Government Digital Service has published details of a recent testing exercise for GOV.UK Chat, which revealed both the potential and the pitfalls of deploying generative AI to engage with citizens
The Government Digital Service has pledged to take a “measured” approach to its work on a proposed GOV.UK chatbot, after public trials of the tool – powered by the technology behind ChatGPT – showed promise but shed light on “issues of accuracy and reliability”.
Plans for the platform, dubbed GOV.UK Chat, were revealed several months ago, as the technology entered a comparatively small-scale process of public testing. GDS, which is leading development of the tool, has published an update detailing the findings of that private pilot exercise, in which 1,000 citizens were invited to participate.
A survey of their experiences found that about 65% of participants were satisfied overall, while 70% said they received useful answers from the technology – which, using large language model (LLM) tech from ChatGPT creator OpenAI – is designed to scour content on GOV.UK and use it provide “ a human-like response” to users’ questions.
However, the public testing process found that, ultimately, “answers did not reach the highest level of accuracy demanded for a site like GOV.UK”, according to the GDS update.
There were several so-called hallucinations – the term applied to instances in which an AI system wrongly presents something as fact. These tended to occur when users presented “ambiguous or inappropriate queries”.
The pilot also found that, in some cases, the chatbot was unable to come up with an answer because the GOV.UK page where it could be found was “too long”.
Related content
- Terrorism: Government keeping tabs on potential for radicalising chatbots, minister says
- Artificial intelligence to empower public services, says minister
- Department for Education ‘assessing risks’ of ChatGPT
As work on the development of the technology continues, GDS believes that “accuracy gains could be achieved by improving how we search for relevant GOV.UK information that we pass to the LLM, and by guiding users to phrase clear questions, as well as by exploring ways to generate answers that are better tailored to users’ circumstances”.
The Cabinet Office-based digital unit also acknowledged that, in response to some questions that cannot be answered using GOV.UK content, “it’s clear we need to redirect people in different ways”.
The update added: “We also found that some users underestimated or dismissed the inaccuracy risks with GOV.UK Chat, because of the credibility and duty of care associated with the GOV.UK brand. There were also some misunderstandings about how generative AI works. This could lead to users having misplaced confidence in a system that could be wrong some of the time. We’re working to make sure that users understand inaccuracy risks, and are able to access the reliable information from GOV.UK that they need.”
GDS stressed that, while testing has shown the potential benefits of a government chatbot, it has also highlighted “the nascent nature of this technology”. A careful and considered approach to ongoing work on the platform is therefore required.
“These findings validate why we’re taking a balanced, measured and data driven approach to this technology — we’re not moving fast and breaking things,” GDS said. “We’re innovating and learning while maintaining GOV.UK’s reputation as a highly trusted – according to internal polling – information source and a ubiquitously recognised symbol in the UK. Based on the positive outcomes and insights from this work, we’re rapidly iterating this experiment to address the issues of accuracy and reliability. In parallel we’re exploring other ways in which AI can help the millions of people who use GOV.UK every day.”
A person essentially help to make seriously articles I would state. This is the first time I frequented your web page and thus far? I surprised with the research you made to create this particular publish amazing. Wonderful job!
Hi my loved one! I wish to say that this post is awesome, nice written and come with almost all significant infos. I抎 like to look extra posts like this .
Wow, what a fantastic piece! Much appreciated for sharing this. This was very helpful and insightful. Take a look at this link about Kanye West posters. For fans of Kanye West, this post is perfect for you. It’s a treasure trove of creativity. Excited about more posts like this from you in the future! https://www.tumblr.com/kanye-west-posters/751574461874094080/kanye-west-posters
Wonderful blog! I found it while searching on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Thank you
Hello there, just became aware of your blog through Google, and found that it’s really informative. I am going to watch out for brussels. I抣l appreciate if you continue this in future. Numerous people will be benefited from your writing. Cheers!
amazing blog! since i checked out yours, care to checkout mine? its all about kanye west posters https://sneakerxp.com/communications-mobile-phones/everyone-loves-kanye-west-poster/
I finally ordered a Kanye West Graduation poster, and the quality is out of this world.
The design is so detailed and crisp, and it adds so much energy to the room.
Being a collector of Kanye memorabilia, this piece was essential for my collection. The Graduation artwork bring Kanye’s creative vision to my walls.
I would absolutely recommend this to anyone who
loves Graduation. Customer service was very helpful, and
the attention to detail is superb.
I’m already planning to buy more posters, and I know
other Kanye fans will love it too. Thanks again for
the amazing product!
Here is my web blog – Kanye west poster
I really wanted to send a word in order to thank you for those amazing tactics you are sharing here. My prolonged internet look up has now been recognized with beneficial tips to share with my visitors. I would state that that many of us site visitors are very much lucky to dwell in a fine community with many lovely individuals with good methods. I feel rather lucky to have seen your entire webpages and look forward to plenty of more fun minutes reading here. Thank you again for all the details.
Hey! This is my first comment here so I just wanted to give a quick shout out and say I genuinely enjoy reading your articles. Can you recommend any other blogs/websites/forums that cover the same subjects? Thank you!
I will immediately snatch your rss feed as I can not find your email subscription hyperlink or e-newsletter service. Do you’ve any? Please allow me realize so that I could subscribe. Thanks.
https://download-install.com/entry/KMED948CEBA088EC9DB4EC96B4-64X-EBACB4EBA38C-EB8BA4EC9AB4EBA19CEB939C
Really informative blog post.Really looking forward to read more. Keep writing.
https://dday.tistory.com/198
Sex
Scam
Pornstar
https://download-install.com/tag/km플레이어20구버전
https://klero.tistory.com/tag/웅상소식20구인구직
mexican mail order pharmacies: Mexican Easy Pharm – Mexican Easy Pharm
medicine in mexico pharmacies https://mexicaneasypharm.com/# buying from online mexican pharmacy
pharmacies in mexico that ship to usa