Government Digital Service has published details of a recent testing exercise for GOV.UK Chat, which revealed both the potential and the pitfalls of deploying generative AI to engage with citizens
The Government Digital Service has pledged to take a “measured” approach to its work on a proposed GOV.UK chatbot, after public trials of the tool – powered by the technology behind ChatGPT – showed promise but shed light on “issues of accuracy and reliability”.
Plans for the platform, dubbed GOV.UK Chat, were revealed several months ago, as the technology entered a comparatively small-scale process of public testing. GDS, which is leading development of the tool, has published an update detailing the findings of that private pilot exercise, in which 1,000 citizens were invited to participate.
A survey of their experiences found that about 65% of participants were satisfied overall, while 70% said they received useful answers from the technology – which, using large language model (LLM) tech from ChatGPT creator OpenAI – is designed to scour content on GOV.UK and use it provide “ a human-like response” to users’ questions.
However, the public testing process found that, ultimately, “answers did not reach the highest level of accuracy demanded for a site like GOV.UK”, according to the GDS update.
There were several so-called hallucinations – the term applied to instances in which an AI system wrongly presents something as fact. These tended to occur when users presented “ambiguous or inappropriate queries”.
The pilot also found that, in some cases, the chatbot was unable to come up with an answer because the GOV.UK page where it could be found was “too long”.
Related content
- Terrorism: Government keeping tabs on potential for radicalising chatbots, minister says
- Artificial intelligence to empower public services, says minister
- Department for Education ‘assessing risks’ of ChatGPT
As work on the development of the technology continues, GDS believes that “accuracy gains could be achieved by improving how we search for relevant GOV.UK information that we pass to the LLM, and by guiding users to phrase clear questions, as well as by exploring ways to generate answers that are better tailored to users’ circumstances”.
The Cabinet Office-based digital unit also acknowledged that, in response to some questions that cannot be answered using GOV.UK content, “it’s clear we need to redirect people in different ways”.
The update added: “We also found that some users underestimated or dismissed the inaccuracy risks with GOV.UK Chat, because of the credibility and duty of care associated with the GOV.UK brand. There were also some misunderstandings about how generative AI works. This could lead to users having misplaced confidence in a system that could be wrong some of the time. We’re working to make sure that users understand inaccuracy risks, and are able to access the reliable information from GOV.UK that they need.”
GDS stressed that, while testing has shown the potential benefits of a government chatbot, it has also highlighted “the nascent nature of this technology”. A careful and considered approach to ongoing work on the platform is therefore required.
“These findings validate why we’re taking a balanced, measured and data driven approach to this technology — we’re not moving fast and breaking things,” GDS said. “We’re innovating and learning while maintaining GOV.UK’s reputation as a highly trusted – according to internal polling – information source and a ubiquitously recognised symbol in the UK. Based on the positive outcomes and insights from this work, we’re rapidly iterating this experiment to address the issues of accuracy and reliability. In parallel we’re exploring other ways in which AI can help the millions of people who use GOV.UK every day.”
A person essentially help to make seriously articles I would state. This is the first time I frequented your web page and thus far? I surprised with the research you made to create this particular publish amazing. Wonderful job!
Hi my loved one! I wish to say that this post is awesome, nice written and come with almost all significant infos. I抎 like to look extra posts like this .
Wow, what a fantastic piece! Much appreciated for sharing this. This was very helpful and insightful. Take a look at this link about Kanye West posters. For fans of Kanye West, this post is perfect for you. It’s a treasure trove of creativity. Excited about more posts like this from you in the future! https://www.tumblr.com/kanye-west-posters/751574461874094080/kanye-west-posters
Wonderful blog! I found it while searching on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Thank you
Hello there, just became aware of your blog through Google, and found that it’s really informative. I am going to watch out for brussels. I抣l appreciate if you continue this in future. Numerous people will be benefited from your writing. Cheers!
amazing blog! since i checked out yours, care to checkout mine? its all about kanye west posters https://sneakerxp.com/communications-mobile-phones/everyone-loves-kanye-west-poster/
I finally ordered a Kanye West Graduation poster, and the quality is out of this world.
The design is so detailed and crisp, and it adds so much energy to the room.
Being a collector of Kanye memorabilia, this piece was essential for my collection. The Graduation artwork bring Kanye’s creative vision to my walls.
I would absolutely recommend this to anyone who
loves Graduation. Customer service was very helpful, and
the attention to detail is superb.
I’m already planning to buy more posters, and I know
other Kanye fans will love it too. Thanks again for
the amazing product!
Here is my web blog – Kanye west poster
I really wanted to send a word in order to thank you for those amazing tactics you are sharing here. My prolonged internet look up has now been recognized with beneficial tips to share with my visitors. I would state that that many of us site visitors are very much lucky to dwell in a fine community with many lovely individuals with good methods. I feel rather lucky to have seen your entire webpages and look forward to plenty of more fun minutes reading here. Thank you again for all the details.
Hey! This is my first comment here so I just wanted to give a quick shout out and say I genuinely enjoy reading your articles. Can you recommend any other blogs/websites/forums that cover the same subjects? Thank you!
I will immediately snatch your rss feed as I can not find your email subscription hyperlink or e-newsletter service. Do you’ve any? Please allow me realize so that I could subscribe. Thanks.
https://download-install.com/entry/KMED948CEBA088EC9DB4EC96B4-64X-EBACB4EBA38C-EB8BA4EC9AB4EBA19CEB939C
Really informative blog post.Really looking forward to read more. Keep writing.
https://dday.tistory.com/198
Sex
Scam
Pornstar
https://download-install.com/tag/km플레이어20구버전
https://klero.tistory.com/tag/웅상소식20구인구직
mexican mail order pharmacies: Mexican Easy Pharm – Mexican Easy Pharm
medicine in mexico pharmacies https://mexicaneasypharm.com/# buying from online mexican pharmacy
pharmacies in mexico that ship to usa
https://new-software.download/windows/discord/
mexican drugstore online https://mexicaneasypharm.shop/# best online pharmacies in mexico
best online pharmacies in mexico
수원출장샵
https://kr.new-version.app/download/nateon/
https://predpharm.com/# PredPharm
buy cheap prednisone
http://dappharm.com/# Priligy tablets
canadian online pharmacy prednisone
https://honeytipit.tistory.com/tag/돌싱글즈320다시보기
https://predpharm.com/# prednisone 50 mg prices
10 mg prednisone tablets
farmaci senza ricetta elenco: BRUFEN prezzo – Farmacia online miglior prezzo
Farmacie online sicure
The casino atmosphere is thrilling and energetic.: phmacao com login – phmacao club
taya365 login [url=http://taya365.art/#]taya365 login[/url] The Philippines has several world-class integrated resorts.
https://phtaya.tech/# Some casinos have luxurious spa facilities.
The gaming floors are always bustling with excitement.
https://bestkkultip.tistory.com/13
Resorts provide both gaming and relaxation options. https://phmacao.life/# Gambling can be a social activity here.
The ambiance is designed to excite players.: taya365 – taya365.art
taya777 login [url=https://taya777.icu/#]taya777 app[/url] Slot tournaments create friendly competitions among players.
Players enjoy both fun and excitement in casinos.: phtaya login – phtaya casino
The Philippines has several world-class integrated resorts.: phtaya login – phtaya casino
jugabet chile [url=https://jugabet.xyz/#]jugabet chile[/url] Los croupiers son amables y profesionales.
Resorts provide both gaming and relaxation options. http://taya777.icu/# Some casinos feature themed gaming areas.
Los casinos ofrecen entretenimiento en vivo.: jugabet chile – jugabet
수원출장샵
Promotions are advertised through social media channels.: phtaya – phtaya casino
phmacao com login [url=https://phmacao.life/#]phmacao casino[/url] The gaming floors are always bustling with excitement.
The casino experience is memorable and unique. http://winchile.pro/# La diversiГіn nunca se detiene en los casinos.
The gaming floors are always bustling with excitement.: taya365 com login – taya365
Resorts provide both gaming and relaxation options. https://jugabet.xyz/# Algunos casinos tienen programas de recompensas.
The ambiance is designed to excite players.: phmacao com login – phmacao.life
winchile [url=http://winchile.pro/#]winchile.pro[/url] Los jugadores deben jugar con responsabilidad.
Las mГЎquinas tienen diferentes niveles de apuesta.: jugabet.xyz – jugabet
Wow, this aesthetic piece is absolutely incredible! Kanye’s Graduation era
was such a milestone in album cover design, and this design truly expresses
the legacy of that time.
The bold tones and the famous Kanye bear rocketing through the starry horizon make
it feel so dreamlike.
This is definitely a visual gem for any rap!
win chile [url=https://winchile.pro/#]winchile casino[/url] Las promociones atraen nuevos jugadores diariamente.
Some casinos feature themed gaming areas.: phmacao casino – phmacao com
phmacao com login [url=https://phmacao.life/#]phmacao club[/url] Entertainment shows are common in casinos.
Game rules can vary between casinos.: phtaya casino – phtaya login
Live music events often accompany gaming nights. https://winchile.pro/# Los casinos reciben turistas de todo el mundo.
winchile casino [url=http://winchile.pro/#]winchile.pro[/url] La mayorГa acepta monedas locales y extranjeras.
Las apuestas mГnimas son accesibles para todos.: jugabet casino – jugabet casino
https://taya365.art/# Gambling regulations are strictly enforced in casinos.
Visitors come from around the world to play.
Es comГєn ver jugadores sociales en mesas.: winchile – win chile
phmacao [url=https://phmacao.life/#]phmacao casino[/url] The gaming floors are always bustling with excitement.
Los jugadores pueden disfrutar desde casa.: winchile casino – win chile
Wow, this wall art is absolutely crazy good! Kanye’s Graduation era was such a pivotal chapter in modern sound, and
this creative explosion truly celebrates the depth of that time.
The eye-popping palette and the legendary symbol drifting through the otherworldly realm make
it feel so next-level innovative.
This is definitely a statement piece for any hip-hop!
Las reservas en lГnea son fГЎciles y rГЎpidas.: jugabet casino – jugabet casino
Players enjoy both fun and excitement in casinos. https://phmacao.life/# Players must be at least 21 years old.
taya777 register login [url=https://taya777.icu/#]taya777 login[/url] Many casinos offer luxurious amenities and services.
La ruleta es un juego emocionante aquГ.: jugabet.xyz – jugabet
Security measures ensure a safe environment.: phtaya casino – phtaya
벼룩시장 신문그대로보기 (구인구직, 부동산) 벼룩시장 신문그대로보기 바로가기 그리고 지역별 벼룩시장 종이신문그대로보기 방법 (구인구직, 부동산) 알아볼게요. 교차로신문 같이 벼룩시장은 지역별 일자리, 구인구직, 부동산 등 다양한 정보를 제공해요. 교차로신문그대로보기 바로가기는 아래에서 확인하고, 오늘은 벼룩시장 신문그대로보기 바로가기 그리고 사용법 섹스카지노사이트
win chile [url=https://winchile.pro/#]win chile[/url] Las apuestas mГnimas son accesibles para todos.
The thrill of winning keeps players engaged. http://phmacao.life/# The casino scene is constantly evolving.
http://taya365.art/# Responsible gaming initiatives are promoted actively.
The poker community is very active here.
Many casinos offer luxurious amenities and services.: taya777 register login – taya777 app
https://winchile.pro/# Las estrategias son clave en los juegos.
Casino visits are a popular tourist attraction.
Many casinos have beautiful ocean views.: phmacao – phmacao com
xxl mexican pharm: mexican mail order pharmacies – xxl mexican pharm
online pharmacy delivery usa [url=https://familypharmacy.company/#]Cheapest online pharmacy[/url] Cheapest online pharmacy
https://klero.tistory.com/tag/memory20부하율
discount drug mart pharmacy: discount drug pharmacy – discount drug pharmacy
canadian pharmacy no prescription https://megaindiapharm.shop/# indian pharmacy
canada drugs online review [url=https://easycanadianpharm.shop/#]easy canadian pharm[/url] easy canadian pharm
discount drug mart pharmacy: discount drugs – discount drugs
pharmacy coupons https://discountdrugmart.pro/# cheap pharmacy no prescription
Best online pharmacy: family pharmacy – Cheapest online pharmacy
cheapest pharmacy for prescriptions https://xxlmexicanpharm.com/# purple pharmacy mexico price list
drug mart [url=https://discountdrugmart.pro/#]discount drugs[/url] drugmart
Mega India Pharm: Mega India Pharm – indian pharmacy paypal
no prescription pharmacy paypal http://discountdrugmart.pro/# discount drug mart pharmacy
buying prescription drugs in mexico: mexican online pharmacies prescription drugs – xxl mexican pharm
canadian pharmacy coupon https://discountdrugmart.pro/# drugmart
canadian pharmacy world coupons https://familypharmacy.company/# family pharmacy
xxl mexican pharm [url=http://xxlmexicanpharm.com/#]xxl mexican pharm[/url] xxl mexican pharm
drugmart: discount drugs – discount drug pharmacy
pharmacy coupons https://xxlmexicanpharm.com/# reputable mexican pharmacies online
canadian pharmacy discount coupon https://discountdrugmart.pro/# discount drug mart
pharmacy no prescription required https://discountdrugmart.pro/# discount drug mart
https://itgunza.com/3457
mexican online pharmacies prescription drugs: xxl mexican pharm – purple pharmacy mexico price list
canadian online pharmacy no prescription https://xxlmexicanpharm.com/# xxl mexican pharm
drugmart: drugmart – drugmart
Mega India Pharm [url=http://megaindiapharm.com/#]MegaIndiaPharm[/url] pharmacy website india
online pharmacy discount code http://discountdrugmart.pro/# drugmart
canadian online pharmacy no prescription https://easycanadianpharm.com/# canada drug pharmacy
xxl mexican pharm: mexican drugstore online – xxl mexican pharm
canada online pharmacy no prescription https://easycanadianpharm.com/# canadian neighbor pharmacy