‘We’re not moving fast and breaking things’ – ChatGPT-powered GOV.UK chatbot trials show promise but uncover ‘issues of accuracy and reliability’


Government Digital Service has published details of a recent testing exercise for GOV.UK Chat, which revealed both the potential and the pitfalls of deploying generative AI to engage with citizens

The Government Digital Service has pledged to take a “measured” approach to its work on a proposed GOV.UK chatbot, after public trials of the tool – powered by the technology behind ChatGPT – showed promise but shed light on “issues of accuracy and reliability”.

Plans for the platform, dubbed GOV.UK Chat, were revealed several months ago, as the technology entered a comparatively small-scale process of public testing. GDS, which is leading development of the tool, has published an update detailing the findings of that private pilot exercise, in which 1,000 citizens were invited to participate.

A survey of their experiences found that about 65% of participants were satisfied overall, while 70% said they received useful answers from the technology – which, using large language model (LLM) tech from ChatGPT creator OpenAI – is designed to scour content on GOV.UK and use it provide “ a human-like response” to users’ questions.

However, the public testing process found that, ultimately, “answers did not reach the highest level of accuracy demanded for a site like GOV.UK”, according to the GDS update.

There were several so-called hallucinations – the term applied to instances in which an AI system wrongly presents something as fact. These tended to occur when users presented “ambiguous or inappropriate queries”.

The pilot also found that, in some cases, the chatbot was unable to come up with an answer because the GOV.UK page where it could be found was “too long”.


Related content


As work on the development of the technology continues, GDS believes that “accuracy gains could be achieved by improving how we search for relevant GOV.UK information that we pass to the LLM, and by guiding users to phrase clear questions, as well as by exploring ways to generate answers that are better tailored to users’ circumstances”.

The Cabinet Office-based digital unit also acknowledged that, in response to some questions that cannot be answered using GOV.UK content, “it’s clear we need to redirect people in different ways”.

The update added: “We also found that some users underestimated or dismissed the inaccuracy risks with GOV.UK Chat, because of the credibility and duty of care associated with the GOV.UK brand. There were also some misunderstandings about how generative AI works. This could lead to users having misplaced confidence in a system that could be wrong some of the time. We’re working to make sure that users understand inaccuracy risks, and are able to access the reliable information from GOV.UK that they need.”

GDS stressed that, while testing has shown the potential benefits of a government chatbot, it has also highlighted “the nascent nature of this technology”. A careful and considered approach to ongoing work on the platform is therefore required.

“These findings validate why we’re taking a balanced, measured and data driven approach to this technology — we’re not moving fast and breaking things,” GDS said. “We’re innovating and learning while maintaining GOV.UK’s reputation as a highly trusted – according to internal polling – information source and a ubiquitously recognised symbol in the UK. Based on the positive outcomes and insights from this work, we’re rapidly iterating this experiment to address the issues of accuracy and reliability. In parallel we’re exploring other ways in which AI can help the millions of people who use GOV.UK every day.”

Sam Trendall

Learn More →

105 thoughts on “‘We’re not moving fast and breaking things’ – ChatGPT-powered GOV.UK chatbot trials show promise but uncover ‘issues of accuracy and reliability’

  1. Parenting December 1, 2024 at 1:46 am

    A person essentially help to make seriously articles I would state. This is the first time I frequented your web page and thus far? I surprised with the research you made to create this particular publish amazing. Wonderful job!

  2. Hairstyles December 2, 2024 at 11:59 pm

    Hi my loved one! I wish to say that this post is awesome, nice written and come with almost all significant infos. I抎 like to look extra posts like this .

  3. Chanell December 6, 2024 at 9:22 pm

    Wow, what a fantastic piece! Much appreciated for sharing this. This was very helpful and insightful. Take a look at this link about Kanye West posters. For fans of Kanye West, this post is perfect for you. It’s a treasure trove of creativity. Excited about more posts like this from you in the future! https://www.tumblr.com/kanye-west-posters/751574461874094080/kanye-west-posters

  4. Medium Hairstyles December 7, 2024 at 6:17 am

    Wonderful blog! I found it while searching on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Thank you

  5. Health December 7, 2024 at 5:15 pm

    Hello there, just became aware of your blog through Google, and found that it’s really informative. I am going to watch out for brussels. I抣l appreciate if you continue this in future. Numerous people will be benefited from your writing. Cheers!

  6. Shirlene Sdoia December 10, 2024 at 11:32 pm

    amazing blog! since i checked out yours, care to checkout mine? its all about kanye west posters https://sneakerxp.com/communications-mobile-phones/everyone-loves-kanye-west-poster/

  7. Kanye west poster December 11, 2024 at 4:40 am

    I finally ordered a Kanye West Graduation poster, and the quality is out of this world.
    The design is so detailed and crisp, and it adds so much energy to the room.

    Being a collector of Kanye memorabilia, this piece was essential for my collection. The Graduation artwork bring Kanye’s creative vision to my walls.

    I would absolutely recommend this to anyone who
    loves Graduation. Customer service was very helpful, and
    the attention to detail is superb.

    I’m already planning to buy more posters, and I know
    other Kanye fans will love it too. Thanks again for
    the amazing product!

    Here is my web blog – Kanye west poster

  8. Beauty Fashion December 31, 2024 at 8:06 pm

    I really wanted to send a word in order to thank you for those amazing tactics you are sharing here. My prolonged internet look up has now been recognized with beneficial tips to share with my visitors. I would state that that many of us site visitors are very much lucky to dwell in a fine community with many lovely individuals with good methods. I feel rather lucky to have seen your entire webpages and look forward to plenty of more fun minutes reading here. Thank you again for all the details.

  9. Long Hairstyles January 1, 2025 at 9:07 pm

    Hey! This is my first comment here so I just wanted to give a quick shout out and say I genuinely enjoy reading your articles. Can you recommend any other blogs/websites/forums that cover the same subjects? Thank you!

  10. Emory Forrest January 15, 2025 at 11:33 pm

    I will immediately snatch your rss feed as I can not find your email subscription hyperlink or e-newsletter service. Do you’ve any? Please allow me realize so that I could subscribe. Thanks.

  11. medartix.com January 16, 2025 at 3:30 pm

    Really informative blog post.Really looking forward to read more. Keep writing.

  12. 섹스노리야동코리아 January 17, 2025 at 1:08 am

    https://dday.tistory.com/198

  13. Porn January 18, 2025 at 9:07 am

    Sex

  14. bbgo January 19, 2025 at 7:46 pm

    Scam

  15. Viagra January 20, 2025 at 7:04 am

    Pornstar

  16. 섹스노리야동코리아 January 20, 2025 at 10:40 am

    https://download-install.com/tag/km플레이어20구버전

  17. 섹스노리야동코리아 January 22, 2025 at 3:24 am

    https://klero.tistory.com/tag/웅상소식20구인구직

  18. Jorgedak January 22, 2025 at 8:47 am

    mexican mail order pharmacies: Mexican Easy Pharm – Mexican Easy Pharm

  19. Rodneyicems January 23, 2025 at 8:52 am

    medicine in mexico pharmacies https://mexicaneasypharm.com/# buying from online mexican pharmacy
    pharmacies in mexico that ship to usa

  20. 섹스노리야동코리아 January 23, 2025 at 10:32 am

    https://new-software.download/windows/discord/

  21. Rodneyicems January 24, 2025 at 6:00 am

    mexican drugstore online https://mexicaneasypharm.shop/# best online pharmacies in mexico
    best online pharmacies in mexico

  22. 섹스노리야동코리아 January 24, 2025 at 10:28 am

    수원출장샵

  23. 섹스노리야동코리아 January 26, 2025 at 4:47 am

    https://kr.new-version.app/download/nateon/

  24. Albertruith January 26, 2025 at 6:36 am

    https://predpharm.com/# PredPharm
    buy cheap prednisone

  25. Albertruith January 27, 2025 at 11:39 am

    http://dappharm.com/# Priligy tablets
    canadian online pharmacy prednisone

  26. 섹스노리야동코리아 January 27, 2025 at 1:19 pm

    https://honeytipit.tistory.com/tag/돌싱글즈320다시보기

  27. Albertruith January 27, 2025 at 11:13 pm

    https://predpharm.com/# prednisone 50 mg prices
    10 mg prednisone tablets

  28. Bradleydug January 31, 2025 at 3:43 am

    farmaci senza ricetta elenco: BRUFEN prezzo – Farmacia online miglior prezzo
    Farmacie online sicure

  29. LannyRinly January 31, 2025 at 6:57 am

    The casino atmosphere is thrilling and energetic.: phmacao com login – phmacao club

  30. Josephbycle January 31, 2025 at 7:21 am

    taya365 login [url=http://taya365.art/#]taya365 login[/url] The Philippines has several world-class integrated resorts.

  31. Daviddof January 31, 2025 at 8:23 am

    https://phtaya.tech/# Some casinos have luxurious spa facilities.
    The gaming floors are always bustling with excitement.

  32. 섹스노리야동코리아 January 31, 2025 at 10:34 am

    https://bestkkultip.tistory.com/13

  33. WilliamTraix January 31, 2025 at 10:48 am

    Resorts provide both gaming and relaxation options. https://phmacao.life/# Gambling can be a social activity here.

  34. LannyRinly January 31, 2025 at 11:48 am

    The ambiance is designed to excite players.: taya365 – taya365.art

  35. Josephbycle January 31, 2025 at 3:53 pm

    taya777 login [url=https://taya777.icu/#]taya777 app[/url] Slot tournaments create friendly competitions among players.

  36. LannyRinly January 31, 2025 at 4:39 pm

    Players enjoy both fun and excitement in casinos.: phtaya login – phtaya casino

  37. LannyRinly January 31, 2025 at 9:29 pm

    The Philippines has several world-class integrated resorts.: phtaya login – phtaya casino

  38. Josephbycle February 1, 2025 at 12:11 am

    jugabet chile [url=https://jugabet.xyz/#]jugabet chile[/url] Los croupiers son amables y profesionales.

  39. WilliamTraix February 1, 2025 at 1:19 am

    Resorts provide both gaming and relaxation options. http://taya777.icu/# Some casinos feature themed gaming areas.

  40. LannyRinly February 1, 2025 at 2:00 am

    Los casinos ofrecen entretenimiento en vivo.: jugabet chile – jugabet

  41. 섹스노리야동코리아 February 1, 2025 at 5:40 am

    수원출장샵

  42. LannyRinly February 1, 2025 at 6:40 am

    Promotions are advertised through social media channels.: phtaya – phtaya casino

  43. Josephbycle February 1, 2025 at 8:15 am

    phmacao com login [url=https://phmacao.life/#]phmacao casino[/url] The gaming floors are always bustling with excitement.

  44. WilliamTraix February 1, 2025 at 10:45 am

    The casino experience is memorable and unique. http://winchile.pro/# La diversiГіn nunca se detiene en los casinos.

  45. LannyRinly February 1, 2025 at 11:20 am

    The gaming floors are always bustling with excitement.: taya365 com login – taya365

  46. WilliamTraix February 1, 2025 at 3:31 pm

    Resorts provide both gaming and relaxation options. https://jugabet.xyz/# Algunos casinos tienen programas de recompensas.

  47. LannyRinly February 1, 2025 at 4:00 pm

    The ambiance is designed to excite players.: phmacao com login – phmacao.life

  48. Josephbycle February 1, 2025 at 4:18 pm

    winchile [url=http://winchile.pro/#]winchile.pro[/url] Los jugadores deben jugar con responsabilidad.

  49. LannyRinly February 1, 2025 at 8:50 pm

    Las mГЎquinas tienen diferentes niveles de apuesta.: jugabet.xyz – jugabet

  50. https://www.kanyewestposters.com/product/kanye-west-donda-2021-album-cover-tracklist-premium-music-art-canvas February 2, 2025 at 12:20 am

    Wow, this aesthetic piece is absolutely incredible! Kanye’s Graduation era
    was such a milestone in album cover design, and this design truly expresses
    the legacy of that time.

    The bold tones and the famous Kanye bear rocketing through the starry horizon make
    it feel so dreamlike.

    This is definitely a visual gem for any rap!

  51. Josephbycle February 2, 2025 at 12:28 am

    win chile [url=https://winchile.pro/#]winchile casino[/url] Las promociones atraen nuevos jugadores diariamente.

  52. LannyRinly February 2, 2025 at 1:38 am

    Some casinos feature themed gaming areas.: phmacao casino – phmacao com

  53. Josephbycle February 2, 2025 at 10:26 am

    phmacao com login [url=https://phmacao.life/#]phmacao club[/url] Entertainment shows are common in casinos.

  54. LannyRinly February 2, 2025 at 11:52 am

    Game rules can vary between casinos.: phtaya casino – phtaya login

  55. WilliamTraix February 2, 2025 at 5:29 pm

    Live music events often accompany gaming nights. https://winchile.pro/# Los casinos reciben turistas de todo el mundo.

  56. Josephbycle February 2, 2025 at 8:30 pm

    winchile casino [url=http://winchile.pro/#]winchile.pro[/url] La mayorГ­a acepta monedas locales y extranjeras.

  57. LannyRinly February 2, 2025 at 9:45 pm

    Las apuestas mГ­nimas son accesibles para todos.: jugabet casino – jugabet casino

  58. Daviddof February 3, 2025 at 2:43 am

    https://taya365.art/# Gambling regulations are strictly enforced in casinos.
    Visitors come from around the world to play.

  59. LannyRinly February 3, 2025 at 2:44 am

    Es comГєn ver jugadores sociales en mesas.: winchile – win chile

  60. Josephbycle February 3, 2025 at 6:22 am

    phmacao [url=https://phmacao.life/#]phmacao casino[/url] The gaming floors are always bustling with excitement.

  61. LannyRinly February 3, 2025 at 8:05 am

    Los jugadores pueden disfrutar desde casa.: winchile casino – win chile

  62. kanye west graduation album cover poster 24x36 machinist tools February 3, 2025 at 12:08 pm

    Wow, this wall art is absolutely crazy good! Kanye’s Graduation era was such a pivotal chapter in modern sound, and
    this creative explosion truly celebrates the depth of that time.

    The eye-popping palette and the legendary symbol drifting through the otherworldly realm make
    it feel so next-level innovative.

    This is definitely a statement piece for any hip-hop!

  63. LannyRinly February 3, 2025 at 1:11 pm

    Las reservas en lГ­nea son fГЎciles y rГЎpidas.: jugabet casino – jugabet casino

  64. WilliamTraix February 3, 2025 at 2:58 pm

    Players enjoy both fun and excitement in casinos. https://phmacao.life/# Players must be at least 21 years old.

  65. Josephbycle February 3, 2025 at 4:06 pm

    taya777 register login [url=https://taya777.icu/#]taya777 login[/url] Many casinos offer luxurious amenities and services.

  66. LannyRinly February 3, 2025 at 6:17 pm

    La ruleta es un juego emocionante aquГ­.: jugabet.xyz – jugabet

  67. LannyRinly February 3, 2025 at 11:18 pm

    Security measures ensure a safe environment.: phtaya casino – phtaya

  68. 섹스노리야동코리아 February 3, 2025 at 11:34 pm

    벼룩시장 신문그대로보기 (구인구직, 부동산) 벼룩시장 신문그대로보기 바로가기 그리고 지역별 벼룩시장 종이신문그대로보기 방법 (구인구직, 부동산) 알아볼게요. 교차로신문 같이 벼룩시장은 지역별 일자리, 구인구직, 부동산 등 다양한 정보를 제공해요. 교차로신문그대로보기 바로가기는 아래에서 확인하고, 오늘은 벼룩시장 신문그대로보기 바로가기 그리고 사용법 섹스카지노사이트

  69. Josephbycle February 4, 2025 at 1:55 am

    win chile [url=https://winchile.pro/#]win chile[/url] Las apuestas mГ­nimas son accesibles para todos.

  70. WilliamTraix February 4, 2025 at 1:59 am

    The thrill of winning keeps players engaged. http://phmacao.life/# The casino scene is constantly evolving.

  71. Daviddof February 4, 2025 at 3:40 am

    http://taya365.art/# Responsible gaming initiatives are promoted actively.
    The poker community is very active here.

  72. LannyRinly February 4, 2025 at 4:13 am

    Many casinos offer luxurious amenities and services.: taya777 register login – taya777 app

  73. Daviddof February 4, 2025 at 7:46 am

    https://winchile.pro/# Las estrategias son clave en los juegos.
    Casino visits are a popular tourist attraction.

  74. LannyRinly February 4, 2025 at 9:16 am

    Many casinos have beautiful ocean views.: phmacao – phmacao com

  75. WillieBut February 4, 2025 at 1:16 pm

    xxl mexican pharm: mexican mail order pharmacies – xxl mexican pharm

  76. PorterveW February 4, 2025 at 1:37 pm

    online pharmacy delivery usa [url=https://familypharmacy.company/#]Cheapest online pharmacy[/url] Cheapest online pharmacy

  77. 섹스노리야동코리아 February 4, 2025 at 3:57 pm

    https://klero.tistory.com/tag/memory20부하율

  78. WillieBut February 4, 2025 at 6:15 pm

    discount drug mart pharmacy: discount drug pharmacy – discount drug pharmacy

  79. MichaelSep February 4, 2025 at 6:29 pm

    canadian pharmacy no prescription https://megaindiapharm.shop/# indian pharmacy

  80. PorterveW February 4, 2025 at 10:16 pm

    canada drugs online review [url=https://easycanadianpharm.shop/#]easy canadian pharm[/url] easy canadian pharm

  81. WillieBut February 4, 2025 at 11:03 pm

    discount drug mart pharmacy: discount drugs – discount drugs

  82. MichaelSep February 5, 2025 at 2:13 am

    pharmacy coupons https://discountdrugmart.pro/# cheap pharmacy no prescription

  83. WillieBut February 5, 2025 at 4:19 am

    Best online pharmacy: family pharmacy – Cheapest online pharmacy

  84. CharlesThofs February 5, 2025 at 4:52 am

    cheapest pharmacy for prescriptions https://xxlmexicanpharm.com/# purple pharmacy mexico price list

  85. PorterveW February 5, 2025 at 8:06 am

    drug mart [url=https://discountdrugmart.pro/#]discount drugs[/url] drugmart

  86. WillieBut February 5, 2025 at 10:02 am

    Mega India Pharm: Mega India Pharm – indian pharmacy paypal

  87. CharlesThofs February 5, 2025 at 10:43 am

    no prescription pharmacy paypal http://discountdrugmart.pro/# discount drug mart pharmacy

  88. WillieBut February 5, 2025 at 3:59 pm

    buying prescription drugs in mexico: mexican online pharmacies prescription drugs – xxl mexican pharm

  89. CharlesThofs February 5, 2025 at 4:43 pm

    canadian pharmacy coupon https://discountdrugmart.pro/# drugmart

  90. MichaelSep February 5, 2025 at 5:36 pm

    canadian pharmacy world coupons https://familypharmacy.company/# family pharmacy

  91. PorterveW February 5, 2025 at 6:59 pm

    xxl mexican pharm [url=http://xxlmexicanpharm.com/#]xxl mexican pharm[/url] xxl mexican pharm

  92. WillieBut February 5, 2025 at 9:48 pm

    drugmart: discount drugs – discount drug pharmacy

  93. CharlesThofs February 5, 2025 at 10:37 pm

    pharmacy coupons https://xxlmexicanpharm.com/# reputable mexican pharmacies online

  94. CharlesThofs February 6, 2025 at 4:31 am

    canadian pharmacy discount coupon https://discountdrugmart.pro/# discount drug mart

  95. MichaelSep February 6, 2025 at 5:57 am

    pharmacy no prescription required https://discountdrugmart.pro/# discount drug mart

  96. 섹스노리야동코리아 February 6, 2025 at 7:27 am

    https://itgunza.com/3457

  97. WillieBut February 6, 2025 at 9:29 am

    mexican online pharmacies prescription drugs: xxl mexican pharm – purple pharmacy mexico price list

  98. MichaelSep February 6, 2025 at 10:09 am

    canadian online pharmacy no prescription https://xxlmexicanpharm.com/# xxl mexican pharm

  99. WillieBut February 6, 2025 at 3:36 pm

    drugmart: drugmart – drugmart

  100. PorterveW February 6, 2025 at 4:33 pm

    Mega India Pharm [url=http://megaindiapharm.com/#]MegaIndiaPharm[/url] pharmacy website india

  101. CharlesThofs February 6, 2025 at 4:44 pm

    online pharmacy discount code http://discountdrugmart.pro/# drugmart

  102. MichaelSep February 6, 2025 at 6:51 pm

    canadian online pharmacy no prescription https://easycanadianpharm.com/# canada drug pharmacy

  103. WillieBut February 6, 2025 at 9:35 pm

    xxl mexican pharm: mexican drugstore online – xxl mexican pharm

  104. CharlesThofs February 6, 2025 at 10:46 pm

    canada online pharmacy no prescription https://easycanadianpharm.com/# canadian neighbor pharmacy

Leave a Reply