GDS introduces algorithmic ‘related content’ links to GOV.UK
Tests show users click on automatically chosen links and make less use of search
The Government Digital Service (GDS) is introducing ‘related content’ boxes generated by an algorithm across GOV.UK, following random tests on whether users clicked on them.
Around 2,000 GOV.UK pages already had such boxes, shown on the right-hand side of pages such as that for UK bank holidays. But the links are chosen by human editors, meaning a lot of effort would be required to extend these across the site.
GDS used an A/B test, where users were randomly served a GOV.UK page with or without a related content box of automatically-generated links. Versions of algorithms were tested for about a week, and staff wrote software to analyse the results immediately on completion of each test, allowing them to make adjustments rapidly.
In a blogpost, GDS data scientists Suganya Sivaskantharajah and Mat Gregory said that users clicked on related links in more than 2.4% of cases for the best-scoring algorithms and used the internal search service 20%-40% less, the latter suggesting they were finding what they wanted through the links. They added that having considered other criteria, GDS has chosen the Node2Vec algorithm, created by researchers at Stanford University, to generate links as it has more potential for improvement.
“We decided that we would not replace the hand-curated links in those 2,000 pages that had them, as despite how good our algorithms are at the moment, they still do not have the same context as a subject matter expert,” Sivaskantharajah and Gregory added.
The work to introduce this appears to be ongoing, as the GOV.UK page used as an example in the blogpost on paternity pay and leave is currently not showing a related content box.
At the recent Local Government ICT Summit, PublicTechnology talked to Gloucestershire County Council and SAP Concur about how authorities can support new ways of working
The nation's expertise in online services and transformation could help forge connections with other countries, according to Tanya Filer from Cambridge University and Antonio Weiss of The PSC
Digital agency offers salary of £168k in search for first permanent head in more than a year
Boris Johnson tells select committee that pandemic response has shown ‘there are some times when we need to move faster’
Accessibility requirements aren’t restrictions that need to be overcome - they’re guidelines to improve online experiences for everyone, says Jadu VP Richard Friend
2020 has been a year of unprecedented change for the UK public sector. Today’s agile working technology enables you to meet citizen needs in this challenging operating environment by empower your...
Organisations need to understand that a single cybersecurity solution alone is not infallible and instead should move towards a multi-layered approach to security, according to experts from...
SAP Concur says it's time for the public sector to embrace more efficient invoice management technology