Lost data on 16,000 coronavirus cases pinned on Excel

Written by Sam Trendall on 6 October 2020 in News
News

The limitations of the popular Microsoft software likely caused the delays in processing data

Credit: Christian Dorn from Pixabay

The failure to enter the details of 16,000 coronavirus cases into the NHS Test and Trace system seems to have been caused by ill-advised use of Microsoft Excel software.

Between 25 September and 2 October, details of 15,841 people to have tested positive for coronavirus in the UK were not provided to the contact-tracing scheme as part of the daily data submission from Public Health England. These have since been belatedly added to the system, resulting in a big spike in daily cases reported on Saturday and Sunday.

Speaking in the House of Commons yesterday, health and social care secretary Matt Hancock said that the temporary loss of the data came as a result of a  “specific issue [that] was in a PHE legacy computer system that we had already identified needed replacing”.

It is understood that details on coronavirus cases was received by PHE – as purely text data – in CSV file formats. This information was then transferred to Excel, which limits input to a little over a million rows of values.


Related content


If, as is reported by the BBC, PHE uses not just CSV, but also the 33-year-old XLS file format, the number of rows is limited to 65,000. With each case requiring multiple rows, the number of actual cases able to be entered into an XLS file could have been limited to several thousand – with any data beyond this that was provided to the government agency being cut off when it was entered into a spreadsheet to be passed on to the Test and Trace programme.

Even before the limitations of the current system caused the issue with the missing data, Hancock said that “I had already commissioned the replacement of it and that replacement is currently being built”.

“We knew that this was a system that needed replacing,” he added. “That work is underway, at the same time as the remedial action to sort the problem more immediately.”

With each confirmed case reporting an average of about four close contacts each, the delay in providing the data will likely mean that contact tracers were unable to get in touch with more than 60,000 people that might otherwise have been advised to self-isolate.

“The chief medical officer [Chris Whitty] has analysed the new data,” Hancock told the Commons. “The CMO’s advice is that the assessment of the disease and its impact have not substantially changed. That is because the just under 16,000 cases were essentially evenly spread, so it has not changed the shape of the epidemic. It has changed the level, in terms of where we are finding the epidemic and in what sorts of groups.”

 

About the author

Sam Trendall is editor of PublicTechnology

Share this page

Tags

Categories

CONTRIBUTIONS FROM READERS

Please login to post a comment or register for a free account.

Related Articles

Ageing NHS IT slowed flow of data on vulnerable citizens, NAO finds
21 May 2021

Report identifies delays in accessing information to alert those that needed to shield as chief auditor points to ‘challenges posed by legacy data and IT systems’

A closer look: what now for the government’s vaccine passport plans?
29 April 2021

PublicTechnology examines the government’s strategy for offering a digital certification tool, and its key advantages and challenges

MPs find data gaps caused up to 800,000 to miss out on shielding support
23 April 2021

The Public Accounts Committee finds a lack of information and collaboration could have seen many ‘slip through the net’

Related Sponsored Articles

"The inflection point is here": how Covid is driving digital transformation in health
9 June 2021

It’s been one of the most challenging years for healthcare providers, but Salesforce sees lasting change from accelerated digital transformation

Social justice: how the police can embrace online channels of citizen communication
17 June 2021

PublicTechnology talks to Salesforce about why police forces need to adopt new omnichannel capabilities, offer the public channel choice and the benefits of doing so

The largest ever UK public sector cloud transformation unlocks cost savings and innovation
17 May 2021

Cloud-based applications can provide ways for agencies and departments to innovate and operate in new ways, as the past year has highlighted they must, writes Oracle 

Stopping Cyber Attacks in Higher Education
19 April 2021

Higher Education institutions are some of the most consistently targeted organisations for cyberattacks. CrowdStrike explores the importance of the right cybersecurity measures.