The potential of Big Data may never be delivered thanks to a knowledge gap between Big Data workers and the decision makers actually commissioning Big Data projects.
According to a survey of 131 members of the “Big Data London” group by real time analytics company Acunu, more than three quarters of Big Data workers in the UK are suffering from a lack of training, with the majority being forced to learn on the job in order to keep up to date with the latest skills.
But formal training is not seen as a solution to the problem as when it comes to keeping up to date with the latest Big Data skills, 80% thought that on the job learning was the best method, while 72% said self-teaching was the answer.
“It’s easy to look at a skills shortage and blame a lack of training on traditional educational routes, but when you’re on the cutting edge of technology, you have to be teaching yourself most of the time,” said Manu Marchal, Acunu director and Big Data London organiser.
Over a quarter of respondents said they do not believe business decision makers are currently exploiting Big Data within their organisation, with “underutilisation of Big Data” (66%) and “having unrealistic expectations for Big Data” (66%) cited as key concerns.
Hadoop remains the most sought after big data sector skill with real-time analytics named as a priority by 62% of respondents with skills in NoSQL databases Cassandra and Mongo keenly sought after.
“Hadoop is becoming mainstream and it’s no surprise skills in the area are sought after, but it’s clear that the next wave is real time analytics, operational analytics, low latency analytics,” said Marchal.
The Big Data London community was founded in February 2011 and currently has over 1,350 members.