James Spencer, analyst consultant at Praescient, believes coordination between the data analyst and data engineer is key in work to extract insights from big data.
“The problem as I see it is that many enterprises deal with analysis and engineering as two separate entities that don’t really talk to each other,” Spencer said Friday.
He said the data scientists and analysts “need to talk to each other and figure out what it is they are trying to answer.”
“Analysts will start to understand what some of the technical limits are with their tools, such as the limits on the size of data that can be imported, or that it can only be analyzed at a certain speed,” Spencer added,
He also believes data scientists will be able to understand how analysts work on the software to gain value from the product.
Spencer cited research and development, genomic information, flight test data and healthcare as some of the sectors to which big data analytics can be applied.