Human Decisions: the real reason for Big Data

It is true and well stated by Joe Hellerstein, CEO of Trifacta. We find ourselves often in love with technology and the development of something and lose site of its real intent. Same is happening with Big Data and the statement that some are making that technology will eventually eliminate the need for a Data Scientist.

Let's remember that humans make qualitative decisions out of the quantitative data that is provided to them, ever faster and more complete by Big Data technology (review article written on this blog). Within the data research process that ends with enough data to make a decision, there is a constant analytical process that asks how can I get to what I want to know using the data I have. The data scientist will always be in control of that process, no matter how much we automate it.

This was well described in Joe's article.