Big Data vs. Business Intelligence

A discussion today involved the perspective that the BI (business intelligence) involves more human-entered data, whereas Big Data is machine generated. The definition of “machine generation” presents itself as one of the first meaningful distinctions of Big Data. Think of it as an analogue to the distinction of “devops” from “infrastructure administration.” We can see it more as a programmatic, even ‘applications’, approach. Let’s consider BI data as the product of human auditors, call center ops, data entry, etc. Big Data can result from log generation, queue statistics, etc. These are both distinct from Data Mining (predictive) and Analytics. One thing this highlights is the role of Big Data in regulatory situations. Sox compliance (and Sarbane Oxley?) is more based on records and assurances (data) that came from human involvement. From this we have compliance standards that define how we collect data. Will we have a consortium for gathering with Big Data mechanisms? Such a body would discuss and advise on regulatory measures of gathering formats (Big Data). With the new collection formats, it may be that no one is asking “Who is being defrauded?” The question’s absence may come simply from the lack of usage of Big Data methods in heavily regulated industries.


© 2001-2023. All rights reserved.

Powered by Hydejack v9.1.6