Story image

Gartner: Big Data is pregnant with analytics

25 Jun 2015

We are at the interesting point: big data time is over. It is now big data analytics time.

Many organiszations are at the point when they have figured out how to get data in Hadoop (or other big data stores), but not — how to get the data out and derive value from it. These companies are becoming increasingly nervous under the pressure of rapidly growing amounts of unprocessed data (a.k.a. WRITE ONLY data that nobody will ever read).

The convergence of cloud, mobility and social computing that started several years ago culminated now in the first truly widespread big data analytics use case — the Internet of Things, IoT. Companies in very different industries — insurance, oil and gas, healthcare, transportation and agriculture among many others — are deploying sensors and collecting data, generated by them.

The rise of data lakes reflects the nature of the current point in time. Data lakes signify uncertainty, when organizations want to store more and more data generated with enormous speed, hoping to make sense of this data someday. Companies need a conventional name for a data storage that allows them to keep their options open for future analysis — this is a data lake. The more data is in the lake, the harder it is to separate the signal from the noise. The signal is there, among a myriad of other signals, go fish.

Analytics is the way out of the data lakes, it will help to find value in big data stores. However, analytics is now different: it is not just a clever tool for analysis, but also the whole architecture to put data in the analytic-ready form. And remember, it is big data analytics — different solutions and algorithms are required at scale.

Moore’s law is still hard at work: for example, server memory is measured now in terabytes compared to gigabytes two years ago, so clusters of severs can keep tens of terabytes in memory — this paves the road to fast in-memory analytics. Apache Spark — a fast, in-memory processing and analytical framework — came to focus at the right time, in the right place: it is leading the shift from big data storage to big data analysis.

In early 2014, I wrote in a blog post, “The rocket ship of big data analytics is launched and on its way to orbit.” Happy to report: the rocket ship of big data analytics reached orbit!

By Svetlana Sicular, Gartner

How Red Hat aims to accelerate business value with container technologies
Red Hat announced that leading global companies are creating, extending and deploying integration services across hybrid and multicloud environments using agile integration architectures based on Red Hat technologies.
IT employers having to up salaries and bonuses to attract talent
As the modern economy relies increasingly on data, it’s certainly a good time to be working in IT.
Red Hat expands integration product capabilities
Adds end-to-end API lifecycle support and new capabilities for agile integration across hybrid architectures.
Electric car infrastructure needs to be a high priority
“Australians should be able to drive all over this massive nation with complete confidence in a zero-emission vehicle.”
Oracle updates enterprise blockchain platform
Oracle’s enterprise blockchain has been updated to include more capabilities to enhance development, integration, and deployment of customers’ new blockchain applications.
BMC adds IBM Cloud, Watson to Helix solution
BMC Helix with IBM Watson delivers cognitive insights across structured and unstructured federated knowledgebases.
Hyundai works with IBM to create a new blockchain-based platform
The network for commercial financing will supposedly provide participants with a single view of all the transactions happening in the network.
Why businesses should invest in energy automation
In industrial applications digital transformation allows businesses to do more with less.