The Data Day, A few days: October 19-25 2013

Hadoop and Teradata go to the cloud. And more.

And that’s the data day, today.

The Data Day, A few days: March 29-April 8 2013

Tableau preps IPO. Funding for SiSense and Deep. And more.

* For 451 Research clients: Citus Data brings SQL to foreign data environments, starting with Hadoop

* For 451 Research clients: With $20m in series B funding in the bag, Platfora makes its Hadoop-based analysis debut

* Tableau Software Files Registration Statement For Proposed Initial Public Offering.

* SiSense raises $10m series B funding.

* Deep Information Sciences scores $10M for its general-purpose database.

* IBM launches BLU Acceleration, PureData System for Hadoop.

* SAP: Is HANA growth overstated?

* VMWare announces the launch of Serengeti 0.8.0.

* MySQL and the forks in the road.

The Data Day, A few days: March 25-28 2013

Google pledges patent support for OSS. Basho open sources Riak CS. And more

And that’s the data day, today.

The Data Day, Two days: November 12/13 2012

Platfora raises $20m. IBM trumpets ‘integration anywhere’. And more

And that’s the Data Day, today.

The Data Day, The week that was: October 22-26 2012

Cloudera launches Impala. Actuate snags Quiterian. Microsoft previews HDInsight.

And the rest:
– Microsoft previewed its Windows Azure HDInsight Service and Microsoft HDInsight Server for Windows.

– SAP launched a new “big data” bundle and go-to-market strategy.

– Informatica introduced Informatica PowerCenter Big Data Edition and reported its third quarter results.

– Also announcing financial results last week were QlikTech and Pervasive.

– Teradata updated its Unity suite with the addition of Unity Loader, and introduced its Unified Data Environment and the Unified Data Architecture.

– Splunk confirmed the release of Splunk Hadoop Connect and the Splunk App for HadoopOps.

– 10gen added five vice presidents to its management team.

– Rackspace partnered with Hortonworks to create OpenStack and Hadoop-based offerings for public and private cloud.

– Talend added support for Cassandra, HBase and MongoDB , and introduced big data profiling for Apache Hadoop to its integration platform

– MarkLogic announced support for HDFS and expanded its relationship with Hortonworks.

– Kognitio adopted a free licensing model.

– Calpont launched InfiniDB 3.5.

– MetaMarkets announced that it is open sourcing its Druid streaming, real-time data store.

– YarcData updated its uRiKA Big Data appliance for graph analytics.

– Alpine Data Labs announced a global OEM partnership with QlikTech.

– Actian and Attunity announced Attunity Replicate for Actian Vectorwise.

And that’s the Data Day, today.

Hadoop’s potential to revolutionise the IT industry

Platfora’s CEO Ben Werther recently wrote a great post explaining the benefits of Apache Hadoop and its potential to play a major role in a modern-day equivalent of the industrial revolution.

Ben highlights one of the important aspects of our Total Data concept, that generating value from data is about more than just the volume, variety, and velocity of ‘big data’, but also the way in which the user wants to interact with their data.

“What has changed – the heart of the ‘big data’ shift – is only peripherally about the volume of data. Companies are realizing that there is surprising value locked up in their data, but in unanticipated ways that will only emerge down the road.”

He also rightly points out that while Hadoop provides what is fast-becoming the platform of choice for storing all of this data, from an industrial revolution perspective we are still reliant on the equivalent of expert blacksmiths to make sense of all the data.

“Since every company of any scale is going to need to leverage big data, as an industry we either need to train up hundreds of thousands of expert blacksmiths (aka data scientists) or find a way into the industrialized world (aka better tools and technology that dramatically lower the bar to harnessing big data).”

This is a point that Cloudera CEO Mike Olson has been making in recent months. As he stated during his presentation at last month’s OSBC: “we need to see a new class of applications that exploit the benefits and architecture of Hadoop.”

There has been a tremendous amount of effort in the past 12-18 months to integrate Hadoop into the existing data management landscape, via the development of uni- and bi-directional connectors and translators that enable the co-existence of Hadoop with existing relational and non-relational databases and SQL analytics and reporting tools.

This is extremely valuable – especially for enterprises with a heavy investment in SQL tools and skills. As Larry Feinsmith, Managing Director, Office of the CIO, JPMorgan Chase pointed out at last year’s Hadoop World: “it is vitally important that new big data tools integrate with existing products and tools”.

This is why ‘dependency’ (on existing tools/skills) is an integral element of the Total Data concept alongside totality, exploration and frequency.

However, this integration of Hadoop into the established data management market really only gets the industry so far, and in doing-so maintains the SQL-centric view of the world that has dominated for decades.

As Ben suggests, the true start of the ‘industrial revolution’ will begin with the delivery of tools that are specifically designed to take advantage of Hadoop and other technologies and that bring the benefits of big data to the masses.

We are just beginning to see the delivery of these tools and to think beyond the SQL-centric perspective with analytics approaches specifically designed to take advantage of MapReduce and/or the Hadoop Distributed File System. This again though, signals only the end of the beginning of the revolution.

‘Big data’ describes the realization of greater business intelligence by storing, processing and analyzing data that was previously ignored due to the limitations of traditional data management technologies.

The true impact of ‘big data’ will only be realised once people and companies begin to change their behaviour, using this greater business intelligence gained from using tools specifically designed to exploit the benefits and architecture of Hadoop and other emerging data processing technologies, to alter business processes and practices.