What is SAP's approach to managing big data?
The big data hype machine is in full swing and buzzwords are flying left and right. Big data has always existed, but its definition has changed over time as computing power has improved. Today, if we're talking about big data, we're probably talking about data sets in the petabyte (1,000 terabytes, 1,000,000 gigabytes) order of magnitude.
For more on SAP and data management:
What are the data warehousing options for SAP landscapes?
The new NLS application is changing the SAP data management equation
Top tips for SAP BW
SAP's HANA project parted ways with the rest of the industry by keeping relatively large data sets (terabytes) in memory. Over the last couple of years, the industry has come around on SAP's approach. But a terabyte is no longer so big. While it may be technically possible (SAP has built a petabyte HANA cluster), most analytics scenarios won't justify the cost of keeping petabytes of data in RAM on HANA.
SAP's big data strategy centers around HANA but farms out really big data to SAP's Sybase IQ product (recently renamed as SAP IQ) or Hadoop clusters (via Hive) -- technologies designed to store and query very large data sets cost-effectively. The data appears to be in HANA, but is actually stored in IQ or Hive. IQ is also an excellent and widely used option standalone (without HANA) for analytics on very large data.
This strategy to manage big data on a fit-for-purpose database promises to allow customers to balance speed against cost. Customers should stay up to speed on the options available to them so that they can balance this equation effectively.
Dig deeper on SAP ERP software
Related Q&A from Ethan Jewett
While many have criticized SAP's cloud strategy for being unclear and erratic in the past, it's beginning to fall into place, writes Ethan Jewett.continue reading
Do you need an SAP data mart, or a data warehouse? It depends if you need to deploy data across an enterprise, or need something more focused.continue reading
BI expert Ethan Jewett explains how running SAP Business Warehouse, or BW, on the SAP HANA database works, and what the advantages are.continue reading
Have a question for an expert?
Please add a title for your question
Get answers from a TechTarget expert on whatever's puzzling you.