Future of Data Warehousing

Architecture of data warehouses has been relatively stable. But this may changes soon according to a recent article in twdi. Various disruptive technologies may be a contributing factor to this change. Here is a very standard EDW pattern commonly seen in enterprises.

Buzz around Big data

Buzz around Big data is getting louder and louder these days. I found a succinct definition of Big Data from a research paper published from McKinsey Global Institute:

“Big data” refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.

Data sets are becoming bigger and bigger and the same time it is becoming cheaper to store data. I can relate to some of it. Quite a few years ago my desktop had only 540MB of disk space. This year, I bought a 1TB disk for my desktop. Interestingly, I am filling up my new disk quickly with all the video files I am downloading from camcorder and camera.

With sensors collecting zillions of data, millions of social network users sharing humongous volume of data, “big data” is very close to home. So, what was a subject of discussion in research labs is quite main stream now. But storing the data is only one challenge. If we don’t have the right tool to analyze big data sets, we may not get the value out of it.

Although, all sectors are poised to gain from application of Big Data, Some sectors may benefit more from the rest of the industry. Retail, Healthcare and Government sectors are predicted to reap the benefit of utilizing Big Data.

Business Intelligence tools

Business Intelligence is how we convert data to intelligence. I was looking at a few BI tools. Here are some details:

SAP Crystal Reports

• Connect to virtually any data source, design and format interactive reports, and share them internally or externally.

SAP BusinessObjects Analysis, edition for OLAP

• Perform analysis of multi-dimensional data sets using this OLAP tool designed for financial and business analysts.

SAP BusinessObjects Analysis, edition for Microsoft

• Perform advanced analysis of data residing in your business warehouse (BW) using an intuitive UI within your Microsoft Office environment.

SAP BusinessObjects Web Intelligence

• Perform ad hoc queries and intuitive analysis across heterogeneous data sources online or offline.

SAP BusinessObjects Predictive Analysis

• Mine your information assets to predict future trends.

Oracle Business Intelligence Enterprise Edition 11g (OBIEE)

• Oracle’s comprehensive business intelligence platform that delivers a full range of analytic and reporting capabilities.

SAS Enterprise Business Intelligence

• Provides a complete portfolio of business intelligence capabilities and applies the power of SAS Analytics and Data Integration to create a complete and easy-to-use business intelligence solution.

SAS Office Analytics

· Delivers the robust power of SAS Analytics in a familiar Microsoft Office interface, promoting collaboration and self-service analytics reporting for business users.

SAS Visual Analytics

· Lets you explore big data using in-memory capabilities to better understand all of your data, discover new patterns and publish reports to the Web and iPad^®.

SAS Visual BI

· Offers dynamic and interactive business visualization that lets business users visually explore ideas and information.

MicroStrategy 9

• MicroStrategy Mobile extends MicroStrategy 9 software platform to mobile devices quickly and easily, and provides intuitive business intelligence that is optimized for the mobile user.

QlikView

• Self service BI tool

Tableau 7.0

• Interactive data visualization tool.

Arcplan Enterprise

• Business intelligence reporting and analytics platform.
• Flexible software for creation of BI applications such as reports, dashboards, ad-hoc analyses, forecasts, etc.

IBM Cognos

• Allows you to do reporting, analysis, scorecards, dashboards
• Provides support for mobile access, statistics, collaborative business intelligence

Panorama Necto

• Socially-enabled Business Intelligence solution

Panorama NovaView

• Web-based Business Intelligence product suite that span BI functionality including analytics, reporting, dashboarding, scorecarding and advanced visualization.

WebFOCUS Business Intelligence

• Dashboards and scorecards
• Query and analysis tools and ad hoc reporting
• Mobile BI, Guided ad hoc reporting