Big Data is a trendy term used for various challenges.
Wikipedia defines Big Data and its challenges in Information technology as follows:
big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. Big data usually includes data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process the data within a tolerable elapsed time.
But what is Big Data?
Big Data is the “explosion” that is going on of data. The data is exploding because of fast growing and (unstructured) content like video, images and text but also data from sensors, this is growing fast, maybe even faster other content.
The following movie about Big Data from The Economist (2,21 minutes) gives you an impression about the data explosion that is going on at the moment and in the future:
Interesting is to make a difference between the “traditional” data as used in the Business Intelligence and the “new” data. Traditional transaction data can be summarized as Create, Read, Update, Delete (CRUD). It is structured information stored in the relational databases often generated by Enterprise Resource Systems. Charles Fan (VP R&D VMware) described the “new” data as Create, Replicate, Append, Process (CRAP). This data is not structured and will never disappear. It is getting bigger and bigger so will have Big Data.