When did the era of big data begin?

The first stage is the operational system phase. In the seventies and eighties of the last century, the records generated by users when shopping were entered into the database one by one, and these operating systems generated these data at that time.

The third stage is the perceptual system stage. The real change from quantitative to qualitative changes in the era of big data is that the way data is generated has reached the third stage - the perceptual system stage.

The perceptual system stage is the large-scale popularization of the Internet of Things, and the rapid development of the Internet of Things has finally brought the era of big data to the end.

Big data is an inevitable product of the development of the Internet to a certain stage:

As the Internet's ability to integrate resources is constantly increasing, the Internet itself must reflect its own value through data, so from this point of view, big data is acting as the embodiment of the value of the Internet.

With the networking and data transformation of more social resources, the value that big data can carry will continue to improve, and the application boundary of big data will continue to expand, so in the future network era, big data itself can not only represent value, but also create value by big data itself.

(1) The proposal of the era of big data.

McKinsey, a world-renowned consulting firm, was the first to propose the arrival of the era of big data, and he believes that data has penetrated into every industry and business function today, becoming an important production factor. The mining and use of massive amounts of data heralds the arrival of a new wave of productivity growth and consumer surpluses.

2) The advent of the era of big data.

With the rapid development of the Internet, smartphones, and "wearable" computing devices, every bit of change in our behavior, location, and even physical data has become data that can be recorded and analyzed. These new technologies are driving the advent of the era of big data, and all walks of life are generating a huge number of data fragments every day, and the units of measurement of data have evolved from bytes, kb, mb, gb, and TB to PB, EB, ZB, YB and even BB.

3) Characteristics of the era of big data.

If we simply understand what big data is, we only need to grasp the four characteristics of big data, which are massive, high-speed, diverse, and valuable. Specifically, the huge volume of data, the explosive growth of data urgently needs intelligent algorithms, powerful data processing platforms and new data processing technologies to count, analyze, and process such large-scale data in real time; There are many types of data, and the wide range of data** determines the diversity of big data forms. Any form of data can make a difference, and the most widely used at present is the application of recommendation systems; The value density is low, and the proportion of data generated in the real world is very small.

Compared with traditional small data, the greatest value of big data lies in mining valuable data for future trends and patterns from a large number of unrelated types of data. Data analysis is processed quickly and is mainly transmitted via the Internet. Big data has very strict requirements for processing speed, a large number of resources in the server are used to process and calculate data, and many platforms need to achieve real-time analysis.

1. The era of big data refers to the use of relevant algorithms to process, analyze, and store massive data, discover value from massive data, and serve life and production. Big data is the product of this high-tech era, today's society is a high-speed development society, science and technology are developed, information circulation, people communicate closely, life is more convenient, 2, with the advent of the cloud era, big data has also attracted much attention. The analyst team of "Zhiyuntai" believes that big data is generally used to describe the large amount of unstructured and semi-structured data created by a company, and it takes a lot of time and money to analyze it in a relational database.

Big data analysis is mainly associated with cloud computing, and the real-time analysis of large data sets should be like the framework of MapReduce.

Ten, hundreds, or even thousands, of computers assign work.

3. To put it simply, big data technology is the ability to quickly obtain valuable information in various types of data. This is also the potential for this technology to reach many enterprises.

The era of big data first proposes that the era of big data is coming, and the world-renowned McKinsey & Company. It is believed that data has penetrated into various industries and business fields and has become an important factor of production. The mining of massive data should herald a new wave of production.

In the era of big data, it is to analyze the daily habits and normalcy of people or other things through a variety of data!

Big data, also known as huge data and massive data, is a data collection composed of a huge number of data, complex structures, and many types of data. Based on the data processing and application mode of cloud computing, the intellectual resources and knowledge service capabilities formed through the integration and sharing of data and cross-reuse.

"Big data" is a massive, high-growth and diversified information and low-interest asset that requires new processing models to have stronger decision-making power, insight discovery and process optimization capabilities. In other words, big data is the use of data analysis technology to analyze and sort out redundant and disordered data in the vast amount of information, and quickly screen out valuable information.

The basic characteristics of big data

First, the volume of data is huge. According to the data, the new homepage navigation needs to provide more than 500 billion sheets of A4 paper every day. It has been confirmed that so far the amount of data for all printed materials produced by humans is only 200 petabytes.

Second, there are various types of data. The current data type is not only in the form of text, but also in the form of **, **, audio, geolocation information and other types of data, and personalized data accounts for the absolute majority.

Third, the processing speed is fast. Data processing follows the "1-second rule", which allows for quick information on the best values from various types of data.

The era of big data refers to the era of massive data generated, transmitted and stored through technical means such as computers and the Internet in the context of highly developed information technology. In this era of god pants, various types of data are growing, including structured data (such as database records), semi-structured data (such as logs, sensor data), and unstructured data (such as documents, audio, etc.). The key features of the big data era can be summarized as 4V:

The volume of data is huge, the processing speed is fast (velocity), the data is cautious and varied, and the data value density is high. By collecting, storing, processing, and analyzing big data, people can uncover patterns, trends, and insights hidden in the data, helping decision-makers make more accurate decisions and driving innovation and growth across industries.

The strategic significance of big data technology is not to grasp the huge amount of data information, but to professionalize the processing of this meaningful data. In other words, if big data is compared to an industry, then the key to the profitability of this industry lies in improving the "processing ability" of data and realizing the "value-added" of data through "processing".

From a technical point of view, the relationship between big data and cloud computing is as inseparable as the heads and tails of the same coin. Big data cannot necessarily be processed by a single computer, and must adopt a distributed architecture. It features distributed data mining of massive amounts of data.

But it must rely on the distributed processing, distributed databases and cloud storage, and virtualization technologies of cloud computing.

The term big data is increasingly mentioned by BAI, and people use it to describe and define the massive amount of data generated in the era of information **, and this era of massive data is called the era of big data.

With the advent of the cloud era, big data has also attracted more and more attention. Big data is often used to describe the large amount of unstructured and semi-structured data created by a company that takes too much time and money to analyze in a relational database.

Big data, or big data, refers to the amount of data involved that is so large that it cannot be captured, managed, processed, and organized into more positive business decisions through current mainstream software tools within a reasonable time. (In The Age of Big Data, by Victor Mayer-Schönberg and Kenneth Cookye, big data refers to the method of using all data without such shortcuts as random analysis (sampling surveys)) The 4V characteristics of big data: volume, velocity, variety, and veracity.

Big data requires special technologies, including massively parallel processing (MPP) databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems.

The four "Vs" or characteristics of big data have four levels: First, the volume of data is huge. From the TB level, jump to the PB level; Second, there are many types of data.

The aforementioned weblogs, geolocation information, and more. Third, the data directly leads to the accuracy and authenticity of the analysis results. If the data** is complete and true, the final analysis and decisions will be more accurate.

Fourth, the processing speed is fast, the 1 second rule. This last point is fundamentally different from traditional data mining techniques. The industry has summarized it into 4 "Vs".

To some extent, big data is the cutting-edge technology of data analysis. In short, the ability to quickly obtain valuable information from various types of data is big data technology. It's important to understand this, and it's what makes this technology have the potential to reach many businesses.

Today's society is a high-speed development society, with developed science and technology, information circulation, closer and closer communication between people, and more and more convenient life, big data is the product of this high-tech era.

When did big data start to be used, the development process of big data 1, the end of the last century, is the embryonic period of big data, in the stage of data mining technology. With the maturity of data mining theory and database technology, some business intelligence tools and knowledge management technologies have begun to be applied Year-2006 is a breakthrough period for the development of big data, the popularity of social chain refers to the network has led to the emergence of a large number of unstructured data, traditional processing methods are difficult to deal with, data processing systems, database architecture began to rethink Year-2009, big data formed parallel computing and distributed systems, for the development of big data mature period Since then, with the application of smart phones, data fragmentation and distributionIn 2012, the McKinsey Global Institute published "Big Data: The Next Frontier of Innovation, Competition, and Productivity", and in 2012, Victor Schönberg published "The Age of Big Data".

In May, the McKinsey Global Institute released a research report titled "Disruptive Technologies: Technology Improves Life, Business and the Global Economy", which identified 12 emerging technologies in the future, and big data is the cornerstone of the demand technology. Hope it helps.