What is the difference between big data and cloud computing?

Cloud computing is the application tool of big data, big data includes data collection, storage, etc., and the subsequent analysis and classification of big data needs to rely on cloud computing.

You can understand the difference or relationship between cloud computing and big data in this way, cloud computing technology is a container, big data is the water stored in this container, and big data relies on cloud computing technology for storage and computing.

What is a cloud service?

A: By distributing computing across a large number of distributed computers, rather than local computers or remote servers, enterprise data centers will operate more like the Internet. This enables enterprises to switch resources to the applications they need, accessing computers and storage systems on demand.

Bihadoop provides the answer.

The concept is different.

At a macro level, cloud computing has changed IT, while big data has changed business. At the same time, big data must have the cloud as its infrastructure in order to be smoothly promoted and reflect strong practical value.

The difference between the target audience.

The target audience of both parties is also different, cloud computing represents an IT-level solution, which is for CIOs; Big data is a strategic framework, which is oriented to managers and business levels, which allows us to show stronger competitiveness in the business and completely enhance our comprehensive strength.

What is the difference between cloud computing and big data? There are often misconceptions about the relationship between big data and cloud computing. And they will also mix them up and say that they are explained in a straightforward sentence:

Cloud computing is the virtualization of hardware resources; Big data is the efficient processing of massive amounts of data.

Big data technology refers to the ability to quickly obtain valuable information from a wide variety of types of data. Technologies for big data, including massively parallel processing (MPP) databases, data mining power grids, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems.

Cloud computing is the model for the addition, use, and delivery of Internet-based services, typically involving the provision of dynamically scalable and often virtualized resources over the Internet. Cloud is a metaphor for the network, the Internet. In the past, clouds were often used to represent telecommunication networks in diagrams, and later they were also used to represent the abstraction of the Internet and the underlying infrastructure.

Cloud computing is equivalent to our computer and operating system, a large number of hardware resources are virtualized and then allocated and used, the current boss in the field of cloud computing should be regarded as Amazon, which can be said to provide a commercial standard for cloud computing, and it is worth paying attention to VMware (in fact, from this point can help you understand the relationship between cloud computing and virtualization), the open source cloud platform is more dynamic is OpenStack.

Big data is equivalent to the "database" of massive data, and the development of the field of big data can also be seen that the current big data processing has been developing in the direction of similar to the traditional database experience, and the generation of Hadoop enables us to use ordinary machines to establish stable clusters for processing terabyte-level data, and the concepts of traditional and expensive parallel computing are pulled in front of us, but it is not suitable for data analysts (because of the complexity of mapreduce development). So Piglatin and Hive appeared (yahoo!, respectivelyAnd the project initiated by Facebook, speaking of which, in the field of big data Google, Facebook, Twitter and other cutting-edge Internet companies have made a very positive and strong contribution), we have brought SQL-like operations, here the operation is like SQL, but the processing efficiency is very slow, absolutely and the processing efficiency of the traditional database is very different, so people are thinking about how to deal with big data not only in the way of operation SQL, And the processing speed can also be "SQL-like", Google has brought us technologies such as Dremel Powerdrill, and Cloudera (a company with strong Hadoop commercialization, where the father of Hadoop Cutting is responsible for technical leadership) has also appeared.

Cloud computing can be understood as a tool, for example, if you have a 100G file, you can't read it into the memory of a computer at one time, but cloud computing is something that can connect n computers together, and you can process very large files through strong cluster performance, for example, a cloud may have 3000 machines, there may be 1w machines, and its computing power can be greatly improved, which is currently mainly the Hadoop family.

Big data, literally is a lot of data, but in the application is mainly data mining, a large amount of data itself is meaningless, and through some methods (such as data mining algorithms) to analyze and process a large amount of data, you can find useful and valuable things in a large amount of data through the computer, and transform a large amount of data into value, which is big data.

Is that okay?

Episode 3 - Big Data and Cloud Computing. Scientific and technological vision.

Many people can't tell what cloud computing and big data can do, so what is the relationship between cloud computing and big data? Today, I will give you a brief analysis.

Cloud computing: Cloud computing provides computing power and storage services for global users through the Internet, and provides hardware foundation for Internet information processing. Cloud computing, simply put, is to put the hard disk and CPU on your own computer or the company's server on the Internet, and call it dynamically in a unified manner.

Big data: Big data uses increasingly mature cloud computing technology to obtain valuable information from the vast Internet information ocean for information induction, retrieval and integration, and provides a software foundation for Internet information processing. Big data, to put it simply, is to put all the data together to analyze, find the association, and achieve the best.

All of the data here corresponds to some of the data from previous sample surveys.

The relationship between cloud computing and big data:

Cloud computing is the foundation, and without cloud computing, big data storage and computing cannot be realized. Big data is an application, and without big data, cloud computing lacks purpose and value. Both require the participation of artificial intelligence, which is a commercial application of the Internet information system in an orderly manner.

This is the real export of cloud computing and big data!

And where does the intelligence in business intelligence come from? One of the ways is to process a large amount of data through the tool of big data, so as to draw some correlation conclusions, and get answers from these correlations, so big data is a tool for business intelligence. And big data to analyze a large amount of data, which is very high for the system's computing power and processing power requirements, the traditional way is to need a supercomputer to process, but this leads to the problem that the computing power is idle when it is idle and busy when it is not enough, and the elastic expansion and horizontal expansion mode of cloud computing is very suitable for computing power to be called on demand, therefore, cloud computing provides a material basis for big data such as computing power and resources.

Episode 3 - Big Data and Cloud Computing. Scientific and technological vision.

What is Cloud Computing and Big Data? What to learn from cloud computing and big data.

In recent years, cloud computing has been in the limelight. Whether it is IT equipment manufacturers, telecom operators, or service providers, content providers, they are all "looking for a door" and cloud computing "pull relationship", everyone sharpened their heads and desperately squeezed into the ship of cloud computing, if their products, ideas or technologies and cloud computing are not related to each other, it is simply ashamed to see people. Cloud computing seems to be omnipotent, ubiquitous, and has taken the world by storm for a while.

The major domestic and foreign universities are scrambling to pursue the unique charm of cloud computing.

Cloud computing is all about turning data into wealth at the cheapest cost. This is just like the relationship between the boss and the secretary, big data must not be processed by a single computer, and a distributed computing architecture must be adopted. In the information society, the amount of data is not only growing rapidly, but also the technology is constantly improving.

Under the premise of massive data, if the cost of extracting, processing, and utilizing the data exceeds the value of the data itself, then the value is equivalent to no value. Ultimate cloud computing from public, private and hybrid clouds is the most qualified secretary to reduce costs in the data extraction process.

In the first collection of data, generally speaking, 90% of the data is useless, so it is necessary to filter out the available data that can provide economic benefits for the enterprise, to see how much trouble has been saved with this secretary of eighteen kinds of martial arts, back to the topic, in a large number of useless data, the focus needs to be filtered out of two categories, one is a large number of stored temporary information, almost no need to invest; Second, the network data accessed from outside the company's firewall to the internal network is of very low value. Cloud computing can provide on-demand scalable compute and storage resources that can be used to filter out unwanted data, and the public cloud is the best choice for handling data outside the firewall.

In the data analysis stage, public cloud and hybrid cloud technologies can be introduced, and in addition, a distributed processing software platform similar to Hadoop can be used for the centralized data processing stage. After the data analysis is completed, the original data provided for the analysis does not need to be retained forever, and the analysis results can be processed using a private cloud, and the information can be imported into the company.

Episode 3 - Big Data and Cloud Computing. Scientific and technological vision.

Cloud computing is to put the hard disk and CPU on your own computer or the company's server on the network, and unify the dynamic call, and the scope of big data is much larger, big data uses cloud computing functions to summarize, retrieve and integrate all valuable data of users, and provides a software foundation for Internet information processing.

The processing of big data is inseparable from cloud computing. Big data can be simply understood as a superdatabase system, and cloud computing is a supercomputer, with different focuses and many similarities. As long as you know these virtual concepts, you can read a flower, so it's better to make a demo program out of it.

Nowadays, there are a lot of empty concepts and nouns, but in fact, there are very few things that can be made, similar to blockchain, which are just the talk of the "amazing" "mouthpieces".

1. Different purposes: Big data is to explore the value of information, while cloud computing is mainly to manage resources and provide corresponding services through the Internet.

2. Different objects: the object of big data is data, and the object of cloud computing is Internet resources and applications.

3. Different backgrounds: the emergence of big data in users and all walks of life in society generates large data showing geometric multiples of growth; The emergence of cloud computing is due to the growth of user service demand and the improvement of the ability of enterprises to handle business.

4. Different values: The value of big data lies in discovering the effective information of data, and cloud computing can save a lot of costs.

The future development trend of cloud computing is that cloud computing, as the bottom layer of computing resources, supports the upper-layer big data processing, and the development trend of big data is real-time interactive query efficiency and analysis capabilities.

1. Big data refers to the collection of data that cannot be captured, managed and processed by conventional software tools within a certain time frame, and is a massive, high-growth rate and diversified information asset that requires new processing modes to have stronger decision-making, insight and process optimization capabilities.

2. The relationship between big data and cloud computing is as inseparable as the positive and negative sides of the same coin. Big data cannot necessarily be processed by a single computer, and a distributed computing architecture must be adopted. It is characterized by the mining of massive amounts of data, but it must rely on the distributed processing, distributed database, cloud storage and virtualization technology of cloud computing.

You can understand the relationship between the two in this way, cloud computing technology is a container, big data is the water stored in this container, and big data relies on cloud computing technology for storage and computing.

The strategic significance of big data technology is not to master the huge data insights, but to professionalize the processing of these meaningful data. In other words, if big data is compared to an industry, then the key to the profitability of this industry is to improve the "processing ability" of data, and realize the "value-added" of data through "processing".

From a technical point of view, the relationship between big data and cloud computing is as inseparable as the heads and tails of the same coin. Big data cannot necessarily be processed by a single computer, and must adopt a distributed architecture. It features distributed data mining of massive amounts of data.

But it must rely on the distributed processing, distributed databases and cloud storage, and virtualization technologies of cloud computing.

The term big data is increasingly used to describe and define the massive amount of data generated in the era of information, and this era of massive data is called the era of big data.

With the advent of the cloud era, big data has also attracted more and more attention. Big data is often used to describe the large amount of unstructured and semi-structured data created by a company that takes too much time and money to analyze in a relational database.