What are the requirements for learning big data technology

The first is the big data platform itself, which is generally based on the deployment of certain Hadoop products such as CDH. There are many components in the deployed product, such as Hive, HBase, Spark, ZooKeeper, etc.

The second is ETL, that is, the data extraction process, the original data in the big data platform is generally the best in other business systems in the company, such as credit in the bank, core, etc., the data of these business systems will be extracted from the business system to the big data platform every day, and then carry out a series of standardization, cleaning and other operations, and then generate some models for downstream systems after some modeling.

The third is data analysis, after the data collection is completed, what kind of processing should be done based on these data, such as report applications, which may be written every day SQL development reports; There are also some platforms, such as risk monitoring, that are processed based on the data collected by the big data platform. Stuffy.

1. Data collection2. Intelligent analysis of big data.

3. Big data information mining.

Is big data technology only in the direction of searching?

1.Internet e-commerce direction.

As the hottest outlet at present, Internet e-commerce is the place with the most application and practice in the Internet field, and it is also the ministry with the largest demand for talents. Graduates majoring in big data technology and application can be engaged in Internet e-commerce operation and maintenance, daily management, consumer big data analysis, financial data risk control management and other related technical work. At present, from the head e-commerce platforms that have been listed to the community e-commerce, the gap of these technical sales and answering talents is relatively large.

2.Retail Finance.

Although retail finance and Internet e-commerce both belong to the field of consumption, specifically, the scope of retail e-commerce is smaller than that of Internet e-commerce, and it is more necessary to accurately connect with consumer groups and consumer groups' hobbies, incomes and other characteristics than Internet e-commerce. Graduates of Big Data Technology and Application can work in computer-based, etc. development and other work.

It is suitable for undertaking related technical services in retail financial enterprises, and can also be engaged in computer application work in the IT field.

A background in computer science is preferable in big data.

There is a programming foundation, a data structure foundation.

Big data is equivalent to a computer science professional course, which is more cutting-edge, and there is a compilation principle in the computer professional course, and big data is equivalent to that difficulty.

Big data is a general term for a series of technical problems, including distributed technology, analysis technology, development technology, etc., so big data needs your foundation to be more comprehensive.

High degree is generally required for graduate degree or above. Good math, good English, and some programming experience are required. In general, it is very demanding.