Reptile preparation
1. Obtain salary, academic qualifications, and work experience requirements first
Since Lagou data loading is dynamically loaded, we need to analyze it. The analysis method is as follows:
F12 analysis page data storage location
We found that the content of the web page was obtained through a post request, and the returned data is in json format, so we can get the json data directly.
We only need salary and academic qualifications, work experience, and a single recruitment information. The corresponding English in the returned json data dictionary is: positionId, salary, education, workYear (positionId is the number of a single recruitment information detail page). The relevant operation codes are as follows:
Access the detailed page of recruitment information according to the obtained positionId
operation result:
4.graph visualization data + data cleaning methods
Python crawler job salary
Keyword analysis:
Education: Bachelor
Monthly salary: 10k-30k
Work experience: 1-5 years
Skills: Distributed, multi-threaded, framework, Scrapy, algorithm, data structure, database
Comprehensive: The position of crawler is relatively relaxed in terms of academic requirements. Most of them are undergraduates. It is more suitable for older brothers and girls who want to change jobs. Moreover, the salary is fairly generous, basically above 10k. However, the only requirement for work experience is relatively high. Nearly half of the companies require more than 3 years of work experience.
Python data analysis position
Keyword analysis:
Education: Bachelor's degree (the proportion of master's degree has increased)
Monthly salary: 10k-30k
Work experience: 1-5 years
Skills: SAS, SPSS, Hadoop, Hive, database, Excel, statistics, algorithm
Comprehensive: The post of data analysis has slightly higher academic requirements than crawlers, the proportion of masters has increased, and there are certain requirements for professional knowledge. Salary treatment is also relatively good, basically above 10k, and the proportion of salary in 30k-40k has also increased. The requirements for work experience are still relatively high, and most companies require more than 3 years of work experience.
Python backend post
Keyword analysis:
Education: Bachelor
Monthly salary: 10k-30k
Work experience: 3-5 years
Skills: Flask, Django, Tornado, Linux, MySql, Redis, MongoDB, TCP/IP, mathematics (haha)
Comprehensive: The post of web backend does not require high academic qualifications, but has great requirements on professional knowledge. You must have computer-related knowledge such as the basic operation of the Linux operating system, the use of three major databases, and the use of three basic web frameworks. Is it still relatively large overall. Salary treatment is also relatively good, basically above 10k, and the proportion of salary in 30k-40k is also nearly 20%. The requirements for work experience are still relatively high, and most companies require more than 3 years of work experience.
Python full stack development position
Keyword analysis:
Education: Bachelor
Monthly salary: 10k-30k
Work experience: 3-5 years
Skills: testing, operation and maintenance, management, development, data structure, algorithms, interfaces, virtualization, front-end
Comprehensive: In the full-stack development position, you need to understand everything and learn more. The academic requirements are not too high. Bachelor degree is enough. Needless to say in terms of professional knowledge, you have to understand all aspects. Understand and use. Salary treatment is also OK, basically above 10k, and the proportion of salary between 30k-40k is also nearly 20%. The requirements for work experience are still relatively high, and most companies require more than 3 years of work experience. In general, I personally feel that the full stack is a job with more effort and less salary.
Python operation and maintenance development position
Keyword analysis:
Education: Bachelor
Monthly salary: 10k-30k
Work experience: 3-5 years
Skills: SVN, Git, Linux, framework, shell programming, mysql, redis, ansible, front-end framework
Comprehensive: The post of operation and maintenance development does not have high academic requirements. Except for the undergraduate, which accounts for more than half, it is a junior college. There are still some requirements for work experience, most of which require 3-5 years of work experience. From the perspective of wages, it is neither high nor low, and about 62% of them are above 20k. There are many things to learn, front-end, back-end, database, operating system, etc.
Python machine learning positions
Keyword analysis:
Education: Bachelor's degree (Master's degree also accounts for a large proportion)
Monthly salary: 30k or more
Work experience: 3-5 years
Skills: Machine Learning, Data Mining, Algorithm R&D, Algorithms, Linux, Decision Tree, TF, Spark+MLlib, Cafe
Comprehensive: The position of machine learning is relatively strict in terms of academic requirements. Although it seems that most of them are undergraduates, it is still very difficult for students who have just graduated or recently graduated, if they are only undergraduates. Of course, the salary of machine learning jobs is extremely high, 60% are above 30k, nearly 90% are above 20k, and 97% are above 10k. In addition to the relatively high requirements for academic qualifications, the requirements for work experience are also relatively high. Nearly half of the companies require more than 3 years of work experience.
Python architect job
Keyword analysis:
Education: Bachelor
Monthly salary: 30k or more
Work experience: 5-10 years
Skills: Flask, Django, MySQL, Redis, MongoDB, Hadoop, Hive, Spark, ElasticSearch, Pandas, Spark/MR, Kafka/rabitmq
Comprehensive: The position of architect cannot tell from the academic qualifications alone, but the salary is almost the same as machine learning, even higher than machine learning. In machine learning, the monthly salary of 40k or more accounts for 23.56%, and the monthly salary of architect is 40k. The above accounted for 30.67%. The academic requirements are slightly lower than those of machine learning, and most of them are undergraduates, but more than half of the companies with work experience require 5-10 years of work experience. The necessary skills are also very strict, which is better than the full-stack developer mentioned before.
Looking at this monthly salary, where do you want to go
*Disclaimer: This article is organized on the Internet, and the copyright belongs to the original author. If the source information is wrong or infringes on rights, please contact me