home page > Special package > big data > Big data system > Big Data Development Engineer

Big Data Development Engineer

Proficient in Hadoop to Flink, start your big data technology journey

Proficient in IDEA and big data technology stack
Real time computing framework Spark and Flink
Practical course from technology to project
Big data ecological comprehensive learning and expansion

Courses

Course content

hour

Course duration

thirteen point zero nine

ten thousand

Cumulative number of learners

branch

score

Long term effective

Duration of study

intended for

IT technology enthusiasts
Computer major students
Data processing engineer
Software developer
Transferred and promoted technicians

About Instructor

Yang Jun

Course: zero student: zero

Senior Java player, big data technology enthusiast. More than 10 years of development experience, more than 7 years of big data practical experience, and more than 10 heavyweight big data projects. Hadoop source code level technology master, skilled in using Hadoop, Spark, Flink, Hive, HBase, Flume, Kafka, ElasticSearch and other major mainstream components. The teaching concept of humility and affinity, advocating the supremacy of practice. It was well received by the students.

Course content

Phase I

IDEA development tool for big data engineers

IDEA is powerful and easy to use. It is a necessary development tool for big data development.

IntelliJ IDEA 53 Basic and Practical Course
The full name of IDEA is IntelliJ IDEA, which is an integrated environment for Java language development. IntelliJ is recognized as one of the better Java development tools in the industry, especially in intelligent code assistant, code automatic prompt, refactoring, J2EE support, Ant, JUnit, CVS integration, code review, innovative GUI design and other aspects. IDEA is a powerful and easy to use Java development tool. In recent years, programmers have a special liking for IDEA. Although IDEA has powerful functions, it is currently explained in the market
69 class hours · 7 hours and 28 minutes 57341 people study five Update 2022/03/30
Course outline
Course outline
Free trial

Phase II

Hadoop and Spark of Big Data Engineer

Hadoop is the core of big data technology, and Spark is the most widely used and mature real-time computing framework

[Excellent Course] Big Data Financial Credit Project Practice (Spark2.3. x Streaming)
This course is a big data financial credit project practice course, focusing on the theory and practice of big data technology commonly used in enterprises, such as Hadoop, Hive, HBase, Sqoop, Flume, Kafka, Spark Streaming, Spark SQL, Spark Structured Streaming, etc. The course includes offline projects and real-time projects, and provides multi-dimensional practical explanation from project business requirements, technology selection, architecture design, cluster installation and deployment, integrated development, and project visualization.
209 class hours · 38 hours and 54 minutes 24462 people study five Updated on March 29, 2022
Course outline
Course outline
Free trial

Phase III

Spark advancement of big data engineers

The advanced content of Spark is the core content that everyone must learn deeply for career change, promotion and salary increase.

[High level actual combat] High level operator big data real-time analysis project
The Spark Development Engineer course aims to help students gain valuable project experience that can be written on their resumes. The course explains each link of the project. The course covers project business introduction, technology selection and architecture design, project architecture evolution, mobile phone end to server data process, log collection design and requirements, log collection topology, online and local cluster resource planning, project whole process development, project summary, and 21 questions of project interview. The content of the project is relatively rich. Students with zero foundation can learn from the foundation, and those with foundation can directly choose to learn from the project. Course feature 1. The course can be paid directly
50 class hours · 16 hours and 11 minutes 394 people study five Updated on October 18, 2019
Course outline
Course outline
Free trial

Phase IV

Flink of Big Data Engineer

Flink is a new generation of computing engine, which is a big data real-time processing technology preferred by large domestic Internet companies at present

Flink1.8 Introduction and Practice
The course "Introduction and Practice of Flink 1.8" is based on Flink * * V1.8. This set of courses is mainly about Flink. After you learn it, you can have a quick understanding of Flink, start to build a Flink project and a Flink production cluster environment. You will get about 1.5 hours of Flink 1.8 Quick Start and Practice video tutorial 2. Be able to use IDEA to build Flink Java and Scala Maven projects 3. Be able to independently install and deploy Flink big data platform
33 class hours · 5 hours and 7 minutes 6295 people study five Updated on June 6, 2019
Course outline
Course outline
Free trial
Real time e-commerce operation project of Flink1.8
Based on the real-time analysis system (2B) operated by an e-commerce company, Flink 1.8 Real Time E-Commerce Operation Project Practice explains Flink DataStream in many aspects. Through the learning of this course, you can not only gain Flink enterprise level real project experience, but also deeply learn the core theoretical knowledge of Flink DataStream, so as to quickly and deeply learn Flink technology. [Suggestion: Flink students with zero foundation are suggested to learn Flink 1.8 Quick Introduction and Practice first.] https://edu.51ct
80 class hours · 12 hours and 9 minutes 3844 people study four point four Updated on September 17, 2019
Course outline
Course outline
Free trial
Application of Flink1.8 in Real Time Data Warehouse Project
The course "Flink 1.8 Real Time Data Warehouse Project Practice" is mainly based on the stable version of Flink * *. The course includes Flink DataSet, fault tolerance, connector, Flink SQL and real-time data warehouse project. It is hoped that through the learning of this course, you can quickly learn Flink batch processing and Flink SQL, and quickly accumulate project experience through real-time database projects.
67 class hours · 11 hours and 19 minutes 4571 people study four point eight Updated on September 17, 2019
Course outline
Course outline
Free trial

Phase V

Big Data Engineer's Extension Technology

After learning Hadoop, Spark, Flink and other big data mainstream and popular technologies, you can expand and further learn other relevant technologies in the big data ecosystem

Hive's application in big data analysis and big data warehouse
With the continuous development of big data technology, Hive is no longer a common tool in the big data technology ecosystem, but plays an almost irreplaceable role in big data analysis and big data warehouse. Hive and Hbase, Hive and Spark SQL The combination of Hive and Impala has become more and more tight, and Hive's role in data warehouse modeling module in big data warehouse is irreplaceable for the time being. Therefore, learning Hive well is a good choice for you to start big data analysis and big data warehouse. Course harvest 1.15+hours video tutorial 2
56 class hours · 12 hours and 9 minutes 4219 people study five Updated on March 29, 2022
Course outline
Course outline
Free trial
Build ELK Massive Log Analysis Platform
This course focuses on building the ELK massive log analysis platform, including Filebeat multi data source collection, marking, multi line exception information integration, Logstash data analysis, filtering, cleaning, Elastic Search to store, search and analyze data, Kibana to achieve big data analysis and data visualization.
135 class hours · 17 hours and 3 minutes 29752 people study five Updated on March 29, 2022
Course outline
Course outline
Free trial

Exercise/examination paper

Exercises/examination papers of big data development engineers

IntelliJ IDEA 53 Basic and Practical Course 1 set of test paper

[Excellent Course] Big Data Financial Credit Project Practice (Spark2.3. x Streaming) 1 set of test paper

Hive's application in big data analysis and big data warehouse 1 set of test paper

Build ELK Massive Log Analysis Platform 1 set of test paper

Data download

Data download of big data development engineers

[Excellent Course] Big Data Financial Credit Project Practice (Spark2.3. x Streaming) 2 data

Data name	file size
[Enterprise level] big data financial credit project operation document - complete	1.92M
[Enterprise level] big data financial credit project practice - complete	11.46M

[High level actual combat] High level operator big data real-time analysis project 2 data

Data name	file size
[Senior] Spark Development Engineer Data Summary	483.72M
[Senior] Spark Development Engineer Data Summary	483.72M

Flink1.8 Introduction and Practice 1 data

Data name	file size
Flink1.8 Quick Start and Practical Data Download	316.09M

Hive's application in big data analysis and big data warehouse 1 data

Data name	file size
Hive data package	3.03M

Real time e-commerce operation project of Flink1.8 1 data

Data name	file size
Real time e-commerce operation project of Flink1.8	5.90M

Build ELK Massive Log Analysis Platform 1 data

Data name	file size
Build data and source code of ELK massive log analysis platform	5.41M

Application of Flink1.8 in Real Time Data Warehouse Project 1 data

Data name	file size
Real time data warehouse project of Flink1.8	2.65M

Student evaluation

{{total>999? '999+': total}} student scores

{{ tag.tagname }} {{ tag.num > 99 ? '99+' : tag.num }}

{{ item.user_name }}
{{ item.create_time }}
- {{ tag.tagname }}
{{item. content | | 'The user has not filled in the evaluation content'}}

Expand more more

No~

on-line
customer service

APP
download

Download Android client

Download iPhone client

official
WeChat

Follow official WeChat

return
Top