33 Code demonstration of PySpark's window function

{{interaction. likeNum==0? (pageType==='video'? 'Like First': 'Like'): formatNumber (interaction. likeNum)}} {{interaction. collectionNumber==0? 'Collection': formatNumber (interaction. collectionNumber)}} {{interaction. discussNum==0? (pageType=='video'? 'grab the sofa': 'discussion'): formatNumber (interaction. discussNum)}}

put questions to {{interaction. noteNum>0? Interaction. noteNum+'notes':' notes'}} Offline viewing

Download the school APP

Cache video for offline viewing

Reporting problems Offline viewing

Download the school APP

Cache video for offline viewing

Course Introduction

discuss {{interaction.discussNum ? '(' + interaction.discussNum + ')' : ''}}

Suitable for people

● Students who want to learn big data processing technology; ● Programmers who have become professionals in data development and want to deal with large-scale data scenarios; ● Be interested in big data field and want to explore and learn new technologies to achieve advancement;

You will learn

Learn the processing flow of big data from zero to one, and implement Spark's technical processing step by step in combination with Python

After learning the course, you can process the cluster resources of Python calling Spark, and realize the whole process development capability
Master the whole process of big data processing, which can be used for large-scale data processing

Course Introduction

Spark is a very popular big data processing technology at present. PySpark is a very convenient way to use Python to implement Spark data processing. This course introduces Python in combination with Spark's data processing and analysis technology, including data reading, filtering, cleaning, statistics, conversion, summary statistics, and data visualization. It also explains cases in combination with real data.

Replica _pyspark Netease Cloud Class Details __2024-06-10+11_54_16.png

Expand more

release

Topping note

{{ item.create_time }} {{ Number(item.like_count) || '' }} reply

delete
Are you sure to delete?
confirm
cancel
{{item. is_top==1? 'Cancel topping': 'topping'}}
The discussion that has been set to the top, do you want to replace the existing one?
confirm
cancel

{{ subitem.create_time }} {{ Number(subitem.like_count) || '' }} reply

delete

Click to see more Stow

release

{{pageType==='video '?' The discussion area grabs the sofa, and you can get double credits': 'The discussion area is empty, please say two sentences~'}}

release

{{ noteHeaderTitle }} note {{hasMyNote? 'My notes':' Take notes'}}

Quality Notes

Updated on: {{$dayjs. format ('YYYY-MM-DD HH: mm: ss', item.last_uptime*1000) }}

Public notes are visible to others and have the opportunity to be rated as "high-quality notes" by the administrator

{{ noteEditor.content.length }}/2000

Public Notes

preservation

put questions to

The lecturer will answer your questions as soon as possible. If you choose to ask questions in public, you can get more help from students.

Record time point

Record the time when the video is played when asking questions, so as to facilitate subsequent viewing

Open questions

Submit