07 chatglm Source Code Analysis Model Introduction 1-51CTO School

{{interaction. likeNum==0? (pageType==='video'? 'Like First': 'Like'): formatNumber (interaction. likeNum)}} {{interaction. collectionNumber==0? 'Collection': formatNumber (interaction. collectionNumber)}} {{interaction. discussNum==0? (pageType=='video'? 'grab the sofa': 'discussion'): formatNumber (interaction. discussNum)}}

put questions to {{interaction. noteNum>0? Interaction. noteNum+'notes':' notes'}} Offline viewing

Download the school APP

Cache video for offline viewing

Reporting problems Offline viewing

Download the school APP

Cache video for offline viewing

Course Introduction

discuss {{interaction.discussNum ? '(' + interaction.discussNum + ')' : ''}}

Suitable for people

Students with computer science background and python foundation who want to change careers and focus on large model application

You will learn

Have a deep understanding of the RAG principle and practice of the big model, and be able to further improve and adapt to the actual business in the current course practice.

Course Introduction

01 chatglm source code analysis- Outline

02 chatglm source code analysis- GLM Principle Introduction

03 chatglm source code analysis- Why do you want to learn such fine-tuning methods as lora

04- Chatglm source code analysis- Introduction to model configuration and py file

05 chatglm source code analysis- tokenizer-sp

06 chatglm source code analysis- tokenizer-chatglm

07 chatglm source code analysis- Model Introduction 1

08 chatglm source code analysis- Position code introduction

09 chatglm source code analysis- Overall introduction to position coding

10 chatglm source code analysis- Trainable position code

11 chatglm source code analysis- Sinusoidal position code

12 chatglm source code analysis- Relative position code

13 chatglm source code analysis- Introduction to alibai location coding

14 chatglm source code analysis- Introduction to rope principle

15 chatglm source code analysis- Rope code introduction

16 chatglm source code analysis- Introduction to model structure class

17 chatglm source code analysis- Analysis of coreattention source code

18 chatglm source code analysis- Analysis of selfattention source code

19 chatglm source code analysis- Glmblock source code analysis

20 chatglm source code analysis- Source code analysis of pre training model

21 chatglm source code analysis- Introduction to condition generation and classification tasks of llm

Expand more

release

Topping note

{{ item.create_time }} {{ Number(item.like_count) || '' }} reply

delete
Are you sure to delete?
confirm
cancel
{{item. is_top==1? 'Cancel topping': 'topping'}}
The discussion that has been set to the top, do you want to replace the existing one?
confirm
cancel

{{ subitem.create_time }} {{ Number(subitem.like_count) || '' }} reply

delete

Click to see more Stow

release

{{pageType==='video '?' The discussion area grabs the sofa, and you can get double credits': 'The discussion area is empty, please say two sentences~'}}

release

{{ noteHeaderTitle }} note {{hasMyNote? 'My notes':' Take notes'}}

Quality Notes

Updated on: {{$dayjs. format ('YYYY-MM-DD HH: mm: ss', item.last_uptime*1000) }}

Public notes are visible to others and have the opportunity to be rated as "high-quality notes" by the administrator

{{ noteEditor.content.length }}/2000

Public Notes

preservation

put questions to

The lecturer will answer your questions as soon as possible. If you choose to ask questions in public, you can get more help from students.

Record time point

Record the time when the video is played when asking questions, so as to facilitate subsequent viewing

Open questions

Submit

07 Chatglm Source Code Analysis - Model Introduction 1