5. Introduction to sqlite and initialization of database tables

six hundred and twenty-two Unauthorized reproduction is prohibited Understanding the course
Course Introduction
discuss {{interaction.discussNum ? '(' + interaction.discussNum + ')' : ''}}
Suitable for people
Python Foundation is Zero | Beginner. I want to know friends who master crawler technology.
You will learn
Through the development of web crawler, we will take you to quickly grasp the principle of crawling web pages
  • Master python crawler technology
  • Master HTML5 and CSS3 graphical web page technology
  • Master urllib technology
  • Master regular expressions
  • Master sqlite database technology
  • Master word cloud technology
Course Introduction

Web crawler is a program that roams a collection of web documents along a link. It generally resides on the server, reads the corresponding document using standard protocols such as http through some given urls, and then continues to roam until there is no new url that meets the conditions, taking all the unreachable urls included in the document as a new starting point. Requests is a commonly used python Http library, which can be safely enjoyed by human beings. Lxml is a parsing library of python, which supports parsing of html and xml, and xpath parsing method, and has very high parsing efficiency. This course will use python, requests, lxml, sqlalchemy, multiprocessing and other technologies to develop a simple web crawler. Through the development of web crawler, we will take you to quickly grasp the principle of crawling web pages in the actual process.

Through learning, you can have a certain understanding of Python, learn Python syntax, and use Python native language to develop projects. I have a systematic understanding of the application of Python in development and a clear understanding of the future development direction. The main knowledge points include basic syntax, file operation, library, object-oriented, process thread coroutine, network programming, database, etc.   

You will learn:

Through learning, I have a certain understanding of Python, learn Python syntax,

It can be developed using Python native language.

Learn Python automatic crawling. Bug framework flask

 



Expand more
release
 head portrait

{{ item.user.nick_name }} {{ EROLE_NAME[item.user.identity] }}

Topping note
 Discussion Chart
{{ item.create_time }} reply
  • delete

    Are you sure to delete?

    confirm
    cancel
  • {{item. is_top==1? 'Cancel topping': 'topping'}}

    The discussion that has been set to the top, do you want to replace the existing one?

    confirm
    cancel
{{ tag.text}}
 head portrait
{{ subitem.user.nick_name }} {{ EROLE_NAME[subitem.user.identity] }}
{{ subitem.create_time }} reply
delete

Are you sure to delete?

confirm
cancel
release
{{pageType==='video '?' The discussion area grabs the sofa, and you can get double credits': 'The discussion area is empty, please say two sentences~'}}
release
{{tips.text}}
{{ noteHeaderTitle }} note {{hasMyNote? 'My notes':' Take notes'}}
{{hasMyNote? 'My notes':' Take notes'}}
Quality Notes
Updated on: {{$dayjs. format ('YYYY-MM-DD HH: mm: ss', item.last_uptime*1000) }}
 head portrait
{{ detail.username }}

Public notes are visible to others and have the opportunity to be rated as "high-quality notes" by the administrator

{{ noteEditor.content.length }}/2000

Public Notes
preservation
put questions to

The lecturer will answer your questions as soon as possible. If you choose to ask questions in public, you can get more help from students.

Record time point
Record the time when the video is played when asking questions, so as to facilitate subsequent viewing
Open questions
Submit