Complete version of Python crawler tutorial
The course is reproduced from Bilibili: https://www.bilibili.com/video/BV1ZT4y1d7JM
218496
person learning
196
class hour
2023-05-23
update time
01 days02 Hours07 minutes37 seconds
Total course duration
有朋自远方来，虽远必诛！
You will learn
The course is reproduced from Bilibili: https://www.bilibili.com/video/BV1ZT4y1d7JM
Complete version of Python crawler tutorial
Section1 Crawler overview
09 minutes25 seconds
Section2 Software used in this course
09 minutes40 seconds
Section3 Kill a small reptile with your hand (Part 1)
07 minutes30 seconds
Section4 Kill a small reptile with your hand (Part 2)
04 minutes15 seconds
Section5 Analysis of web request process (Part 1)
10 minutes59 seconds
Section6 Analysis of web request process (Part 2)
06 minutes06 seconds
Section7 http protocol (Part 1)
07 minutes00 seconds
Section8 http protocol (below)
06 minutes17 seconds
Section9 Getting Started with Requests-1
07 minutes00 seconds
Section10 Getting Started with Requests-2
08 minutes19 seconds
Section11 Getting Started with Requests-3
06 minutes20 seconds
Section12 Getting Started with Requests-4
08 minutes00 seconds
Section13 Getting Started with Requests-5
08 minutes36 seconds
Section14 Added - turn off resp
02 minutes15 seconds
Section15 Supplementary_py basics_character set issues
05 minutes55 seconds
Chapter1 Chapter One
Section1 Data parsing overview
02 minutes18 seconds
Section2 Re parsing regular expression-1
10 minutes00 seconds
Section3 Re parsing regular expression-2
09 minutes16 seconds
Section4 Re parsing regular expression-3
07 minutes59 seconds
Section5 Re parsing regular expression-4
09 minutes27 seconds
Section6 Python's re module uses -1
10 minutes00 seconds
Section7 Python’s re module uses -2
10 minutes59 seconds
Section8 Ranking of top 250 movies on Douban (Part 1)
10 minutes00 seconds
Section9 Ranking of top 250 movies on Douban (Part 2)
09 minutes31 seconds
Section10 Pirated Paradise Movie Information-1
10 minutes00 seconds
Section11 Pirated Paradise Movie Information-2
10 minutes13 seconds
Section12 Pirated Paradise Movie Information-3
10 minutes56 seconds
Section13 Bs4 parsing foreplay-Html grammar rules-1
11 minutes54 seconds
Section14 Introduction to Bs4 Analysis-Gagacai Price (1)
09 minutes59 seconds
Section15 Introduction to Bs4 Analysis-Go Gao Cai Price (2)
10 minutes08 seconds
Section16 Bs4 analysis case-grabbing beautiful gallery pictures (1)
12 minutes00 seconds
Section17 Bs4 analysis case-grabbing beautiful gallery pictures (2)
12 minutes35 seconds
Section18 Getting Started with Xpath-1
07 minutes59 seconds
Section19 Getting Started with Xpath-2
08 minutes49 seconds
Section20 Getting Started with Xpath-3
07 minutes00 seconds
Section21 Getting Started with Xpath-4
09 minutes09 seconds
Section22 Practical use of Xpath to capture Zhubajie.com information (1)
10 minutes00 seconds
Section23 Practical use of Xpath to capture Zhubajie.com information (2)
10 minutes12 seconds
Section24 Practical use of Xpath to capture Zhubajie.com information (3)
06 minutes28 seconds
Chapter2 Chapter two
Section1 Advanced overview of Requests
02 minutes54 seconds
Section2 Handling cookies Login to Novel Network (1)
10 minutes00 seconds
Section3 Handling cookies Login to Novel Network (2)
08 minutes58 seconds
Section4 Anti-hotlink capture pear video (1)
12 minutes00 seconds
Section5 Anti-hotlink capture pear video (2)
13 minutes03 seconds
Section6 Agent-1
09 minutes58 seconds
Section7 Comprehensive training to capture NetEase Cloud music review information (1)
10 minutes00 seconds
Section8 Comprehensive training to capture NetEase Cloud music review information (2)
10 minutes06 seconds
Section9 Comprehensive training to capture NetEase Cloud music review information (3)
10 minutes12 seconds
Section10 Comprehensive training to capture NetEase Cloud music review information (4)
10 minutes10 seconds
Section11 Comprehensive training to capture NetEase Cloud music review information (5)
10 minutes10 seconds
Section12 Comprehensive training to capture NetEase Cloud music review information (6)
10 minutes00 seconds
Section13 Comprehensive training to capture NetEase Cloud music review information (7)
06 minutes37 seconds
Section14 Multithreading(1)
08 minutes00 seconds
Section15 Multithreading(2)
07 minutes16 seconds
Section16 Multithreading-1
06 minutes12 seconds
Section17 Getting Started with Thread Pools and Process Pools
06 minutes59 seconds
Section18 Thread pool case_grabbing Xinfadi vegetable prices (Part 1)
09 minutes00 seconds
Section19 Thread pool case_grabbing Xinfadi vegetable prices (Part 2)
09 minutes41 seconds
Chapter3 third chapter
Section1 Coroutine concept
11 minutes31 seconds
Section2 Multi-task asynchronous coroutine (Part 1)
12 minutes00 seconds
Section3 Multi-task asynchronous coroutine (Part 2)
11 minutes54 seconds
Section4 Supplement - About asynchronous coroutines - obsolescence warning
07 minutes09 seconds
Section5 Asynchronous http request aiohttp module explanation (Part 1)
08 minutes00 seconds
Section6 Asynchronous http request aiohttp module explanation (Part 2)
07 minutes44 seconds
Section7 Practical combat of asynchronous crawlers - stripping away a novel (Part 1)
12 minutes00 seconds
Section8 Practical combat of asynchronous crawlers - stripping away a novel (Part 2)
12 minutes15 seconds
Section9 Comprehensive training_How video websites work (Part 1)
09 minutes00 seconds
Section10 Comprehensive training_How video websites work (Part 2)
10 minutes02 seconds
Section11 Grab 91 and watch the drama_Simple version (Part 1)
07 minutes00 seconds
Section12 Grab 91 to watch the drama_Simple version (Part 2)
07 minutes40 seconds
Section13 Grab 91 and watch the drama_Simple version (Part 1)
10 minutes00 seconds
Section14 Grab 91 to watch the drama_Simple version (Part 2)
11 minutes13 seconds
Section15 Grab 91 to watch the drama_Complex Edition_1_Overview (Part 1)
06 minutes00 seconds
Section16 Grab 91 to watch the drama_Complex Edition_1_Overview (Part 2)
07 minutes40 seconds
Section17 Grab 91 to watch the drama_complex version_2_get the m3u8 path
11 minutes00 seconds
Section18 Grab 91 to watch the drama_complex version_3_download m3u8 (Part 1)
08 minutes00 seconds
Section19 Grab 91 to watch the drama_complex version_3_download m3u8 (Part 2)
07 minutes36 seconds
Section20 Grab 91 to watch the drama_complex version_4_download video (Part 1)
09 minutes00 seconds
Section21 Grab 91 to watch the drama_complex version_4_download video (Part 2)
09 minutes01 seconds
Section22 Grab 91 to watch the drama_Complex version_5_Decryption (Part 1)
07 minutes59 seconds
Section23 Grab 91 to watch the drama_Complex version_5_Decryption (Part 2)
08 minutes16 seconds
Section24 _Catch 91 to watch the drama_Complex version_6_Merge video (Part 1)
06 minutes00 seconds
Chapter4 Chapter Four
Section1 Selenium introduces concepts (Part 1)
07 minutes00 seconds
Section2 Selenium introduces concepts (Part 2)
07 minutes39 seconds
Section3 selenium_Various operations_grabbing hook (Part 1)
10 minutes00 seconds
Section4 selenium_Various operations_grabbing hook (Part 2)
11 minutes21 seconds
Section5 selenium_various operations_switching between windows (Part 1)
10 minutes00 seconds
Section6 selenium_Various operations_Switching between windows (Part 2)
10 minutes49 seconds
Section7 selenium_Various Operations_Headless Browser (Part 1)
10 minutes00 seconds
Section8 selenium_Various operations_Headless browser (Part 2)
11 minutes51 seconds
Section9 selenium_Super Eagle processing verification code (Part 1)
07 minutes00 seconds
Section10 selenium_Super Eagle processing verification code (Part 2)
08 minutes08 seconds
Section11 selenium_super eagle fuck super eagle
08 minutes58 seconds
Section12 selenium_solve the login problem of 12306 (1)
10 minutes00 seconds
Section13 selenium_solve the login problem of 12306 (2)
10 minutes05 seconds
Section14 selenium_solve the login problem of 12306 (4)
09 minutes50 seconds
Chapter5 chapter Five
Section1 Python captures pictures of girls from the beautiful gallery
41 minutes29 seconds
Section2 Grab Lagou.com recruitment information
37 minutes26 seconds
Section3 Easy and simple explanation of recursion and small recursion cases
52 minutes32 seconds
Section4 Simple analysis of lottery data
43 minutes04 seconds
Section5 Use python automation tool selenium to capture 51job recruitment information
52 minutes32 seconds
Section6 binary search
In calculation
Section7 maze problem
In calculation
Section8 Do movie box office
In calculation
Section9 dry flask
In calculation
Section10 Data visualization display
39 minutes11 seconds
Section11 Regular expression_metacharacter
In calculation
Section12 Regular expression_quantifier
In calculation
Section13 Regular Expressions_Greedy and Lazy
In calculation
Section14 re extract grouped data
In calculation
Section15 Use Douban TOP250 data to capture
In calculation
Section16 Capture movie paradise movie information_on
17 minutes27 seconds
Section17 Capture movie paradise movie information_Part 2
14 minutes46 seconds
Section18 html basic grammar rules
In calculation
Section19 css selector syntax rules
In calculation
Section20 css selector syntax rules_cut completed
In calculation
Chapter6 Chapter Six
Section1 bs4 practical case one
12 minutes59 seconds
Section2 bs4 practical case 2
In calculation
Section3 xpath analysis_on
18 minutes35 seconds
Section4 xpath analysis_down
06 minutes33 seconds
Section5 Anti-leech_grab pear video
24 minutes56 seconds
Section6 Multithreading and multiprocessing
In calculation
Section7 Multi-threading and multi-process-2
In calculation
Section8 Multi-threading and multi-process-3
In calculation
Section9 Multi-threading and multi-process-4
In calculation
Section10 Multi-threading and multi-process-5
In calculation
Section11 01_Multi-task asynchronous coroutine
20 minutes00 seconds
Section12 02_Multi-task asynchronous coroutine
20 minutes00 seconds
Section13 03_Multi-task asynchronous coroutine
20 minutes00 seconds
Section14 04_Multi-task asynchronous coroutine
In calculation
Section15 05_Multi-task asynchronous coroutine
In calculation
Section16 06_Multi-task asynchronous coroutine
In calculation
Section17 07_Multi-task asynchronous coroutine
In calculation
Section18 08_Multi-task asynchronous coroutine
In calculation
Section19 09_Multi-task asynchronous coroutine
In calculation
Chapter7 Chapter VII
Section1 01_Catch wbdy
20 minutes00 seconds
Section2 02_Catch wbdy
20 minutes00 seconds
Section3 04_Catch wbdy
In calculation
Section4 05_Catch wbdy
In calculation
Section5 06_Catch wbdy
In calculation
Section6 07_Catch wbdy
In calculation
Section7 08_Catch wbdy
In calculation
Section8 09_Catch wbdy
20 minutes00 seconds
Section9 10_grab wbdy
In calculation
Section10 11_Catch wbdy
In calculation
Section11 01_Getting started with selenium
In calculation
Section12 02_Getting started with selenium
In calculation
Section13 03_Getting started with selenium
In calculation
Section14 Getting Started with Selenium-4
In calculation
Section15 Getting Started with Selenium-5
20 minutes01 seconds
Section16 Getting Started with Selenium-6
In calculation
Section17 Getting Started with Selenium-7
In calculation
Section18 Getting Started with Selenium-8
In calculation
Section19 Getting Started with Selenium-9
In calculation
Section20 Getting Started with Selenium-10
09 minutes08 seconds
Chapter8 chapter eight
Section1 Selenium small advanced + case-1
20 minutes01 seconds
Section2 Selenium small advanced + case-2
20 minutes02 seconds
Section3 Selenium small advanced + case-3
20 minutes05 seconds
Section4 Selenium small advanced + case-4
In calculation
Section5 Selenium small advanced + case-5
In calculation
Section6 Selenium small advanced + case-6
In calculation
Section7 Selenium small advanced + case-7
In calculation
Section8 Selenium small advanced + case-8
In calculation
Section9 Selenium small advanced + case-9
In calculation
Section10 Scrapy introduction and initial use-1
20 minutes00 seconds
Section11 Scrapy introduction and initial use-2
20 minutes09 seconds
Section12 Scrapy introduction and initial use-3
20 minutes05 seconds
Section13 Scrapy introduction and initial use-4
In calculation
Section14 Scrapy introduction and initial use-5
In calculation
Section15 Scrapy introduction and initial use-6
In calculation
Section16 Scrapy introduction and initial use-7
In calculation
Chapter9 Chapter nine
Section1 01 Scrapy pipeline
In calculation
Section2 02 Scrapy pipeline
In calculation
Section3 03 Scrapy pipeline
In calculation
Section4 04 Scrapy pipeline
In calculation
Section5 05 Scrapy pipeline
In calculation
Section6 06 Scrapy pipeline
In calculation
Section7 07 Scrapy pipeline
In calculation
Section8 08 Scrapy pipeline
In calculation
Section9 09 Scrapy pipeline
In calculation
Section10 1Scrapy middleware uses -1
In calculation
Section11 1Scrapy middleware usage-2
20 minutes04 seconds
Section12 1Scrapy middleware usage-3
In calculation
Section13 1Scrapy middleware usage -4
In calculation
Section14 1Scrapy middleware uses -5
In calculation
Chapter10 chapter Ten
Section1 Scrapy simulated login and middleware-1
20 minutes00 seconds
Section2 Scrapy simulated login and middleware-2
20 minutes07 seconds
Section3 Scrapy simulated login and middleware-3
In calculation
Section4 Scrapy simulated login and middleware-4
In calculation
Section5 Scrapy simulated login and middleware-5
In calculation
Section6 Scrapy simulated login and middleware-6
In calculation
Section7 Scrapy simulated login and middleware-7
In calculation
Section8 Scrapy simulated login and middleware-8
In calculation
Section9 Scrapy simulated login and middleware-9
In calculation
Section10 Scrapy site-wide data capture-1
19 minutes59 seconds
Section11 Scrapy site-wide data capture-2
In calculation
Chapter11 Chapter 11
Data Name
The courseware is currently not available for download, and the staff are organizing it. Please pay more attention to this course in the future~
王林 Lecturer Other Courses
Popular courses
JAVA Beginner's Video Tutorial
753 class hour
2982556
Little Turtle's zero-based introduction to learning Python video tutorial
60 class hour
546667
Quick introduction to web front-end development
8 class hour
220790
Master PS video tutorials from scratch
268 class hour
1003298
Latest courses
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
[Web front-end] Node.js quick start
16 class hour
16696
Complete collection of foreign web development full-stack courses
12 class hour
13480
Go language practical GraphQL
10 class hour
11115
550W fan master learns JavaScript from scratch step by step
1 class hour
1264
