Section1 what is scrapy

08 minutes32 seconds

Section2 Initial use of scrapy

15 minutes27 seconds

Section3 Basic steps to use scrapy

13 minutes55 seconds

Section4 Introduction to basic concepts 1-scrapy command line tool

13 minutes17 seconds

Section5 Introduction to basic concepts 3-Important objects in scrapy

11 minutes09 seconds

Section6 Introduction to scrapy built-in services

11 minutes54 seconds

Section7 Advanced crawling - crawling of the "Western Thorns" website

09 minutes48 seconds

Section8 Interpretation of the core code of the "Xiqi" website crawler

14 minutes49 seconds

Section9 Practical Tip 1—Crawling Techniques for Multi-Level Pages

12 minutes28 seconds

Section10 Practical Tip 2—Picture Capture

10 minutes54 seconds

Section11 Frequently asked questions during the crawling process 1—Use of proxy IP

09 minutes56 seconds

Section12 Frequently asked questions during the crawling process 2—Handling of cookies

09 minutes02 seconds

Section13 Common problems in the crawling process 3—js processing skills

18 minutes22 seconds

Section14 Introduction to scrapy’s deployment tool-scrapyd

05 minutes15 seconds

Section15 Deploy scrapy to scrapyd

12 minutes39 seconds

Section16 Course Summary

07 minutes48 seconds