简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)
Web crawler - python crawler, the data to be crawled is not in the source code of the web page, how to deal with it?
世界只因有你
世界只因有你 2017-06-28 09:25:38
0
2
1802

I want to capture the scores of live broadcast events: live broadcast links, but I can only capture the date, home and away teams, etc. using Scrapy. My question is: are the scores loaded via Script? Is it in bf4.js in this script? How to accurately obtain the score as shown below in this Request Method: GET situation?
The source code of the web page viewed through the developer tools is as follows:

  • 15:00 China League One 15th Round Yunnan Lijiang < span> - Wuhan ZallWuhan Culture and Sports Guangzhou Competition PPTV Text Watch live broadcast on mobile phone score UEFA Champions League New football uniform

    • That is, the score is not displayed in - . How can we capture the rendered score webpage?

    世界只因有你
    世界只因有你

    reply all (2)
    巴扎黑
    巴扎黑2017-06-28 09:27:38 2 floor 
    数据在https://bifen4pc.qiumibao.com/json/list.htm?74520

    Like+0
    Add Reply
      洪涛
      洪涛2017-06-28 09:27:38 1 floor

      Then use Selenium to get it,

      Link description

      Like+0
      Add Reply
        Popular Topics
        More>
        Popular Articles
        Popular Tutorials
        More>
        Related Tutorials
        Popular Recommendations
        Latest courses
        Latest Downloads
        More>
        Web Effects
        Website Source Code
        Website Materials
        Front End Template
        About us Disclaimer Sitemap
        php.cn：Public welfare online PHP training，Help PHP learners grow quickly！