简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)
python - scrapy能爬取https的网页么
PHP中文网
PHP中文网 2017-04-17 13:58:59
0
3
495
PHP中文网
PHP中文网

认证0级讲师

reply all (3)
PHPzhong
PHPzhong2017-04-17 14:00:59 3 floor

这有个用scrapy爬取https的解决方法：http://stackoverflow.com/questions/23958073/scrapy-not-scraping-https

Like+0
Add Reply
    黄舟
    黄舟2017-04-17 14:00:59 2 floor

    用Scrapy对https是不行的，你可以用Facebook的SDK

    https://github.com/pythonforfacebook/facebook-sdk

    Like+0
    Add Reply
      Peter_Zhu
      Peter_Zhu2017-04-17 14:00:59 1 floor

      到最后发现是proxy的问题。线上测试就没问题

      Like+0
      Add Reply
        Popular Topics
        More>
        Popular Articles
        Popular Tutorials
        More>
        Related Tutorials
        Popular Recommendations
        Latest courses
        Latest Downloads
        More>
        Web Effects
        Website Source Code
        Website Materials
        Front End Template
        About us Disclaimer Sitemap
        php.cn：Public welfare online PHP training，Help PHP learners grow quickly！