python - 抓取天猫详情页里面的月销量,反爬非常厉害
天蓬老师
天蓬老师 2017-04-18 10:29:07
0
4
871

现在需要抓取天猫详情页里面的月销量
如https://detail.tmall.com/item...

已分析得到是异步js返回的数据,接口如下
https://mdskip.taobao.com/cor...


这个地址访问几次就需要登录,登录之后多访问几次就需要输入验证码
用代理换IP也一样
各位大神有啥好办法

天蓬老师
天蓬老师

欢迎选择我的课程,让我们一起见证您的进步~~

reply all(4)
左手右手慢动作

No login, change agent directly

Do not keep session when switching proxy

巴扎黑

To obtain the entrance, you can choose the mobile terminal entrance, for example: entrance


The data is directly on the page, it is easy to get the data, keywords"sellCount".

阿神

No matter how many times you visit the browser, you will not be asked to log in. Use code to adjust the browser plug-in to access htmlunit

After using Postman 50 times, I still won’t be allowed to log in or a verification code will appear. I’ll try it on my next post. Taobao’s anti-crawling is still average.
https://www.endclothing.com is really damned if it uses anti-crawling

Peter_Zhu

Does anyone have experience with this?

Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template
About us Disclaimer Sitemap
php.cn:Public welfare online PHP training,Help PHP learners grow quickly!