Python crawls Baidu beauty pictures-Python Tutorial-php.cn

Python crawls Baidu beauty pictures

PHPz

Release： 2017-04-04 10:34:21

Original

3201 people have browsed it

Through pythonAutomatically download Baidu beauties in batchesPictures

The effect is like this

Python crawls Baidu beauty pictures

##Effect display

My code

import requests
import re

Copy after login

Python crawls Baidu beauty pictures

Turn page to view picture mode

#获取每页图片的访问链接
def get_page():
    urls=['http://image.baidu.com/search/flip?tn=baiduimage&ie=utf-8&word=%E7%BE%8E%E5%A5%B3%E5%9B%BE%E7%89%87&pn={}&gsm=3c00000000003c'.format(num) for num in range(0,20000,20)]
    for url in urls:
        print(url)
        get_img_link(url)

Copy after login

#从网页中获取每个图片的访问链接
def get_img_link(url):
    r=requests.get(url)
    #print(r.encoding)
    r.encoding='utf-8'
    html_code=r.text
    reg=re.compile(r'"objURL":"(.*?)"')
    imgs=re.findall(reg,html_code)
    # print(imgs)
    for img in imgs:
        #print(img)
        down_img(img)

Copy after login

#图片下载保存再本地
def down_img(url):
    web_data=requests.get(url)
    filename=url.split('/')[-1]
    targetfile='E:/pict_baidu/{}'.format(filename)
    with open(targetfile,'wb') as f:
        f.write(web_data.content)

Copy after login

if name=='main':
    get_page()

Copy after login

Summary

Crawler idea-Get multi-page access link->Get picture link for each page-> Image download;
The use of regular expressions;
The use of format and with open as syntax;
Adjustment of encoding method;
.

The above is the detailed content of Python crawls Baidu beauty pictures. For more information, please follow other related articles on the PHP Chinese website!