When using python to do CSDN web crawler, when crawling the title of the web page, I always use the regular expression(?<=\
cannot be used in CSDN. Go to the CSDN source code and see that the title breaks into new lines and displays
As a result, the original regular expression cannot be used. Then, the question arises. The title of a webpage like this contains a newline. How to extract it with a regular expression?
PS:
I don’t want to use xpath or beautifulsoup methods, I just need regular expressions
CSDN itself has an anti-crawler mechanism. It’s not because of this anti-crawler that I couldn’t crawl the title
thank you all
Referring to @caimaoy's method, I changed the regular expression to(?<=\
Thank you all again.
re.M Multi-line mode
Write multi-line matching by yourself http://python3-cookbook.readt...
Add a
flag
to the expression