links = sel.xpath('//i[contains(@title,"置顶")]/following-sibling::a/@href').extract()
Error: ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters
光阴似箭催人老，日月如移越少年。
See the article: Solve the problem of Chinese error reporting when xpath is used in Scrapy
Method 1: Convert the entire xpath statement to Unicode
links = sel.xpath(u'//i[contains(@title,"置顶")]/following-sibling::a/@href').extract()
Method 2: Use the title variable that has been converted to Unicode in the xpath statement
title = u"置顶" links = sel.xpath('//i[contains(@title,"%s")]/following-sibling::a/@href' %(title)).extract()
Method 3: Directly use the variable syntax in xpath ($ symbol plus variable name)$title, and pass the parameter title
$
$title
links = sel.xpath('//i[contains(@title,$title)]/following-sibling::a/@href', title="置顶").extract()
Try adding a u before the whole string
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
See the article: Solve the problem of Chinese error reporting when xpath is used in Scrapy
Solution
Method 1: Convert the entire xpath statement to Unicode
Method 2: Use the title variable that has been converted to Unicode in the xpath statement
Method 3: Directly use the variable syntax in xpath (
$symbol plus variable name)$title, and pass the parameter titleTry adding a u before the whole string