python - pyspider scheduled crawling problem
我想大声告诉你
我想大声告诉你 2017-05-18 10:53:29
0
2
978


When I was writing the crawler, I found that after setting every in the code, after crawling once on the 21st, I saw that the result was not updated today, and the lastcrawltime was still on the 21st. Is my parameter setting incorrect?

我想大声告诉你
我想大声告诉你

reply all(2)
迷茫

The picture of the task you posted, what task is it for?

The task posted is detail_page

The questioner set a time for index_page that is less than the cronjob interval. However, detail_page is not set. In this way, detail_page will not be rescheduled

Project queue status, what are the recent active tasks?

我想大声告诉你

It is possible that every and age do not match. If there is no problem with age, to be honest, this is a difficult disease. I often encounter it. I always go to taskdb to clear the corresponding table, then restart pyspider and re-run the project

Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template