When I was writing the crawler, I found that after setting every in the code, after crawling once on the 21st, I saw that the result was not updated today, and the lastcrawltime was still on the 21st. Is my parameter setting incorrect?
The picture of the task you posted, what task is it for?
The task posted is detail_page
The questioner set a time for index_page that is less than the cronjob interval. However, detail_page is not set. In this way, detail_page will not be rescheduled
Project queue status, what are the recent active tasks?
It is possible that every and age do not match. If there is no problem with age, to be honest, this is a difficult disease. I often encounter it. I always go to taskdb to clear the corresponding table, then restart pyspider and re-run the project
The picture of the task you posted, what task is it for?
The questioner set a time for index_page that is less than the cronjob interval. However, detail_page is not set. In this way, detail_page will not be rescheduled
Project queue status, what are the recent active tasks?
It is possible that every and age do not match. If there is no problem with age, to be honest, this is a difficult disease. I often encounter it. I always go to taskdb to clear the corresponding table, then restart pyspider and re-run the project