Scrapy crawl http header data only
原文可能无法访问了,如果运气好的话,你还能看到我们对原文的
存档
摘要
(How) can I archieve that scrapy only downloads the header data of a website (for check purposes etc.) I've tried to disable some download-middlewares but it doesn't seem to work.