Scrapy crawl http header data only
This question shows research effort; it is useful and clear
3
This question does not show any research effort; it is unclear or not useful
Show activity on this post.
(How) can I archieve that scrapy only downloads the header data of a website (for check purposes etc.)
I've tried to disable some download-middlewares but it doesn't seem to work.