Scrapy crawl http header data only

This question shows research effort; it is useful and clear

3

This question does not show any research effort; it is unclear or not useful

Show activity on this post.

(How) can I archieve that scrapy only downloads the header data of a website (for check purposes etc.)

I've tried to disable some download-middlewares but it doesn't seem to work.

首页 - Wiki
Copyright © 2011-2024 iteam. Current version is 2.125.0. UTC+08:00, 2024-05-03 19:04
浙ICP备14020137号-1 $访客地图$