类库
› scraperai
scraperai/scraperai
ScraperAI是一个开源、AI驱动的网页抓取工具,旨在简化所有技能水平用户的网络爬取过程。它利用大型语言模型(如ChatGPT)从网页中提取数据,并生成可重复使用和共享的抓取配置方案。
技术栈
查看全部依赖 (23)
依赖
NumPy
unknown
Pandas
unknown
Pillow
unknown
Pydantic
unknown
appdirs
unknown
beautifulsoup4
unknown
click
unknown
htmlmin
unknown
langchain
unknown
langchain_community
unknown
langchain_openai
unknown
langchain_text_splitters
unknown
lxml
unknown
openai
unknown
openpyxl
unknown
packaging
unknown
python-dotenv
unknown
retry
unknown
selenium
unknown
tabulate
unknown
tiktoken
unknown
tqdm
unknown
webdriver-manager
unknown