liteparse

GitHub

本地文档解析工具,支持PDF、Office及图像的文件格式转换与OCR。提供带边界框的空间文本提取和页面截图输出,适用于RAG布局感知、多模态代理及批量文献处理,无需云端依赖。

skills/liteparse/SKILL.md K-Dense-AI/scientific-agent-skills

Trigger Scenarios

需要本地快速解析PDF或Office文件 需要获取文本的边界框坐标用于RAG或定位 需要对扫描版文档或图片进行OCR识别 需要生成页面PNG截图供多模态模型使用 需要批量导入论文文件夹或协议库

Install

npx skills add K-Dense-AI/scientific-agent-skills --skill liteparse -g -y
More Options

Use without installing

npx skills use K-Dense-AI/scientific-agent-skills@liteparse

指定 Agent (Claude Code)

npx skills add K-Dense-AI/scientific-agent-skills --skill liteparse -a claude-code -g -y

安装 repo 全部 skill

npx skills add K-Dense-AI/scientific-agent-skills --all -g -y

预览 repo 内 skill

npx skills add K-Dense-AI/scientific-agent-skills --list

SKILL.md

Frontmatter
{
    "name": "liteparse",
    "license": "Apache-2.0",
    "metadata": {
        "version": "1.1",
        "skill-author": "K-Dense Inc."
    },
    "description": "Local document and PDF parsing that returns spatial text with bounding boxes. Use for extracting text from PDFs, DOCX, Office files, and images; running OCR on scans; producing layout-preserved JSON for RAG; batch-ingesting folders of papers; or rendering pages to PNG for multimodal agents. Distinguishing capabilities are per-token bounding boxes, page raster output, and fully local processing with no cloud API.",
    "allowed-tools": "Read Write Edit Bash",
    "compatibility": "Python 3.10+. Optional LibreOffice (Office formats) and ImageMagick (images). Bundled Tesseract for OCR. All processing is local — no cloud API required."
}

LiteParse — Local Document Parsing

Overview

LiteParse is a fast, open-source document parser (Rust core, Python/Node bindings) focused on local, layout-aware text extraction with bounding boxes. It does not produce Markdown and does not call cloud LLMs. Outputs are plain text (layout-preserved) or structured JSON with per-page text_items (position, font metadata, optional confidence).

Version note: Examples target liteparse 2.0.0 (PyPI, May 2026). The upstream V1 branch is legacy; this skill documents V2 / main only.

For parser selection vs MarkItDown, the pdf skill, or LlamaParse, see references/choosing_a_parser.md.

When to Use This Skill

Use LiteParse when you need:

  • Fast local parsing of PDFs or converted Office/image files without cloud dependencies
  • Spatial text with bounding boxes for layout-aware RAG, citation grounding, or figure/table region logic
  • OCR on scanned PDFs or images (bundled Tesseract, or a user-run HTTP OCR server)
  • Page screenshots (PNG) for multimodal agents that must see charts, figures, or handwriting
  • Batch ingestion of literature folders, supplementary PDFs, or protocol libraries
  • Page subsets or password-protected PDFs

When Not to Use

Task Use instead
Markdown for LLM ingestion (EPUB, audio, YouTube, HTML) markitdown skill
Merge/split PDFs, forms, watermarks, rotation pdf skill
Dense tables, handwriting, production cloud pipelines LlamaParse (cloud; sign up separately)

Installation

uv pip install "liteparse==2.0.0"

This installs the Python bindings and the lit CLI. Verify:

lit --help
python -c "import liteparse; print(liteparse.__version__)"

Optional system tools (for non-PDF inputs):

  • LibreOffice — Word, Excel, PowerPoint, OpenDocument, CSV/TSV
  • ImageMagick — PNG, JPEG, TIFF, WebP, SVG, etc.

Install commands are in references/ocr_and_formats.md.

Node.js / TypeScript (optional): npm i @llamaindex/liteparse — see references/api_reference.md.


Quick Start

Python

from liteparse import LiteParse

parser = LiteParse(quiet=True)
result = parser.parse("paper.pdf")
print(result.text)

for page in result.pages:
    print(f"Page {page.page_num}: {len(page.text_items)} items")

CLI

# Layout-preserved text (default)
lit parse paper.pdf

# Structured JSON with bounding boxes
lit parse paper.pdf --format json -o paper.json

# Disable OCR on text-native PDFs (faster)
lit parse paper.pdf --no-ocr

Core Workflows

1. Parse to layout-preserved text

Best for quick full-document text or feeding chunkers that do not need coordinates.

parser = LiteParse(ocr_enabled=True, quiet=True)
result = parser.parse("document.pdf")
full_text = result.text
lit parse document.pdf -o output.txt

2. Parse to structured JSON (bounding boxes)

Use when building layout-aware RAG, highlighting source regions, or joining text with screenshots.

import json
from liteparse import LiteParse

parser = LiteParse(output_format="json", quiet=True)
result = parser.parse("document.pdf")

# Programmatic access
for page in result.pages:
    for item in page.text_items:
        bbox = (item.x, item.y, item.width, item.height)
        # item.text, item.confidence, item.font_name, item.font_size
lit parse document.pdf --format json -o document.json

JSON field layout: references/output_formats.md.

3. Parse specific pages

parser = LiteParse(target_pages="1-5,10,15-20", quiet=True)
result = parser.parse("long_paper.pdf")
lit parse long_paper.pdf --target-pages "1-5,10"

4. Parse from bytes or stdin

Useful for uploads, S3 downloads, or piping remote PDFs.

with open("document.pdf", "rb") as f:
    result = parser.parse(f.read())
curl -sL https://example.com/report.pdf | lit parse -

5. Page screenshots for multimodal agents

Screenshots capture visual content that text extraction alone misses (figures, complex tables, handwriting).

from pathlib import Path

parser = LiteParse(dpi=150, quiet=True)
shots = parser.screenshot("document.pdf", page_numbers=[1, 2, 3])
out = Path("screenshots")
out.mkdir(exist_ok=True)
for s in shots:
    (out / f"page_{s.page_num}.png").write_bytes(s.image_bytes)
lit screenshot document.pdf --target-pages "1,3,5" -o ./screenshots
lit screenshot document.pdf --dpi 300 -o ./screenshots

Combine JSON parse + screenshots when an agent needs both coordinates and pixels for the same pages.

6. Batch-parse a directory

For large corpora, prefer the CLI (parallel OCR workers) or the bundled script.

lit batch-parse ./papers ./parsed --format json --recursive
lit batch-parse ./papers ./parsed --extension .pdf --no-ocr
python scripts/batch_parse_dir.py ./papers ./parsed --format json --recursive

See scripts/batch_parse_dir.py for a Python batch wrapper without network calls.

7. OCR configuration

OCR is on by default. Tesseract is bundled; no extra install for basic English OCR.

parser = LiteParse(
    ocr_enabled=True,
    ocr_language="eng",       # Tesseract codes: fra, deu, etc.
    num_workers=4,            # parallel OCR (default: CPU cores - 1)
    dpi=150,                  # higher DPI → better OCR, slower
)
lit parse scan.pdf --ocr-language fra
lit parse scan.pdf --no-ocr
lit parse scan.pdf --ocr-server-url http://localhost:8080/ocr

Offline / air-gapped: set TESSDATA_PREFIX to a directory of .traineddata files, or pass --tessdata-path. Details: references/ocr_and_formats.md.

8. Encrypted PDFs

parser = LiteParse(password="secret", quiet=True)
result = parser.parse("protected.pdf")
lit parse protected.pdf --password secret

9. Search text items by phrase

Merge adjacent items and return combined bounding boxes for a phrase (e.g. section titles).

from liteparse import search_items

page = result.get_page(1)
matches = search_items(page.text_items, "Materials and Methods", case_sensitive=False)

Multi-Format Inputs

Category Extensions (examples) Requirement
PDF .pdf Native
Office .docx, .xlsx, .pptx, .doc, .odt, … LibreOffice
Images .png, .jpg, .tiff, .webp, .svg, … ImageMagick

Files are converted to PDF internally, then parsed. If conversion tools are missing, parsing fails with an actionable error — install the dependency and retry.


Performance Tips

  • --no-ocr on born-digital PDFs — largest speedup
  • target_pages — parse only methods/supplement sections
  • num_workers — scale OCR across CPU cores
  • max_pages — cap very large files (default 1000)
  • lit batch-parse — directory-scale jobs with --recursive and --extension
  • Lower dpi (e.g. 100) when OCR quality is already sufficient

Reference Files

File Read when
references/choosing_a_parser.md Unsure whether to use LiteParse, MarkItDown, pdf, or LlamaParse
references/api_reference.md Python/TypeScript API, types, search_items
references/cli_reference.md Full lit command flags
references/output_formats.md JSON schema, bboxes, confidence scores
references/ocr_and_formats.md Tesseract, HTTP OCR, LibreOffice, ImageMagick

Troubleshooting

Issue Fix
Office file fails Install LibreOffice; ensure soffice is on PATH (Windows: add LibreOffice program dir)
Image fails Install ImageMagick; verify convert or magick works
OCR poor quality Increase --dpi; try --ocr-language; or HTTP OCR server
OCR slow --no-ocr if not needed; reduce pages; increase num_workers
Air-gapped OCR export TESSDATA_PREFIX=/path/to/tessdata or --tessdata-path
ParseError on bytes Ensure input is valid PDF bytes (Office bytes need a file path + conversion)

Resources

Version History

  • 390f514 Current 2026-08-20 15:01

Same Skill Collection

skills/adaptyv/SKILL.md
skills/aeon/SKILL.md
skills/anndata/SKILL.md
skills/arboreto/SKILL.md
skills/astropy/SKILL.md
skills/benchling-integration/SKILL.md
skills/bgpt-paper-search/SKILL.md
skills/bids/SKILL.md
skills/biopython/SKILL.md
skills/bioservices/SKILL.md
skills/cellxgene-census/SKILL.md
skills/cirq/SKILL.md
skills/citation-management/SKILL.md
skills/clinical-decision-support/SKILL.md
skills/clinical-reports/SKILL.md
skills/cobrapy/SKILL.md
skills/dask/SKILL.md
skills/database-lookup/SKILL.md
skills/datamol/SKILL.md
skills/deepchem/SKILL.md
skills/deepspot-m/SKILL.md
skills/deeptools/SKILL.md
skills/depmap/SKILL.md
skills/diffdock/SKILL.md
skills/dnanexus-integration/SKILL.md
skills/esm/SKILL.md
skills/etetoolkit/SKILL.md
skills/exploratory-data-analysis/SKILL.md
skills/flowio/SKILL.md
skills/fluidsim/SKILL.md
skills/generate-image/SKILL.md
skills/geniml/SKILL.md
skills/geopandas/SKILL.md
skills/get-available-resources/SKILL.md
skills/gget/SKILL.md
skills/glycoengineering/SKILL.md
skills/gtars/SKILL.md
skills/histolab/SKILL.md
skills/hypogenic/SKILL.md
skills/hypothesis-generation/SKILL.md
skills/imaging-data-commons/SKILL.md
skills/infographics/SKILL.md
skills/lab-hardware-cad/SKILL.md
skills/labarchive-integration/SKILL.md
skills/lamindb/SKILL.md
skills/latchbio-integration/SKILL.md
skills/latex-posters/SKILL.md
skills/literature-review/SKILL.md
skills/markdown-mermaid-writing/SKILL.md

Metadata

Files
0
Version
390f514
Hash
330eb982
Indexed
2026-08-20 15:01

Главная - Вики-сайт
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-08-21 05:41
浙ICP备14020137号-1 $Гость$