类库
› LiteRT-LM
google-ai-edge/LiteRT-LM
LiteRT-LM是Google开源的高性能大语言模型推理框架，专为在边缘设备（如手机、IoT）上部署而设计。支持多种主流模型（如Gemma、Llama），并利用GPU/NPU加速。提供跨平台支持，功能包括多模态输入和工具调用。
技术栈
根目录 rust
网络
Requests
查看全部依赖 (79)
依赖
NumPy
Pandas
absl-py
aiohappyeyeballs
aiohttp
aiosignal
annotated-doc
antlr4rust
0.5
anyio
attrs
certifi
chardet
charset-normalizer
chrono
0.4
click
colorama
cxx
=1.0.149
dataproperty
datasets
dill
evaluate
filelock
frozenlist
fsspec
googletest
0.14
h11
hf-xet
httpcore
httpx
huggingface-hub
idna
indexmap
2.12
jinja2
joblib
jsonlines
lm-eval
lxml
markdown-it-py
markupsafe
mbstrdecoder
mdurl
more-itertools
multidict
multiprocess
nltk
packaging
pathvalidate
portalocker
prompt-toolkit
propcache
pyarrow
pygments
pytablewriter
python-dateutil
pytz
pyyaml
regex
rich
rouge-score
sacrebleu
scikit-learn
scipy
shellingham
six
sqlitedict
tabledata
tabulate
tcolorpy
threadpoolctl
tqdm
typepy
typer
typing-extensions
urllib3
wcwidth
word2number
xxhash
yarl
zstandard
cmake/rust/antlr_fc rust
查看全部依赖 (1)
依赖
antlr4rust
0.5
cmake/rust/antlr_python rust
查看全部依赖 (1)
依赖
antlr4rust
0.5
cmake/rust/python_parser rust
查看全部依赖 (2)
依赖
antlr4rust
0.5
antlr_python_tool_call_parser
