hpcaitech/ColossalAI

类库 › ColossalAI

hpcaitech/ColossalAI

ColossalAI旨在降低大型AI模型的成本、加快训练速度，并提高可访问性，适用于研究人员进行高效计算。

41,109 4,526 41,109 475

在 GitHub 上查看

技术栈

applications/Colossal-LLaMA python

查看全部依赖 (15)

依赖

autoflake black colossalai datasets flash-attn huggingface-hub ninja packaging protobuf sentencepiece six tensorboard torch tqdm transformers

applications/ColossalChat/coati/distributed/zero_bubble python

查看全部依赖 (2)

依赖

pygloo ray

applications/ColossalChat python

框架

FastAPI

查看全部依赖 (24)

依赖

autoflake black colossalai datasets flash-attn gpustat jsonlines langchain latex2sympy2_extended loralib math_verify ninja packaging pyext sentencepiece six sse_starlette tensorboard tiktoken tokenizers torch tqdm transformers wandb

applications/ColossalEval python

查看全部依赖 (13)

依赖

Pandas colossalai fuzzywuzzy jieba matplotlib openai peft rouge scikit-learn seaborn tabulate transformers vllm

applications/ColossalMoE python

查看全部依赖 (5)

依赖

colossalai datasets sentencepiece torch transformers

applications/ColossalQA python

ORM

SQLAlchemy

测试

pytest

查看全部依赖 (19)

依赖

Requests chromadb datasets gpustat gradio jq langchain langchain-experimental modelscope openai pypdf sentence-transformers sentencepiece tiktoken tokenizers torch tqdm transformers unstructured

colossalai/legacy/moe/openmoe python

查看全部依赖 (5)

依赖

colossalai datasets sentencepiece torch transformers

requirements python

框架

FastAPI

查看全部依赖 (25)

依赖

NumPy Pydantic bitsandbytes click contexttimer diffusers einops fabric galore_torch google ninja packaging peft pre-commit protobuf psutil ray rich rpyc safetensors sentencepiece torch tqdm transformers uvicorn

hpcaitech/ColossalAI