1 Star 0 Fork 0

xastra/TensorRT-LLM

加入 Gitee
与超过 1400万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
文件
克隆/下载
requirements.txt 844 Bytes
一键复制 编辑 原始数据 按行查看 历史
Kaiyu Xie 提交于 2024-04-09 17:03 +08:00 . Update TensorRT-LLM (#1427)
--extra-index-url https://pypi.nvidia.com
accelerate==0.25.0
build
colored
cuda-python # Do not override the custom version of cuda-python installed in the NGC PyTorch image.
diffusers==0.15.0
lark
mpi4py
numpy
onnx>=1.12.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py
StrEnum
sentencepiece>=0.1.99
# WAR the new posting of "nvidia-cudnn-cu12~=9.0".
# "tensorrt==9.3.0.post12.dev1" specifies "nvidia-cudnn-cu12" but actually requires "nvidia-cudnn-cu12~=8.9".
nvidia-cudnn-cu12~=8.9; platform_machine == "x86_64"
tensorrt==9.3.0.post12.dev1
# https://github.com/pytorch/pytorch/blob/v2.2.1/version.txt still uses 2.2.0a0.
# https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-02.html#rel-24-02 uses 2.3.0a0.
torch>=2.2.0a,<=2.3.0a
nvidia-ammo~=0.7.0
transformers==4.38.2
wheel
optimum
evaluate
janus
mpmath==1.3.0
Loading...
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/xastra/TensorRT-LLM.git
git@gitee.com:xastra/TensorRT-LLM.git
xastra
TensorRT-LLM
TensorRT-LLM
main

搜索帮助