Skip to main content

🧠 NVIDIA模型优化工具库

  1. 🧠 NVIDIA模型优化工具库

    之前想给大模型做推理加速,挨个试量化、剪枝、蒸馏各种技术太折腾了,NVIDIA这个ModelOpt库直接把各类SOTA模型优化技术都整合到一块了,支持Hugging…

    https://github.com/NVIDIA/Model-Optimizer

    #NvidiaModelOptimizer #Python #ModelOptimization #TGAgent #GitHubTrending