Skip to main content

🟢 自托管推理引擎SIE

  1. 🟢 自托管推理引擎SIE

    做Agent自托管推理的话可以试试这个，所有Agent要调用的开源模型都能统一放在你自己云上的单个集群里提供服务，不用再给每个任务单独搭模型服务器。兼容OpenAI接口，搜检索、文档转Markdown、结构化输出这些常用能力都预配置好了，还支持K8s部署和主流Agent框架集成。

    https://github.com/superlinked/sie
    https://superlinked.com/docs

    #SIE #Python #InferenceServer #TGAgent #GitHubTrending
    GitHub
    GitHub - superlinked/sie: Open-source inference server and production cluster for all the models your agent needs.
    GitHub - superlinked/sie: Open-source inference server and production cluster for all the models your agent needs.
    Open-source inference server and production cluster for all the models your agent needs. - superlinked/sie