Self-hosted, OpenAI-compatible inference server that runs 85–100+ open models behind one API (encode/score/extract/generate), loading and LRU-evicting models…
Yes, SIE (Superlinked Inference Engine) is open source under the Apache-2.0 license.
SIE (Superlinked Inference Engine) is free to use.
Yes, SIE (Superlinked Inference Engine) can be self-hosted (the source is available under the Apache-2.0 license).
Self-hosted, OpenAI-compatible inference server that runs 85–100+ open models behind one API (encode/score/extract/generate), loading and LRU-evicting models by traffic so one GPU serves a rotating set instead of one server per model. Plugs into Qdrant, Weaviate, Chroma, LanceDB, LangChain, LlamaIndex.