rushizirpe/open-llm-server
This Open LLM Framework serves as a powerful and flexible tool for serving endpoints for embeddings and chat completions using SOTA open source language models. By leveraging models Transformers, this enables various natural language processing (NLP) tasks to be performed via simple HTTP endpoints similar to openai endpoints.
Platform-specific configuration:
{
"mcpServers": {
"open-llm-server": {
"command": "npx",
"args": [
"-y",
"open-llm-server"
]
}
}
}Add the config above to .claude/settings.json under the mcpServers key.
Loading reviews...