Services

Configuration

LLMConfig(api_key, base_url, model[, ...])

A universal configuration object for any LLM connection.

Clients

vLLMConnection(url[, model_name, headers, ...])	LEGACY: This class is maintained for backward compatibility only.
UniversalLLMClient(config, provider)	A universal client for interacting with various LLM providers.
LLMFactory()	A factory for creating pre-configured UniversalLLMClient instances.

Schemas

LLMProviderStrategy()	Abstract base class for LLM provider strategies.
LLMInterface()	Abstract base class for LLM connections.

Strategies

OpenAIStyleStrategy()	A strategy for interacting with LLM providers that follow the OpenAI API format.
AnthropicStrategy()	A strategy for interacting with the Anthropic API (Claude).
GoogleGeminiStrategy()	A strategy for interacting with the Google Gemini REST API.