orkes.services.LLMInterface

class orkes.services.LLMInterface

Abstract base class for LLM connections.

This class defines the interface for sending and streaming messages to an LLM, as well as for performing health checks.

__init__()

Methods

__init__()
health_check()	Checks the health status of the LLM server.
send_message(message, **kwargs)	Sends a message to the LLM and receives the full response.
stream_message(message, **kwargs)	Streams the response from the LLM incrementally.