Class BaseLLMAbstract

constructor

• new BaseLLM(model: string): BaseLLM

  Constructor for BaseLLM

  Parameters

  • model: string

  Returns BaseLLM

model

connect

• connect(llmRequest: LLMRequest): BaseLLMConnection

  Creates a live connection to the LLM

  Parameters

  • llmRequest: LLMRequest

    The request to send to the LLM

  Returns BaseLLMConnection

  BaseLLMConnection, the connection to the LLM

AbstractgenerateContentAsync

• generateContentAsync(
      llmRequest: LLMRequest,
      stream?: boolean,
  ): AsyncGenerator<LLMResponse, void, unknown>

  Generates content from the given request

  Parameters

  • llmRequest: LLMRequest

    The request to send to the LLM
  • Optionalstream: boolean

    Whether to do streaming call

  Returns AsyncGenerator<LLMResponse, void, unknown>

  A generator of LLMResponses

StaticsupportedModels

• supportedModels(): string[]

  Returns a list of supported models in regex for LLMRegistry

  Returns string[]