Documentation
¶
Overview ¶
Command custom-provider shows how to plug an in-process language model into Kit with a ProviderFactory. The model uses only kit.LLM* types, so the application does not import the underlying LLM library.
The model echoes the last user message. Replace its body with calls to your own inference backend.
Click to show internal directories.
Click to hide internal directories.