Extensions

Use large language models with your favourite framework, like LangChain / LLamaIndex or Transformers (HuggingFace). If you want to use your model but still use the SDK, try the LocalServer extension provided by the SDK.

• Transformers (HuggingFace)
  • Run Transformers Agents
• LangChain
  • Streaming response from LangChain
  • Chat with a model using LangChain
  • Text generation using LangChain
  • Serialize LangChain model to a file
  • QA using native LangChain features
• LLamaIndex
  • Use a model through LLamaIndex
• LocalServer
  • Customize behavior of local client
  • Use a local server with a custom model