Examples

The following modules contain various examples of using SDK for things like Text Generation, Tokenization, Embedding, Moderation, Prompt Tuning and more!

Besides that, we do provide integrations for libraries like LangChain, LLamaIndex or Transformers.

• Text
  • Stream answer from a model
  • Moderate text data
  • Chat with a model
  • Get embedding vectors for text data
  • Compare a set of hyperparameters
  • Generate text using a model
  • Tokenize text data
• Models
  • Show information about supported models
• Tunes
  • Tune a custom model (Prompt Tuning)
• Prompts
  • Create a custom prompt with variables
• System Prompts
  • Working with system prompts
• Files
  • Working with files
• Users
  • Show information about current user
• Requests
  • Working with your requests
• Extra
  • Overriding built-in services
  • Enable/Disable logging for SDK
  • Error Handling
  • Shutdown Handling
  • Text generation with custom concurrency limit and multiple processes
  • Retrieve metadata for given service method
  • Customize underlying API (httpx) Client
  • Vector Databases
    • Chroma DB
      • Create ChromaDB Embedding Function
• Extensions
  • Transformers (HuggingFace)
    • Run Transformers Agents
  • LangChain
    • Streaming response from LangChain
    • Chat with a model using LangChain
    • Use LangChain generation with a custom template.
    • Text generation using LangChain
    • LangChain agent
    • LangChain Embeddings
    • Serialize LangChain model to a file
    • QA using native LangChain features
  • LLamaIndex
    • Use a model through LLamaIndex
  • LocalServer
    • Customize behavior of local client
    • Use a local server with a custom model