Examples

The following modules contain various examples of using SDK for things like Text Generation, Tokenization, Embedding, Moderation, Prompt Tuning and more!

Besides that, we do provide integrations for libraries like LangChain, LLamaIndex or Transformers.

• Text
  • Stream answer from a model
  • Moderate text data
  • Chat with a model
  • Get embedding vectors for text data
  • Simple text generation
  • Compare a set of hyperparameters
  • Complex text generation example with a progress bar
  • Tokenize text data
• Models
  • Show information about supported models
• Tunes
  • Tune a custom model (Prompt Tuning)
• Prompts
  • Create a custom prompt with variables
• System Prompts
  • Working with system prompts
• Files
  • Working with files
• Users
  • Show information about current user
• Requests
  • Working with your requests
• Extra
  • Overriding built-in services
  • Enable/Disable logging for SDK
  • Error Handling
  • Shutdown Handling
  • Text generation with custom concurrency limit and multiple processes
  • Retrieve metadata for given service method
  • Customize underlying API (httpx) Client
  • Vector Databases
    • Chroma DB
      • Create ChromaDB Embedding Function
• Extensions
  • Transformers (HuggingFace)
    • Run Transformers Agents
  • LangChain
    • Streaming response from LangChain
    • Chat with a model using LangChain
    • Use LangChain generation with a custom template.
    • LangChain SQL Agent
    • Text generation using LangChain
    • LangChain agent
    • LangChain Embeddings
    • Serialize LangChain model to a file
    • QA using native LangChain features
  • LLamaIndex
    • Use a model through LLamaIndex
    • LlamaIndex Embeddings
  • LocalServer
    • Customize behavior of local client
    • Use a local server with a custom model