LocalServer

Create a minimal Rest API compatible with the SDK interface and run inference on your model.

Before you start

To use the following extension, first install it by running pip install 'ibm-generative-ai[localserver]'.

• Customize behavior of local client
• Use a local server with a custom model