.. _examples.extensions.localserver.local_server:

Use a local server with a custom model
======================================

.. admonition:: Python 3.12 support
    :class: warning

    The transformers library is not supported in python 3.12 yet due to the lack of pytorch support for 3.12.
    Follow the `pytorch issue <https://github.com/pytorch/pytorch/issues/110436>`_ for more information.

.. literalinclude:: ../../../examples/extensions/localserver/local_server.py
	:language: python
	:caption: See `local_server.py <https://github.com/IBM/ibm-generative-ai/blob/v3.0.0/examples/extensions/localserver/local_server.py>`_ on GitHub.
	:lines: 11-