.. _examples.extensions.lm_eval.lm_eval_model:

lm-evaluation-harness advanced usage
====================================

Use lm-evaluation extension from code to have additional control over concurrency or execution options

Note:
    This is for advanced usage only, use CLI in most cases (lm_eval_cli example)

.. literalinclude:: ../../../examples/extensions/lm_eval/lm_eval_model.py
	:language: python
	:caption: See `lm_eval_model.py <https://github.com/IBM/ibm-generative-ai/blob/v3.0.0/examples/extensions/lm_eval/lm_eval_model.py>`_ on GitHub.
	:lines: 10-