Skip to content
A comprehensive guide to using AI with IBM i

Running AI natively on IBM i

LLaMa.cpp

LLaMa.cpp is becoming a popular industry solution for running Large Language Models (LLMs). It can now be run natively on IBM i!

In the near future, LLaMa.cpp will likely be available as an IBM i RPM and installable with the yum package manager

In the meantime, you can build and deploy LLaMa.cpp yourself by following the steps documented in this deployment guide

scikit-learn (SKLearn)

scikit-learn provides robust machine learning capabilities for Python programs. It provides support for a number of capabilities including classification, regression, and clustering.

The SciKit-Learn packages for Python are available in RPM form and can be installed via:

Terminal window
/QOpenSys/pkgs/bin/yum install python39-scikit-learn

chainer

chainer provides “A Powerful, Flexible, and Intuitive Framework for Neural Networks.” It can be installed with a simple pip invocation, for instance with Python 3.13:

Terminal window
/QOpenSys/pkgs/bin/python3.13 install chainer