Running AI natively on IBM i

LLaMa.cpp

Solution report card

Runs on IBM i?	✅
On-prem	✅
IBM Cloud	✅
AI capabilities	Large Language Models
Commercial support	❌
Free to try?	✅
Requirements	IBM i Open Source

LLaMa.cpp is becoming a popular industry solution for running Large Language Models (LLMs). It can now be run natively on IBM i!

In the near future, LLaMa.cpp will likely be available as an IBM i RPM and installable with the yum package manager

In the meantime, you can build and deploy LLaMa.cpp yourself by following the steps documented in this deployment guide

scikit-learn (SKLearn)

Solution report card

Runs on IBM i?	✅
On-prem	✅
IBM Cloud	✅
AI capabilities	Machine Learning Deep Learning
Commercial support	❌
Free to try?	✅
Requirements	IBM i Open Source

scikit-learn provides robust machine learning capabilities for Python programs. It provides support for a number of capabilities including classification, regression, and clustering.

The SciKit-Learn packages for Python are available in RPM form and can be installed via:

/QOpenSys/pkgs/bin/yum install python39-scikit-learn