Introduction¶

ado is a Python platform for designing experiment campaigns and executing them at scale. It enables distributed teams of researchers and engineers to collaborate, execute experiments, and share data.

You can extend ado across different domains through its plugin model — often as simple as decorating a Python function. By integrating your methodology, you gain cross-cutting capabilities — such as parallel execution, data provenance, and a unified CLI — alongside a structured foundation that allows AI coding agents to autonomously formulate and run your experiments.

• 🧑‍💻 Using ado assumes familiarity with command line tools.
• 🛠️ Developing ado requires knowledge of Python.

Key Features¶

• CLI: Our human-centric CLI follows best practices
• Projects: Allow distributed groups of users to collaborate and share data
• 🔌 Extendable: Easily add new experiments or optimizers and other tools
• Scalable: We use Ray as our execution engine, allowing experiments and tools to scale easily
• Automatic data-reuse: Avoid repeating work with transparent reuse of experiment results; ado's internal protocols ensure this happens only when it makes sense
• Provenance: Relationships between data and operations are automatically tracked. The versions of ado-core and every plugin used to create a resource are also recorded, keeping results reproducible and debuggable
• Optimization and sampling: Out-of-the-box, leverage powerful optimization methods via Ray Tune or use our flexible built-in sampler
• Coding agents: Supercharge your workflow. ado's typed resources and bundled skills enable AI assistants to autonomously formulate, validate, and run experiments. Learn more

Foundation Model Experimentation¶

We have developed ado plugins providing advanced capabilities for performance testing of foundation models:

• Fine-tuning performance benchmarking
• Inference performance benchmarking (using vLLM bench or guidellm)
• Predictive performance model creation

Requirements¶

A basic installation of ado only requires a recent Python version (3.10 to 3.14). This will allow you to run many of our examples and explore ado features.

Additional Requirements¶

Some advanced features have additional requirements:

• Distributed Projects (Optional): To support projects with multiple users you will need a remote, accessible MySQL database. See here for more details
• Multi-Node Execution (Optional): To support multi-node or scaled execution you may need a multi-node RayCluster. See here for more details

In addition, ado plugins may have additional requirements for executing realistic experiments. For example:

• Fine-Tuning Benchmarking: Requires a RayCluster with GPUs
• vLLM Performance Benchmarking: Requires an OpenShift cluster with GPUs

Try it out¶

Example¶

This video shows listing actuators and getting the details of an experiment. Check demo for more videos.

Acknowledgement¶

This project is partially funded by the European Union through the Smart Networks and Services Joint Undertaking (SNS JU) under grant agreement No. 101192750 (Project 6G-DALI).

What's next¶