Lab 0. Pre-work

These are the required applications and general installation notes for this workshop.

Please have the "Required" software installed, and then choose from the Student's choice section per your preferences. If you don't know what to select choose the SUGGESTED options.

Required¶

Ollama - This application allows you to locally host an LLM model on your computer.
Python - If you don't already have a proficiently in a language, please follow the python steps.

Student's Choice¶

Visual Studio Code - SUGGESTED We'll be walking through an extension to VSCode in this workshop.
One of the Jetbrains IDEs - You can choose the one you want, if the wifi is bad, please reach out to a TA to give you a USB stick.
AnythingLLM - SUGGESTED This will be a GUI interface to your LLM(s).
Open WebUI - This is a browser based GUI for your LLM(s).

Ollama¶

Mac installation steps¶

Download via the Ollama website¶

Download Ollama via the website.

Unzip the folder, and move the Ollama app to your applications folder.

Terminal Installation¶

Open up a terminal, and install homebrew.

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

After the installation is complete, install ollama via brew.

brew install ollama

Windows installation steps¶

Install ollama via the website here.

Visual Studio Code¶

Mac installation steps¶

Open up a terminal, and install homebrew, if you didn't install this during the Ollama step.

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

After the installation is complete, install vscode via brew.

brew install --cask visual-studio-code

Jetbrains¶

Head on over to here and download the IDE if you haven't already. If you are leveraging python like this workshop will be, you should pick PyCharm

Python¶

Python is a whole programming language. There are multiple ways to install it, and here is the official website. Please take a moment and if you can't run the following command, reach out to a teaching assistant or instructor to help you get resolved.

Note

If you have an older version of python, or default "OS" versions of python, you'll need to update.

python --version
Python 3.11.4

Mac installation steps¶

Terminal Installation¶

If you need to install Python via brew please do the following:

brew install python@3.11

Please confirm that your python --version is at least 3.11+ for the best experience.

AnythingLLM¶

Head on over here choose the correct version for your Operating System. We will configure it later in the workshop.

Open-WebUI¶

If you have decided to run the Web Based/Browser based way to interact with your LLM(s) open-webui is a fine if not the defacto choice.

Note

You only need to pick one of AnythingLLM or Open-WebUI, though you could pick both, it's really up to you!

Assuming you've set up Python above, you'll need the following commands to get it installed.

cd ~
mkdir openweb-ui
cd openweb-ui
python3.11 -m venv --upgrade-deps venv
source venv/bin/activate
pip install open-webui
open-webui serve

With this you should have the applications you need, let's start the workshop!