Introduction
Open Source AI workshop¶
Welcome to our workshop! Thank you for trusting us to help you learn about this new and exciting space. There is a lot going on here, and we want to give you enough to be able to feel confident in consuming LLM(s) and ideally find success quickly. In this workshop we'll be using a local AI Model for code completion, and learning best practices leveraging an Open Source LLM.
Our overarching goals of this workshop is as follows:
- Understand what Open Source AI is, and its general use cases
- How to use an Open Source AI model that is built in a verifiable and legal way
- Learn about Prompt Engineering, how to leverage a local LLM in starter daily tasks
Tip
This workshop may seem short, but a lot of working with AI is exploration and engagement. These labs is set up for you to get "everything you need to start" put together so you can share in a collaborative learning environment and shared exploration. Don't hesitate to raise your hand ask questions and engage with the other students.
By the time you leave today, you'll have everything you need leverage this on your laptop at home, without internet access, in a secure manner.
Agenda¶
| Lab | Description |
|---|---|
| Lab 0: Pre-work | Pre-work and set up for the workshop |
| Lab 1: Building a local AI co-pilot | Let's get VSCode and our local AI working together |
| Lab 2: Using the local AI co-pilot | Let's learn about how to use a local AI co-pilot |
| Lab 3: Configuring AnythingLLM | Let's configure AnythingLLM or Open-WebUI |
| Lab 3.5: Configuring Open-WebUI | Let's configure Open-WebUI or AnythingLLM |
| Lab 4: Prompt engineering overview | Let's learn about leveraging and engaging with the granite3.1-dense model |
| Lab 5: Useful prompts and use cases | Let's get some good over arching prompts and uses cases with granite3.1-dense model |
Success
Thank you SO MUCH for joining us on this workshop, if you have any thoughts or questions the TAs would love answer them for you. If you found any issues or bugs, don't hesitate to put a Pull Request or an Issue in and we'll get to it ASAP.
Compatibility¶
This workshop has been tested on the following platforms:
- MacOS: version 14.5
- Linux: Fedora 40
- Windows 11