Using Large Language Models locally
Using Large Language Models locally
one afternoon
General context
Although most of us use Large Language Models via a web interface, this is not always the ideal scenario. GDPR or intellectual property considerations may prohibit exposing data or even queries to providers of such services. A model may have to be fine-tuned to increase the quality for certain applications. In such circumstances, you may want to deploy an LLM locally, and this training will show you how to do that and give some illustrations of applications you can implement.
When you follow this training you will be able to:
- install and run LLMs on local hardware;
- use Retrieval Augmented Generation (RAG) to chat with your own documents/data;
- fine-tune an LLM to better answer your questions;
- optimize an LLM to reduce requirements for inference.
Familiarity with Python will be required, experience using the Bash command line will help.
Trainers
Geert Jan Bex
Program
0900-17:30 - Local LLMs
Practical info
05 December 2024
Brussels - HOEK 38
Leuvenseweg 38
1000 Brussel
Belgium
05 December 2024
Brussels - HOEK 38
No public transport information has been provided for this location.
05 December 2024
Brussels - HOEK 38
05 December 2024
Brussels - HOEK 38
No parking information has been provided for this location.