Name: Video recording for Fine-tuning LLMs with Declarative ML Orchestration - Codementor Events
Uploaded: 2023-09-04
Description: Learn efficient fine-tuning of large language models using Flyte, an open-source orchestration platform. Discover state-of-the-art deep learning tools like torchrun, LoRA, and FSDP with reproducibility and cost management benefits.

Learn efficient fine-tuning of large language models using Flyte, an open-source orchestration platform. Discover state-of-the-art deep learning tools like torchrun, LoRA, and FSDP with reproducibility and cost management benefits.

_This talk is part of the **[AI Engineering Job Fair](https://www.codementor.io/events/remote-ai-job-fair-hiy7zwae7q)**. Signing up for this event will give you access to all the talks on the agenda, including the job fair._

## About the talk
Foundation LLMs are trained by a few organizations with massive compute resources. The ML community fine-tunes these models for specific uses, facing infrastructure challenges.

In this session, Niels will demonstrate how to use Flyte, a Linux Foundation open-source orchestration platform. 

Flyte allows for the declarative specification of the infrastructure needed for a broad range of ML workloads, including fine-tuning LLMs with limited resources. 

### Key Takeaways
- Efficiently fine-tune large language models with limited resources using Flyte.
- Explore torchrun, LoRA, and FSDP for deep learning tasks.
- Leverage Flyte's reproducibility and cost management features for ML workloads.

Video recording for: Fine-tuning LLMs with Declarative ML Orchestration

Discussion