Back to Catalog

Mastering Generative AI: Fine-Tuning Transformers

Learn on

edX logo
IntermediateCourse

Unlock the potential of generative AI by fine-tuning transformers with this intermediate-level course. You will explore advanced techniques, enhance model efficiency, and improve AI performance. Through hands-on projects, gain skills in data preparation, parameter adjustment, and outcome evaluation. Designed for practitioners aiming to refine their expertise, this course bridges foundational knowledge and advanced application.

Language

  • English

Topic

  • Artificial Intelligence

Enrollment Count

  • 637

Skills You Will Learn

  • Fine-tuning LLMs, LoRA And QLoRA, Pre-Training Transformers, PyTorch And Hugging Face

Offered By

  • IBMSkillsNetwork

Estimated Effort

  • 2 Weeks 4 hrs

Platform

  • edX

Last Update

  • March 16, 2026
About this Course
  1. Hello and welcome to this course!

  2. In this course, you will explore transformers and model frameworks, such as PyTorch and Hugging Face. You’ll begin this course with a general framework to optimize large language models (LLMs) and fine-tune generative AI models.

  3. Additionally, you’ll learn about parameter-efficient fine-tuning (PEFT), low-rank adaptation (LoRA), and quantized low-rank adaptation (QLoRA).

  4. You’ll also practice hands-on labs such as loading, pretraining, fine-tuning, and applying models with Hugging Face and PyTorch.

  5. This course is part of the Generative AI Engineering Professional Certificate, designed to equip learners with the essential skills in Python, PyTorch, and neural networks in generative AI engineering with LLMs.
  6. Who should take this course?
  7. This course is designed for professionals interested in AI engineering and includes training, developing, fine-tuning, and deploying LLMs. It is also suitable for existing and aspiring data scientists and machine learning engineers.

  8. Prerequisites
  9. You’ll require basic knowledge of Python, PyTorch, and neural networks. This course is suitable for professionals aspiring to build their careers in AI engineering, including training, developing, fine-tuning, and deploying LLMs. This professional certificate is suitable for existing and aspiring data scientists and machine learning engineers with basic knowledge of Python.
  10. Congratulations on taking this first step to boost your skills in fine-tuning transformers.
  11. Enjoy the journey!