Back to Catalog

Mastering Generative AI: Fine-Tuning Transformers

Learn on

edX logo
IntermediateCourse

Unlock the potential of generative AI by fine-tuning transformers with this intermediate-level course. You will explore advanced techniques, enhance model efficiency, and improve AI performance. Through hands-on projects, gain skills in data preparation, parameter adjustment, and outcome evaluation. Designed for practitioners aiming to refine their expertise, this course bridges foundational knowledge and advanced application.

Language

  • English

Topic

  • Artificial Intelligence

Skills You Will Learn

  • Fine-tuning LLMs, LoRA And QLoRA, PyTorch And Hugging Face, Pre-Training Transformers

Offered By

  • IBMSkillsNetwork

Estimated Effort

  • 2 Weeks 4 hrs

Platform

  • edX

Last Update

  • February 5, 2025
About this Course
  1. Hello and welcome to this course!

  2. In this course, you will explore transformers and model frameworks, such as PyTorch and Hugging Face. You’ll begin this course with a general framework to optimize large language models (LLMs) and fine-tune generative AI models.

  3. Additionally, you’ll learn about parameter-efficient fine-tuning (PEFT), low-rank adaptation (LoRA), and quantized low-rank adaptation (QLoRA).

  4. You’ll also practice hands-on labs such as loading, pretraining, fine-tuning, and applying models with Hugging Face and PyTorch.

  5. This course is part of the Generative AI Engineering Professional Certificate, designed to equip learners with the essential skills in Python, PyTorch, and neural networks in generative AI engineering with LLMs.
  6. Who should take this course?
  7. This course is designed for professionals interested in AI engineering and includes training, developing, fine-tuning, and deploying LLMs. It is also suitable for existing and aspiring data scientists and machine learning engineers.

  8. Prerequisites
  9. You’ll require basic knowledge of Python, PyTorch, and neural networks. This course is suitable for professionals aspiring to build their careers in AI engineering, including training, developing, fine-tuning, and deploying LLMs. This professional certificate is suitable for existing and aspiring data scientists and machine learning engineers with basic knowledge of Python.
  10. Congratulations on taking this first step to boost your skills in fine-tuning transformers.
  11. Enjoy the journey!

Instructors

Joseph Santarcangelo

Senior Data Scientist at IBM

Joseph has a Ph.D. in Electrical Engineering, his research focused on using machine learning, signal processing, and computer vision to determine how videos impact human cognition. Joseph has been working for IBM since he completed his PhD.

Read more

Fateme Akbari

Data Scientist @IBM

I'm a data-driven Ph.D. Candidate at McMaster University and a data scientist at IBM, specializing in machine learning (ML) and natural language processing (NLP). My research focuses on the application of ML in healthcare, and I have a strong record of publications that reflect my commitment to advancing this field. I thrive on tackling complex challenges and developing innovative, ML-based solutions that can make a meaningful impact—not only for humans but for all living beings. Outside of my research, I enjoy exploring nature through trekking and biking, and I love catching ball games.

Read more

Kang Wang

Data Scientist

I am a Data Scientist in the IBM. I am also a PhD Candidate in the University of Waterloo.

Read more

Ashutosh Sagar

Data Scientist

I am currently a Data Scientist at IBM with a Master’s degree in Computer Science from Dalhousie University. I specialize in natural language processing, particularly in semantic similarity search, and have a strong background in working with advanced AI models and technologies.

Read more

Contributors

Wojciech "Victor" Fulmyk

Data Scientist at IBM

As a data scientist at the Ecosystems Skills Network at IBM and a Ph.D. candidate in Economics at the University of Calgary, I bring a wealth of experience in unraveling complex problems through the lens of data. What sets me apart is my ability to seamlessly merge technical expertise with effective communication, translating intricate data findings into actionable insights for stakeholders at all levels. Follow my projects to learn data science principles, machine learning algorithms, and artificial intelligence agent implementations.

Read more