Generative AI For Software Developers Syllabus
Generative AI For Software Developers Syllabus
udacity.com
Generative AI Nanodegree program
Overview
In an era where generative AI is reshaping the landscape of software development, the Generative AI
Nanodegree program equips professionals with essential skills to apply these cutting-edge technologies to
enhance their software applications. The program addresses the growing demand for expertise in adapting
generative foundation models, crafting custom applications using large language models (LLMs), and
employing advanced techniques like Stable Diffusion. If you aspire to supercharge your software development
and stay at the forefront of artificial intelligence and deep learning advancements, this program is for you!
A graduate of this program will be able to: Additional software such as Python and common
Situate generative AI within the broader history, context, and deep learning libraries (e.g. PyTorch and Hugging
applications of artificial intelligence and deep learning Face) will be required, but the program includes
Udacity Workspaces with all of the relevant packages
Adapt generative foundation models to perform tasks in installed, so students will not need to download any
novel contexts additional software.
Use LLMs and prompt engineering to create a custom
chatbot
Use image generation models such as Stable Diffusion to *The length of this program is an estimation of total hours
perform image inpainting the average student may take to complete all required
coursework, including lecture and project time. If you spend
Build applications that use LLMs, implement semantic search about 5-10 hours per week working through the program, you
with vector databases, and apply retrieval augmented should finish within the time provided. Actual hours may vary.
generation techniques
uda c it y . c om
G e n e r at i v e AI N a nodegre e pro gr a m
Course #1
GenAI Fundamentals
S k i l l s c ov e r e d i n c l u d e :
What is GenAI?
Examples of GenAI
Deep Learning Fundamentals
Foundation Models
Domain Adaptation
ChatGPT & BERT
P RO J E CT # 1
In this project, learners will explore advanced techniques in AI model fine-tuning with Hugging Face and PyTorch
tools.
To pass this project, learners will need to execute the following core tasks:
Identify and load a Hugging Face dataset for your particular task
Utilize a state-of-the-art technique to adjust the foundation model's weights to meet the needs of your task,
using a lightweight (AKA parameter-efficient) fine-tuning technique that improves performance faster and more
efficiently
udacity.com
Gener at ive AI Na node g ree p ro g r am
Course #2
LLMs & Text Generation
Dive deeper into how computers understand and create
language, and build a custom chatbot using unsupervised
machine learning and prompt engineering.
PROJECT #2
Build a Custom Chat Bot
Apply retrieval-augmented generation (RAG) to create a custom OpenAI chatbot without fine-tuning.
To pass this project, learners will need to execute the following core tasks:
Find and prepare a dataset that augments a foundation model's knowledge, from a source such as APIs, web
scraping, or documents on hand
Create a semantic search pipeline by implementing a custom Python vector similarity search algorithm to
match user questions to relevant parts of the custom dataset
Compose a custom query by combining the semantic search results with the user's question and send it to the
foundation model
u d a c i ty. c o m
Gener at ive AI Na node ree ro r
g p g am
Course #3
Computer Vision &
Generative AI
Learn how computers process and understand image data,
then harness the power of the latest Generative AI models
to create new images.
PROJECT #3
AI Photo Editing with Inpainting
Use the Segment Anything Model (SAM) and Stable Diffusion to replace parts of images with AI-generated content.
To pass this project, learners will need to execute the following core tasks:
Create a segmentation mask by differentiating between the subject and background of an image and create a
matrix of pixels indicating the locations of these two components
Given a text prompt and the pixel locations of the subject or background, replace part of the image with an AI-
generated image
Connect your inpainting pipeline to a web interface that allows users to upload their own images and specify
their own text prompts
ud ci
a ty. co m
Generative AI N anode g ree p ro g ram
Course #4
GenAI Solutions
Learn how to design and build applications that use
generative AI models. Build applications and AI agents
using the OpenAI API, vector databases and semantic
search, the LangChain framework, and techniques for
recommendation, personalization, and retrieval
augmented generation (RAG).
PROJECT #4
Personalized Real Estate Agent
Build a “real estate agent” application that uses LLMs for content generation, vector databases, semantic search
and RAG techniques to transform standard real estate listings into personalized narratives.
To pass this project, learners will need to execute the following core tasks:
Generate synthetic data using LLMs
Embed property listing data in a vector database
Perform semantic search over property listings against user preferences
Design prompts and use RAG techniques to deliver personalized recommendations
u dac i t y . c o m
G e n e r at i v e A I N a n o d e g r e e p ro g r a m
Jason Lin
Research Engineer
udacity.com
Learn more at
w w w.udacity.com