FourthBrain Workshop
MultiModal Models with RAG
A 1-day LIVE workshop for engineers, developers, and data scientists on combining the capabilities of RAG with vision-language models. You'll learn to enrich application functionalities with multimodal data understanding and retrieval.
- Date: Coming Soon!
- Time: 9am-3pm PT
- Cost: $500
Generative AI is evolving past strictly textual or strictly visual tasks. Combining multiple types of data can create a much more powerful experience for your users.
In this workshop you will deepen your understanding of vision-language models, and integrate visual and textural information to enhance applications. You'll build an application combining advanced RAG features with vision-language models to solve complex tasks involving both visual and textual inputs.
Key Outcomes
Understand the architecture, functionality, and applications of multimodal models
Integrate vision-langauge models with RAG for enhanced multimodal data processing
Use multimodal models to solve complex tasks
Workshop Schedule
This workshop includes two modules.
- Introduction to latest vision-language models including CLIP, Dall-E, and more
- Integrating vision-language models with RAG
- Set up a vision-language model to perform tasks
This workshop is for you if:
You are an engineer, data scientist, or developer who wants to incorporate multi-modal capabilities to your projects
You have some experience with LLMs and understand some of the use cases for multimodal applications
You are fluent in Python and have experience manipulating data, building basic ML models like classifiers, and have deployed an application.
How to Prepare
Create a Google Colab Account
We suggest you work in Google Colab for fine-tuning, so you should have a paid account.
Familiarize yourself with Hugging Face
This Introduction to Hugging Face Course will teach you about NLP using libraries from the Hugging Face ecosystem.
Many employers offer reimbursement for programs like ours. Check out our tips for getting reimbursed.
Register Here
Interested in this program for your team? Reach out!
FAQs
