➡️ ADVANCED Vision Fine-tuning Repo: [ Ссылка ]
➡️ Trelis Newsletter: [ Ссылка ]
➡️ Trelis Resources and Support: [ Ссылка ]
**Video Resources**
Slides: [ Ссылка ]
IDEFICS: [ Ссылка ]
LLaVA: [ Ссылка ]
Affiliate Links (support the channel):
- RunPod - [ Ссылка ]
- Vast AI - [ Ссылка ]
Chapters:
0:00 Fine-tuning Multi-modal Models
0:16 Overview
1:30 LLaVA vs ChatGPT
4:53 Applications
5:37 Multi-modal model architecture
9:05 Vision Encoder architecture
14:00 LLaVA 1.5 architecture
16:30 LLaVA 1.6 architecture
18:30 IDEFICS architecture
22:00 Data creation
24:11 Dataset creation
25:29 Fine-tuning
34:25 Inference and Evaluation
37:34 Data loading
40:00 LoRA setup
42:52 Recap so far
43.25 Evaluation pre-training
44:26 Training
45:40 Evaluation post-training
46:45 Technical clarifications
50:29 Summary
