❤️ Become The AI Epiphany Patreon ❤️ ► [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

In this video I do a (semi) deep dive of the "An image is worth 16x16 words:
transformers for image recognition at scale" paper which introduced the Vision Transformer.

The paper is very interesting as it showed that with minimal modifications transformers can give better results than CNNs on the image classification problem.

Until now transformers were ruling the NLP world and now they are coming for the CV world as well!

You'll learn about:
✔️ How the vision transformer works
✔️ Main ideas in the paper

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ paper: [ Ссылка ]
✅ transformer Jupyter Notebook: [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

⌚️ Timetable:
0:00 Enter The Vision Transformer, Jupyter Notebook
1:00 Deep dive intro
3:14 How does Vision Transformer work?
4:39 Let's go even deeper
8:33 Positional encoding inductive bias
9:50 Model variants and results
11:50 VTAB benchmark results
13:00 Perf vs amount of pretrained data
16:08 What does Vision Transformer learn? (attention span)
19:35 Self-supervision vs Supervised learning
21:10 Scaling the transformer (future research prediction)
22:15 Positional Encodings details
24:15 Logging out

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 BECOME A PATREON OF THE AI EPIPHANY ❤️

If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!

The AI Epiphany ► [ Ссылка ]
One-time donation:
[ Ссылка ]

Much love! ❤️

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical "intuition".

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👋 CONNECT WITH ME ON SOCIAL
LinkedIn ► [ Ссылка ]
Twitter ► [ Ссылка ]

Instagram ► [ Ссылка ]
Facebook ► [ Ссылка ]

👨‍👩‍👧‍👦 JOIN OUR DISCORD COMMUNITY:
Discord ► [ Ссылка ]

📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ► [ Ссылка ]

💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS:
GitHub ► [ Ссылка ]

📚 FOLLOW ME ON MEDIUM:
Medium ► [ Ссылка ]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

#transformers #computervision #visiontransformer

свернуть