I implement DALLE 1 from SCRATCH on MNIST скачать в хорошем качестве

I implement DALLE 1 from SCRATCH on MNIST

In this video I go over Dalle-1. Specifically I talk over all Dalle components and how to train each of those components. I show results and visualizations of what Dalle 1 ends up learning in both the stages and finally how to actually implement Dalle by yourself and generate images in pytorch. #dalle #generativeai Timestamps 00:00 Intro 00:31 Components of Dalle 01:42 Stage I - Learning the Codebook 02:20 Gumbel Softmax 04:50 Stage I with Gumbel Softmax 06:06 Impact of KL Loss Weight 06:49 Creating the dataset 08:08 Reconstruction Results 08:58 Stage I Visualization 10:00 Stage II Training 12:02 Generation Results 12:40 Stage II Attention Visualization 15:37 Positional Embedding Visualization 17:10 Discrete VAE Implementation 19:26 Transformer Implementation 21:23 Outro Paper Link - https://tinyurl.com/exai-dalle-paper Subscribe - https://tinyurl.com/exai-channel-link Other DallE Videos you should checkout - AI Coffee Break with Letitia    • OpenAI's DALL-E explained. How GPT-3 creat...   Aleksa Gordić - The AI Epiphany -    • DALL-E: Zero-Shot Text-to-Image Generation...   Yannic Kilcher -    • OpenAI DALL·E: Creating Images from Text (...   Gumbel Softmax Links https://tinyurl.com/exai-dalle-gumbel-1 https://tinyurl.com/exai-dalle-gumbel-2 https://tinyurl.com/exai-dalle-gumbel-3 https://tinyurl.com/exai-dalle-gumbel-4 https://tinyurl.com/exai-dalle-gumbel-5 Implementation Links My Implementation - https://tinyurl.com/exai-dalle-code For a more efficient implementation of DallE and whole lot of other papers, checkout https://tinyurl.com/lucidrains-dalle (a lot of my implementation is also taken from here) Background Track Fruits of Life by Jimena Contreras Email - explainingai.official@gmail.com