Implementing a transformer with candle + Rust - (Part 1, Input Embeddings) скачать в хорошем качестве

Implementing a transformer with candle + Rust - (Part 1, Input Embeddings)

I picked a new project. Learn GenAI with Rust. This series is about implementing a plain vanilla transformer in Rust using the candle framework. We cover the following in Part1: Input Embeddings 00:00:00 Intro and why candle 00:04:16 Some background on what we're building - transformers 00:06:45 running my project - Optimus 00:07:40 What are Input Embeddings 00:13:55 token gen, token to id mapping, one-hot encodings 00:14:18 summing up - embedding layer or embedding matrix 00:16:17 Create embeddings with Candle + Rust code 00:22:13 What's in the next episode about In Part2 - we will cover positional encodings Link to Git repo: https://github.com/nihalpasham/optimu... #ai #rust #apple #gpu