Tasks
10| Task | Topics | Difficulty | Environment |
|---|---|---|---|
| Learn BPE merges nlp · tokenization · bpe · algorithms | nlp · tokenization · bpe · algorithms | medium | browser |
| Apply BPE merges to a word nlp · tokenization · bpe | nlp · tokenization · bpe | easy | browser |
| Pad token sequences and build a mask numpy · nlp · padding · masking | numpy · nlp · padding · masking | easy | browser |
| TF-IDF vectorizer from scratch nlp · tfidf · numpy · feature-engineering | nlp · tfidf · numpy · feature-engineering | hard | browser |
| Build Skip-gram pairs nlp · embeddings · word2vec · skipgram | nlp · embeddings · word2vec · skipgram | easy | browser |
| Causal scaled dot-product attention numpy · transformers · attention · causal-mask | numpy · transformers · attention · causal-mask | hard | browser |
| Build a language-model batch numpy · language-modeling · batching · gpt | numpy · language-modeling · batching · gpt | easy | browser |
| Top-k logit filtering numpy · language-modeling · sampling · top-k | numpy · language-modeling · sampling · top-k | medium | browser |
| LoRA linear layer pytorch · lora · fine-tuning · linear-algebra | pytorch · lora · fine-tuning · linear-algebra | hard | cpu · torch |
| Symmetric CLIP loss pytorch · contrastive-learning · clip · infonce | pytorch · contrastive-learning · clip · infonce | medium | cpu · torch |