Page 2 - Showing 5 of 13 posts
- Understanding Attention: From Q, K, V to Multi-Head
A deep dive into Attention, the Transformer's core engine: grasp Q, K, V via a database-query analogy, master Multi-Head, and clear up Softmax vs RMSNorm.
13 min read - RoPE: From Permutation Invariance to Multi-Frequency
A deep dive into RoPE (Rotary Position Embedding), the standard position encoding for modern LLMs: the math, the engineering, and floating-point precision.
12 min read - Why Transformers Need Normalization: Gradients to RMSNorm
A deep dive into why deep neural networks need normalization, and how RMSNorm became standard in modern LLMs
10 min read - Frontend Intern Interviews at Chinese Startups: A Prep Guide
A systematic rundown of the technical topics, application data, and a complete prep checklist for frontend internship interviews at smaller Chinese companies.
8 min read - My First-Ever Pull Request
A sophomore reflects on landing his first successful open-source pull request
6 min read