Technical Blog

• RoPE and Rotations
• Fully Sharded Data Parallel (FSDP)
• Event Loop and GIL
• Encoder and Decoder
• Pre-norm and Post-norm
• Watermarking with SynthID-Text
• Retrieval-augmented Generation (RAG)
• Cross-entropy and Negative Log Likelihood