Data science, career and other topics
06 January 2025
Coconut lets LLMs reason in latent space instead of generating text tokens, enabling breadth-first exploration of reasoning paths and better performance on tasks requiring backtracking.
28 December 2024
12 years of studying foreign languages with Anki
23 December 2024
BERT rebuilt with modern tricks — 2 trillion training tokens, 8192 context length, Flash Attention, and rotary embeddings — delivering state-of-the-art classification and retrieval with the best speed/memory efficiency among encoders.
16 December 2024
My review of the paper Byte Latent Transformer Patches Scale Better Than Tokens
09 December 2024
My review of the paper Reverse Thinking Makes LLMs Stronger Reasoners
25 November 2024
What happens when you put 1k AI agents in Minecraft and let them self-organize? They form governments, transmit culture, develop religions, and build legal systems.
Type at least 2 characters to search...