Data science, career and other topics
23 December 2024
BERT rebuilt with modern tricks — 2 trillion training tokens, 8192 context length, Flash Attention, and rotary embeddings — delivering state-of-the-art classification and retrieval with the best speed/memory efficiency among encoders.
16 December 2024
My review of the paper Byte Latent Transformer Patches Scale Better Than Tokens
09 December 2024
My review of the paper Reverse Thinking Makes LLMs Stronger Reasoners
25 November 2024
What happens when you put 1k AI agents in Minecraft and let them self-organize? They form governments, transmit culture, develop religions, and build legal systems.
11 November 2024
My review of the paper Large Language Models Orchestrating Structured Reasoning Achieve Kaggle Grandmaster Level
29 October 2024
My review of the paper Unbounded A Generative Infinite Game of Character Life Simulation
Type at least 2 characters to search...