Paper Review: RWKV-7 Goose with Expressive Dynamic State Evolution
24 March 2025
My review of the paper RWKV-7 Goose with Expressive Dynamic State Evolution
Blogposts
Data science, career and other topics
Browse by category:
Paper Review: Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
17 March 2025
My review of the paper Audio Flamingo 2 An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
Paper Review: Large Language Diffusion Models
10 March 2025
LLaDA replaces autoregressive token generation with diffusion-based masked prediction, rivaling LLaMA3 8B while naturally solving the reversal curse that plagues standard LLMs.
Two Years of Studying and Practicing Foreign Languages
05 March 2025
Two Years of Studying and Practicing Foreign Languages. Spanish, German, and Japanese
Paper Review: NeoBERT: A Next-Generation BERT
03 March 2025
A compact 250M-parameter bidirectional encoder that incorporates RoPE, SwiGLU, and modern pretraining to outperform much larger models on the MTEB benchmark.
Paper Review: SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
24 February 2025
Google's upgraded vision-language encoders that add self-supervised learning and online data curation to SigLIP, delivering major gains in localization, dense prediction, and multilingual retrieval.