Tag: distillation

• Paper Review: Subliminal Learning: Language models transmit behavioral traits via hidden signals in data (28 Jul 2025)
  
• Paper Review: M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models (21 Apr 2025)
  
• Paper Review: Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes (08 May 2023)
  

---

All tags

paperreview (187) deeplearning (183) cv (74) nlp (73) llm (62) transformer (35) blogpost (18) pretraining (16) sota (15) imagesegmentation (14) attention (11) pytorch (10) objectdetection (9) career (9) imagegeneration (8) video (7) rl (6) life (6) diffusion (6) datascience (6) agent (6) timeseries (5) stablediffusion (5) vlm (4) selfsupervised (4) ner (4) mllm (4) languages (4) gan (4) audio (4) yolo (3) tokenization (3) superresolution (3) styletransfer (3) rnn (3) reasoning (3) kaggle (3) imagecaptioning (3) distillation (3) bert (3) augmentation (3) visual (2) videogeneration (2) tts (2) transferlearning (2) simulation (2) sd (2) reinforcementlearning (2) recommender (2) ranking (2) rag (2) qa (2) mamba (2) machinelearning (2) languagemodel (2) jobsearch (2) graph (2) gpt (2) gnn (2) generation (2) fewshotlearning (2) dpo (2) competition (2) cnn (2) classification (2) weaksupervision (1) unet (1) textgeneration (1) tensorflow (1) tabular (1) swa (1) summarization (1) speechtranslation (1) speechtospeech (1) speechrecognition (1) speechgeneration (1) sentenceembeddings (1) semisupervised (1) selfsupervisedlearning (1) scaling (1) robustness (1) robotics (1) relationextrction (1) relationextraction (1) recurrent (1) recommendation (1) realtime (1) quantization (1) promptengineering (1) objecttracking (1) objectdetecion (1) nlg (1) nas (1) multimodal (1) motivation (1) motiontracking (1) mlp (1) mentoring (1) memoryoptimization (1) languagetranslation (1) jigsaw (1) interview (1) instructlearning (1) inferencespeed (1) imagetextmatching (1) imagerestoration (1) imageinpainting (1) graphneuralnets (1) forecasting (1) fail (1) evaluation (1) entitylinking (1) endtoend (1) embedding (1) efficiency (1) diffusionmodels (1) depthestimation (1) curriculumlreaning (1) contrastivelearning (1) coco (1) clip (1) chatbot (1) captioning (1) books (1) autoencoder (1) asr (1) annotation (1) anchorfree (1) alignment (1) advice (1) adversarial (1) activationfunction (1) CV (1)