Tag: pretraining

Paper Review: CogVLM: Visual Expert for Pretrained Language Models (09 Nov 2023)
Paper Review: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture (15 Jun 2023)
Paper Review: The effectiveness of MAE pre-pretraining for billion-scale pretraining (05 Jun 2023)
Paper Review: DarkBERT: A Language Model for the Dark Side of the Internet (18 May 2023)
Paper Review: DINOv2: Learning Robust Visual Features without Supervision (20 Apr 2023)
Paper Review: NÜWA Visual Synthesis Pre-training for Neural visUal World creAtion (25 Nov 2021)
Paper Review: Efficient Visual Pretraining with Contrastive Detection (01 Sep 2021)
Paper Review: CoAtNet Marrying Convolution and Attention for All Data Sizes (10 Jun 2021)
Paper Review: ByT5 Towards a token-free future with pre-trained byte-to-byte models (02 Jun 2021)
Paper Review: Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence (21 May 2021)
Paper Review: Are Pre-trained Convolutions Better than Pre-trained Transformers? (10 May 2021)
Paper Review: LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval (21 Mar 2021)
Paper Review: ReXNet: Diminishing Representational Bottleneck on Convolutional Neural Network (04 Jul 2020)
Paper Review: VirTex: Learning Visual Representations from Textual Annotations (14 Jun 2020)

All tags

paperreview (154) deeplearning (150) cv (65) nlp (56) llm (42) transformer (26) sota (14) pretraining (14) blogpost (14) imagesegmentation (12) pytorch (9) objectdetection (9) attention (8) career (7) video (6) datascience (6) stablediffusion (5) diffusion (5) timeseries (4) selfsupervised (4) ner (4) mllm (4) gan (4) agent (4) yolo (3) vlm (3) styletransfer (3) life (3) kaggle (3) imagegeneration (3) imagecaptioning (3) augmentation (3) audio (3) visual (2) tts (2) transferlearning (2) superresolution (2) simulation (2) sd (2) recommender (2) ranking (2) qa (2) languages (2) languagemodel (2) gpt (2) gnn (2) generation (2) fewshotlearning (2) dpo (2) competition (2) cnn (2) classification (2) weaksupervision (1) unet (1) textgeneration (1) tensorflow (1) tabular (1) swa (1) summarization (1) speechtranslation (1) speechtospeech (1) speechrecognition (1) speechgeneration (1) sentenceembeddings (1) semisupervised (1) robustness (1) robotics (1) rnn (1) relationextrction (1) relationextraction (1) reinforcementlearning (1) recurrent (1) recommendation (1) realtime (1) ragn (1) rag (1) quantization (1) promptengineering (1) objecttracking (1) objectdetecion (1) nlg (1) nas (1) multimodal (1) motivation (1) motiontracking (1) mlp (1) mentoring (1) memoryoptimization (1) mamba (1) languagetranslation (1) jigsaw (1) instructlearning (1) inferencespeed (1) imagetextmatching (1) imagerestoration (1) imageinpainting (1) graphneuralnets (1) graph (1) forecasting (1) fail (1) entitylinking (1) endtoend (1) embedding (1) efficiency (1) distillation (1) diffusionmodels (1) depthestimation (1) curriculumlreaning (1) contrastivelearning (1) coco (1) clip (1) chatbot (1) captioning (1) books (1) bert (1) autoencoder (1) asr (1) annotation (1) anchorfree (1) alignment (1) advice (1) adversarial (1) activationfunction (1)