All research directions

Continual Learning Foundation Models

Lifelong adaptation, continual learning, incremental learning, and unlearning for evolving foundation models.

To enable foundation models to learn continuously from new data while retaining prior knowledge and forgetting sensitive information when required.

Overview

This direction studies how large models adapt over time without catastrophic forgetting. Research covers rehearsal-free continual learning, document retrieval under distribution shift, and principled machine unlearning for safe AI.

Key topics

  • Continual learning for LLMs
  • Continual learning for SDMs
  • Continual learning for VLA
  • Incremental learning for foundation models
  • Continuous document retrieval under distribution shift

News

  • Mar 2026

    Paper An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental Learning accepted at CVPR.

  • Mar 2025

    Paper A Good Teacher Adapts Their Knowledge for Distillation accepted at ICCV.

  • Feb 2025

    Paper Boosting Multiple Views for pretrained-based Continual Learning accepted at ICLR.

Papers in this direction

  • An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental Learning

    Quyen Tran, Ngoc-Hai Nguyen, Quan Dao, Hoang Phan, Ngo Van-Linh, Khoat Than, Dinh Phung, Dimitris N. Metaxas, Trung Le

    Conference on Computer Vision and Pattern Recognition 2026 (CVPR 2026)
  • Spectral-Aware Analytic Class-Incremental Learning for Long-Tailed Distributions

    Quyen Tran, Ngoc-Hai Nguyen, Quan Dao, Zhuowei Li, Nam Le Hai, Trung Le, Dimitris N. Metaxas

    European Conference on Computer Vision (ECCV 2026)
  • A Good Teacher Adapts Their Knowledge for Distillation

    Chengyao Qian, Trung Le, Mehrtash Harandi

    International Conference on Computer Vision (ICCV 2025)
  • Boosting Multiple Views for pretrained-based Continual Learning

    Quyen Tran, Tung Lam Tran, Khanh Doan, Toan Tran, Khoat Than, Dinh Phung, Trung Le

    International Conference on Learning Representations 2025 (ICLR 2025)
  • Leveraging Hierarchical Taxonomies in Prompt-based Continual Learning

    Quyen Tran, Hoang Phan, Minh Le, Tuan Truong, Dinh Phung, Linh Ngo, Thien Nguyen, Nhat Ho, Trung Le

    arXiv preprint arXiv:2410.04327
    [arXiv]
  • Improving prompt-based continual learning with key-query orthogonal projection and prototype-based one-versus-all

    Quyen Tran, Tung Lam Tran, Khoat Than, Toan Tran, Dinh Phung, Trung Le

    article
  • Class-prototype conditional diffusion model for continual learning with generative replay

    Khanh Doan, Quyen Tran, Tuan Nguyen, Dinh Phung, Trung Le

    arXiv preprint arXiv:2312.06710vol. 1
    [arXiv]