Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

52 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2024
    A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning TasksErik B. Terres-Escudero, Javier Del Ser, Pablo G. BringasCoLLAs
    PDF ↗
  2. 2024
    Learning to Learn without Forgetting using AttentionAnna Vettoruzzo, Joaquin Vanschoren, Mohamed-Rafik Bouguelia, Thorsteinn RögnvaldssonCoLLAs
    PDF ↗
  3. 2024
    Diffusion Augmented Agents: A Framework for Efficient Exploration and Transfer LearningNorman Di Palo, Leonard Hasenclever, Jan Humplik, Arunkumar ByravanCoLLAs
    PDF ↗
  4. 2024
    Local vs Global continual learningGiulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas HofmannCoLLAs
    PDF ↗
  5. 2024
    Reflecting on the State of Rehearsal-free Continual Learning with Pretrained ModelsLukas Thede, Karsten Roth, Olivier J. Hénaff … Zeynep AkataCoLLAs
    PDF ↗
  6. 2024PDF ↗
  7. 2024
    Statistical Context Detection for Deep Lifelong Reinforcement LearningJeffery Dick, Saptarshi Nath, Christos Peridis … Andrea SoltoggioCoLLAs
    PDF ↗
  8. 2024
    An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank UpdatesAlbin Soutif--Cormerais, Simone Magistri, Joost van de Weijer, Andew D. BagdanovCoLLAs
    PDF ↗
  9. 2024PDF ↗
  10. 2024
    Integrating Present and Past in Unsupervised Continual LearningYipeng Zhang, Laurent Charlin, Richard S. Zemel, Mengye RenCoLLAs
    PDF ↗
  11. 2024PDF ↗
  12. 2024
    Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from GeneralizationSebastian Dziadzio, Çağatay Yıldız, Gido M. van de Ven … Matthias BethgeCoLLAs
    PDF ↗
  13. 2024
    Continual Learning of Diffusion Models with Generative DistillationSergi Masip, Pau Rodríguez, Tinne Tuytelaars, Gido M. van de VenCoLLAs
    PDF ↗
  14. 2024
    From Categories to Classifiers: Name-Only Continual Learning by Exploring the WebAmeya Prabhu, Hasan Abed Al Kader Hammoud, Ser-Nam Lim … Adel BibiCoLLAs
    PDF ↗
  15. 2024
    Keep moving: identifying task-relevant subspaces to maximise plasticity for newly learned tasksDaniel Anthes, Sushrut Thorat, Peter König, Tim C. KietzmannCoLLAs
    PDF ↗
  16. 2024PDF ↗
  17. 2024
    Maintaining Plasticity in Continual Learning via Regenerative RegularizationSaurabh Kumar, Henrik Marklund, Benjamin Van RoyCoLLAs
    PDF ↗
  18. 2023
    Improving Performance in Continual Learning Tasks using Bio-Inspired ArchitecturesSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakashCoLLAs
    PDF ↗
  19. 2023
    Measuring and Mitigating Interference in Reinforcement LearningVincent Liu, Wang, Han, Tao, Ruo Yu … White, MarthaCoLLAs · University of Alberta
    PDF ↗
  20. 2023
    Improving Online Continual Learning Performance and Stability with Temporal EnsemblesAlbin Soutif--Cormerais, Antonio Carta, Joost van de WeijerCoLLAs
    PDF ↗
  21. 2023
    Partial Hypernetworks for Continual LearningHamed Hemati, Vincenzo Lomonaco, Davide Bacciu, Damian BorthCoLLAs
    PDF ↗
  22. 2024
    Masked Autoencoders are Efficient Continual Federated LearnersSubarnaduti Paul, Lars-Joel Frey, Roshni Kamath … Martin MundtCoLLAs
    PDF ↗
  23. 2023
    RaSP: Relation-aware Semantic Prior for Weakly Supervised Incremental SegmentationSubhankar Roy, Riccardo Volpi, Gabriela Csurka, Diane LarlusCoLLAs · Télécom Paris
    PDF ↗
  24. 2023
    Sharing Lifelong Reinforcement Learning Knowledge via Modulating MasksSaptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioCoLLAs
    PDF ↗
  25. 2023PDF ↗
  26. 2023
    I2I: Initializing Adapters with Improvised KnowledgeTejas Srinivasan, Furong Jia, Mohammad Rostami, Jesse ThomasonCoLLAs
    PDF ↗
  27. 2023
    Fixed Design Analysis of Regularization-Based Continual LearningHaoran Li, Jingfeng Wu, Vladimir BravermanCoLLAs
    PDF ↗
  28. 2023
    Replay Buffer with Local Forgetting for Adapting to Local Environment Changes in Deep Model-Based Reinforcement LearningAli Rahimi-Kalahroudi, Janarthanan Rajendran, Ida Momennejad … Sarath ChandarCoLLAs
    PDF ↗
  29. 2023
    Loss of Plasticity in Continual Deep Reinforcement LearningZaheer Abbas, Rosie Zhao, Joseph Modayil … Marlos C. MachadoCoLLAs
    PDF ↗
  30. 2023
    Class-Incremental Learning with RepetitionHamed Hemati, Andrea Cossu, Antonio Carta … Damian BorthCoLLAs
    PDF ↗
  31. 2023
    PlaStIL: Plastic and Stable Exemplar-Free Class-Incremental LearningGrégoire Petit, Adrian Popescu, Eden Belouadah … Bertrand DelezoideCoLLAs
    PDF ↗
  32. 2022PDF ↗
  33. 2022
    A Theory for Knowledge Transfer in Continual LearningDiana Benavides‐Prado, Patricia RiddleCoLLAs
    PDF ↗
  34. 2022
    Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2Zachary Daniels, Aswin Raghavan, Jesse Hostetler … Ajay DivakaranCoLLAs
    PDF ↗
  35. 2022PDF ↗
  36. 2022
    Reactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement LearningChristian Steinparz, Thomas Schmied, Fabian Paischer … Sepp HochreiterCoLLAs
    PDF ↗
  37. 2023
    Challenging Common Assumptions about Catastrophic Forgetting and Knowledge AccumulationTimothée Lesort, Оleksiy Ostapenko, Diganta Misra … Irina RishCoLLAs
    PDF ↗
  38. 2022PDF ↗
  39. 2022PDF ↗
  40. 2022PDF ↗
  41. 2023
    Task-Agnostic Continual Reinforcement Learning: Gaining Insights and Overcoming ChallengesM. Caccia, Jonas Mueller, Taesup Kim … Rasool FakoorCoLLAs
    PDF ↗
  42. 2022
    Continual Learning with Foundation Models: An Empirical Study of Latent ReplayОleksiy Ostapenko, Timothée Lesort, Pau Rodríguez … Laurent CharlinCoLLAs
    PDF ↗
  43. 2022
    Forgetting and Imbalance in Robot Lifelong Learning with Off-policy DataWenxuan Zhou, Steven Bohez, Jan Humplik … Nicolas HeessCoLLAs
    PDF ↗
  44. 2022
    Continual Learning and Private UnlearningBo Liu, Qiang Liu, Peter StoneCoLLAs
    PDF ↗
  45. 2022
    Online Continual Learning for Embedded DevicesTyler L. Hayes, Christopher KananCoLLAs
    PDF ↗
  46. 2022
    Sparsity and Heterogeneous Dropout for Continual Learning in the Null Space of Neural ActivationsAli Abbasi, Parsa Nooralinejad, Vladimir Braverman … Soheil KolouriCoLLAs
    PDF ↗
  47. 2023
    Continual Learning Beyond a Single ModelThang Doan, Seyed Iman Mirzadeh, Mehrdad FarajtabarCoLLAs
    PDF ↗
  48. 2022PDF ↗
  49. 2022
    Continual Novelty DetectionRahaf Aljundi, Daniel Olmeda Reino, Nikolay Chumerin, Richard E. TurnerCoLLAs
    PDF ↗
  50. 2022
    TAG: Task-based Accumulated Gradients for Lifelong learningPranshu Malviya, Balaraman Ravindran, Sarath ChandarCoLLAs
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. By default it shows the papers we have a reason to trust: published at a venue like NeurIPS, ICML, ICLR, CVPR or TPAMI, or written by someone who has published there, or cited a few hundred times. The rest are one click away under “All papers”. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.