Related work

The foundational work on continual learning, 1980 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

72 papers of 8,653 · showing 1–50Sort Recent · Most cited
  1. 2024PDF ↗
  2. 2024
    A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning TasksErik B. Terres-Escudero, Javier Del Ser, Pablo G. BringasCoLLAs
    PDF ↗
  3. 2024
    Learning to Learn without Forgetting using AttentionAnna Vettoruzzo, Joaquin Vanschoren, Mohamed-Rafik Bouguelia, Thorsteinn RögnvaldssonCoLLAs
    PDF ↗
  4. 2024
    Diffusion Augmented Agents: A Framework for Efficient Exploration and Transfer LearningNorman Di Palo, Leonard Hasenclever, Jan Humplik, Arunkumar ByravanCoLLAs
    PDF ↗
  5. 2024
    Local vs Global continual learningGiulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas HofmannCoLLAs
    PDF ↗
  6. 2024
    Decoupled Prompt-Adapter Tuning for Continual Activity RecognitionDi Fu, T. Vo, Haozhe Ma, Tze-Yun LeongCoLLAs
    PDF ↗
  7. 2024
    Reflecting on the State of Rehearsal-free Continual Learning with Pretrained ModelsLukas Thede, Karsten Roth, Olivier J. Hénaff … Zeynep AkataCoLLAs
    PDF ↗
  8. 2024PDF ↗
  9. 2024
    Statistical Context Detection for Deep Lifelong Reinforcement LearningJeffery Dick, Saptarshi Nath, Christos Peridis … Andrea SoltoggioCoLLAs
    PDF ↗
  10. 2024
    An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank UpdatesAlbin Soutif--Cormerais, Simone Magistri, Joost van de Weijer, Andew D. BagdanovCoLLAs
    PDF ↗
  11. 2024
    Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental LearningPrashant Bhat, Bharath Renjith, Elahe Arani, Bahram ZonoozCoLLAs
    PDF ↗
  12. 2024PDF ↗
  13. 2024PDF ↗
  14. 2024
    Integrating Present and Past in Unsupervised Continual LearningYipeng Zhang, Laurent Charlin, Richard S. Zemel, Mengye RenCoLLAs
    PDF ↗
  15. 2024
    Disentangling the Causes of Plasticity Loss in Neural NetworksClare Lyle, Zeyu Zheng, Khimya Khetarpal … Will DabneyCoLLAs
    PDF ↗
  16. 2024PDF ↗
  17. 2024
  18. 2024
    Memory Head for Pre-Trained Backbones in Continual LearningMatteo Tiezzi, F. Becattini, Simone Marullo, S. MelacciCoLLAs
  19. 2024
    Continual Learning for Unsupervised Concept Bottleneck DiscoveryLuca Salvatore Lorello, Marco Lippi, S. MelacciCoLLAs
  20. 2024
    Replaying with Realistic Latent Vectors in Generative Continual LearningHyemin Jeong, Seong-Woong Kim, Dong-Wan ChoiCoLLAs
  21. 2023
    Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from GeneralizationSebastian Dziadzio, Çağatay Yıldız, Gido M. van de Ven … Matthias BethgeCoLLAs
    PDF ↗
  22. 2023
    Continual Learning of Diffusion Models with Generative DistillationSergi Masip, Pau Rodríguez, Tinne Tuytelaars, Gido M. van de VenCoLLAs
    PDF ↗
  23. 2023
    From Categories to Classifiers: Name-Only Continual Learning by Exploring the WebAmeya Prabhu, Hasan Abed Al Kader Hammoud, Ser-Nam Lim … Adel BibiCoLLAs
    PDF ↗
  24. 2023
    Keep moving: identifying task-relevant subspaces to maximise plasticity for newly learned tasksDaniel Anthes, Sushrut Thorat, Peter König, Tim C. KietzmannCoLLAs
    PDF ↗
  25. 2023PDF ↗
  26. 2023
    GRASP: A Rehearsal Policy for Efficient Online Continual LearningMd Yousuf Harun, Jhair Gallardo, Chen, Junyu, Kanan, ChristopherCoLLAs
    PDF ↗
  27. 2023
    Maintaining Plasticity in Continual Learning via Regenerative RegularizationSaurabh Kumar, Henrik Marklund, Benjamin Van RoyCoLLAs
    PDF ↗
  28. 2023
    Improving Performance in Continual Learning Tasks using Bio-Inspired ArchitecturesSandeep Madireddy, Ángel Yanguas-Gil, Prasanna BalaprakashCoLLAs
    PDF ↗
  29. 2023
    Measuring and Mitigating Interference in Reinforcement LearningVincent Liu, Wang, Han, Tao, Ruo Yu … White, MarthaCoLLAs · University of Alberta
    PDF ↗
  30. 2023
    Improving Online Continual Learning Performance and Stability with Temporal EnsemblesAlbin Soutif--Cormerais, Antonio Carta, Joost van de WeijerCoLLAs
    PDF ↗
  31. 2023
    Partial Hypernetworks for Continual LearningHamed Hemati, Vincenzo Lomonaco, Davide Bacciu, Damian BorthCoLLAs
    PDF ↗
  32. 2023
    Masked Autoencoders are Efficient Continual Federated LearnersSubarnaduti Paul, Lars-Joel Frey, Roshni Kamath … Martin MundtCoLLAs
    PDF ↗
  33. 2023
    RaSP: Relation-aware Semantic Prior for Weakly Supervised Incremental SegmentationSubhankar Roy, Riccardo Volpi, Gabriela Csurka, Diane LarlusCoLLAs · Télécom Paris
    PDF ↗
  34. 2023
    Sharing Lifelong Reinforcement Learning Knowledge via Modulating MasksSaptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu … Andrea SoltoggioCoLLAs
    PDF ↗
  35. 2023PDF ↗
  36. 2023
    I2I: Initializing Adapters with Improvised KnowledgeTejas Srinivasan, Furong Jia, Mohammad Rostami, Jesse ThomasonCoLLAs
    PDF ↗
  37. 2023
    Fixed Design Analysis of Regularization-Based Continual LearningHaoran Li, Jingfeng Wu, Vladimir BravermanCoLLAs
    PDF ↗
  38. 2023
    Replay Buffer with Local Forgetting for Adapting to Local Environment Changes in Deep Model-Based Reinforcement LearningAli Rahimi-Kalahroudi, Janarthanan Rajendran, Ida Momennejad … Sarath ChandarCoLLAs
    PDF ↗
  39. 2023
    Loss of Plasticity in Continual Deep Reinforcement LearningZaheer Abbas, Rosie Zhao, Joseph Modayil … Marlos C. MachadoCoLLAs
    PDF ↗
  40. 2023PDF ↗
  41. 2023
    Class-Incremental Learning with RepetitionHamed Hemati, Andrea Cossu, Antonio Carta … Damian BorthCoLLAs
    PDF ↗
  42. 2023
    Continually learning representations at scaleAlexandre Galashov, Jovana Mitrovic, Dhruva Tirumala … Razvan PascanuCoLLAs
  43. 2023
  44. 2023
  45. 2021
    Self-Activating Neural Ensembles for Continual Reinforcement LearningSam Powers, Xing, Eliot, Gupta, AbhinavCoLLAs · Carnegie Mellon University · Meta (Israel)
    PDF ↗
  46. 2022
    The Effectiveness of World Models for Continual Reinforcement LearningSamuel Kessler, Ostaszewski, Mateusz, Bortkiewicz, Michał … Miłoś, PiotrCoLLAs
    PDF ↗
  47. 2022
    PlaStIL: Plastic and Stable Exemplar-Free Class-Incremental LearningGrégoire Petit, Adrian Popescu, Eden Belouadah … Bertrand DelezoideCoLLAs
    PDF ↗
  48. 2022PDF ↗
  49. 2022
    A Theory for Knowledge Transfer in Continual LearningDiana Benavides‐Prado, Patricia RiddleCoLLAs
    PDF ↗
  50. 2022
    Model-Free Generative Replay for Lifelong Reinforcement Learning: Application to Starcraft-2Zachary Daniels, Aswin Raghavan, Jesse Hostetler … Ajay DivakaranCoLLAs
    PDF ↗
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.