Related work

The foundational work on continual learning, 1959 to 2026: methods, theory, benchmarks, surveys, and the neuroscience of memory. Updated weekly; some carry our notes.

24 papers of 11,817Sort Recent · Most cited
  1. 2022
    CODA-Prompt: COntinual Decomposed Attention-Based Prompting for Rehearsal-Free Continual LearningJames Seale Smith, Leonid Karlinsky, Vyshnavi Gutta … Zsolt KiraCVPR · Georgia Institute of Technology · IBM (United States) · +1
    PDF ↗
  2. 2022
    A Closer Look at Rehearsal-Free Continual Learning *James Seale Smith, Junjiao Tian, Shaunak Halbe … Zsolt KiraCVPR · Georgia Institute of Technology · Samsung (United States) · +1
    PDF ↗
  3. 2022
    System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy GamesIndranil Sur, Zachary Daniels, Abrar Rahman … Aswin RaghavanInternational Conference on AI-ML-Systems · SRI International · American University · +3
    PDF ↗
  4. 2021
    The Surprising Positive Knowledge Transfer in Continual 3D Object Shape ReconstructionAnh Thai, Stefan Stojanov, Zixuan Huang, James M. RehgInternational Conference on 3D Vision (3DV) · Georgia Institute of Technology
    PDF ↗
  5. 2022
    Incremental Learning with Differentiable Architecture and Forgetting SearchJames Seale Smith, Zachary Seymour, Han-Pang ChiuIJCNN · Georgia Institute of Technology · SRI International
    PDF ↗
  6. 2022
    Biological underpinnings for lifelong learning machinesDhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb … Hava T. SiegelmannNature Machine Intelligence · The University of Texas at San Antonio · Intelligent Systems Research (United States) · +24
  7. 2022
    TA-SBERT : Token Attention Sentence-BERT for Improving Sentence RepresentationJaejin Seo, Sangwon Lee, Ling Liu, Wonik ChoiIEEE Access · Inha University · Georgia Institute of Technology
  8. 2021
    Provable Lifelong Learning of RepresentationsXinyuan Cao, Weiyang Liu, Santosh VempalaAISTATS · Georgia Institute of Technology · University of Cambridge
    PDF ↗
  9. 2021
    Always Be Dreaming: A New Approach for Data-Free Class-Incremental LearningJames Smith, Yen-Chang Hsu, Jonathan Balloch … Zsolt KiraICCV · Georgia Institute of Technology · Samsung (United States) · +1
    PDF ↗
  10. 2019
    Unsupervised Progressive Learning and the STAM ArchitectureJames Smith, Cameron Taylor, Seth Baer, Constantine DovrolisIJCAI · Georgia Institute of Technology
    PDF ↗
  11. 2021
    Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay BufferJames Smith, Jonathan Balloch, Yen-Chang Hsu, Zsolt KiraIJCNN · Georgia Institute of Technology · Samsung (United States)
    PDF ↗
  12. 2021
    Unsupervised Class-Incremental Learning Through ConfusionShivam Khare, Kun Cao, James M. RehgarXiv · Georgia Institute of Technology
    PDF ↗
  13. 2021
    Continual Learning of Knowledge Graph EmbeddingsAngel Daruna, Mehul Gupta, Mohan Sridharan, Sonia ChernovaRA-L · Georgia Institute of Technology · University of Birmingham
    PDF ↗
  14. 2021
    AILC: Accelerate On-Chip Incremental Learning With Compute-in-Memory TechnologyYandong Luo, Shimeng YuIEEE Transactions · Georgia Institute of Technology
  15. 2021
    Continual Learning for Text Classification with Information Disentanglement Based RegularizationYufan Huang, Yanzhe Zhang, Jiaao Chen … Diyi YangNAACL · Georgia Institute of Technology · Google (United States) · +1
    PDF ↗
  16. 2021
    Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingBinzong Geng, Fajie Yuan, Qiancheng Xu … Min YangACL · University of Science and Technology of China · Chinese Academy of Sciences · +7
    PDF ↗
  17. 2021
    Principal Gradient Direction and Confidence Reservoir Sampling for Continual LearningZhiyi Chen, Tong LinSpringer LNCS · Georgia Institute of Technology · Peking University · +1
    PDF ↗
  18. 2020
    Learning to Incentivize Other Learning AgentsJiachen Yang, Ang Li, Mehrdad Farajtabar … Hongyuan ZhaNeurIPS · Georgia Institute of Technology · Google (United States)
    PDF ↗
  19. 2020
    Efficient and Robust Syslog Parsing for Network Devices in Datacenter NetworksShenglin Zhang, Ying Liu, Weibin Meng … Ming ZhangIEEE Access · Nankai University · Baidu (China) · +5
  20. 2019
    Inverse Design of Transmission Lines with Deep LearningKallol Roy, Majid Ahadi Dolatsara, Hakki Mert Torun … Madhavan SwaminathanIEEE 28th Conference on Electrical Performance of Electro… · Georgia Institute of Technology · Politecnico di Torino
  21. 2019
    Incremental Object Learning From Contiguous ViewsStefan Stojanov, Samarth Mishra, Ngoc Anh Thai … James M. RehgCVPR · Georgia Institute of Technology · Indiana University Bloomington
  22. 2019
    Leveraging Semantics for Incremental Learning in Multi-Relational EmbeddingsAngel Daruna, Weiyu Liu, Zsolt Kira, Sonia ChernovaarXiv · Georgia Institute of Technology
    PDF ↗
  23. 2018
    Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong BaselinesYen-Chang Hsu, Yen‐Cheng Liu, Ramasamy, Anita, Kira, ZsoltarXiv · Georgia Institute of Technology
    PDF ↗
  24. 2015
    Minimizing Human Effort in Interactive Tracking by Incremental Learning of Model ParametersArridhana Ciptadi, James M. RehgICCV · Georgia Institute of Technology
About this index

We keep this list because we read the field and wanted one place to see it. It covers work on continual learning itself, in the core areas of machine learning, and leaves out papers that apply it inside another field, such as medical imaging or fault diagnosis. It is seeded from the community lists kept by ContinualAI and by Xialei Liu, then filled out from OpenAlex, and every week a script looks for new papers on OpenAlex and arXiv. A model reads each candidate and decides whether it belongs; a person reviews the additions before they go live. Authors and affiliations come from OpenAlex, so a recent preprint can lack its institutions for a week or two.

Missing something, or filed under the wrong venue? Write to hello@unify.ai with the arXiv id or DOI.