arXiv · 2024 · Preprint

Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective

Xueying Bai, Yifan Sun, Niranjan Balasubramanian

Rendered by arXiv from the LaTeX source. If anything looks wrong, switch to the PDF.HTML · PDF · Open in a new tab ↗ · Close
Date
2024-10-08
Citations
2
arXiv
2410.05648
Cite
@misc{bai2024does,
  title = {Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective},
  author = {Xueying Bai and Yifan Sun and Niranjan Balasubramanian},
  year = {2024},
  eprint = {2410.05648},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2410.05648},
}