ICLR · 2022 · Journal article

Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum

Kirby Banman, Liam Peet-Pare, Nidhi Hegde, Alona Fyshe, Martha White

PDF from arXiv.HTML · PDF · Open in a new tab ↗ · Close
Published in
International Conference on Learning Representations
Date
2022-03-22
Citations
1
arXiv
2203.11992
Cite
@article{banman2022resonance,
  title = {Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum},
  author = {Kirby Banman and Liam Peet-Pare and Nidhi Hegde and Alona Fyshe and Martha White},
  year = {2022},
  journal = {International Conference on Learning Representations},
  eprint = {2203.11992},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2203.11992},
}