PNAS · 2021 · Journal article

The inverse variance–flatness relation in stochastic gradient descent is critical for finding flat minima

Published in: Proceedings of the National Academy of Sciences
Date: 2021-02-22
Citations: 89

Cite

@article{feng2021inverse,
  title = {The inverse variance–flatness relation in stochastic gradient descent is critical for finding flat minima},
  author = {Yu Feng and Yuhai Tu},
  year = {2021},
  journal = {Proceedings of the National Academy of Sciences},
  doi = {10.1073/pnas.2015617118},
  url = {https://doi.org/10.1073/pnas.2015617118},
}