Author of the publication

The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon

, , , , , and . (2022)cite arxiv:2206.04817Comment: Removed Tex formatting commands in title Title and Abstract.

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

On the Convex Behavior of Deep Neural Networks in Relation to the Layers' Width., and . CoRR, (2020)Complexity of multiverse networks and their multilayer generalization., and . ICPR, page 372-377. IEEE, (2016)Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit., and . CoRR, (2023)What Algorithms can Transformers Learn? A Study in Length Generalization., , , , , , , and . CoRR, (2023)Adaptivity and Modularity for Efficient Generalization Over Task Complexity., , , , , , , , , and 1 other author(s). CoRR, (2023)Vanishing Gradients in Reinforcement Finetuning of Language Models., , , , , , , and . CoRR, (2023)Collegial Ensembles., , , , and . CoRR, (2020)The Multiverse Loss for Robust Transfer Learning., and . CoRR, (2015)Stabilizing Transformer Training by Preventing Attention Entropy Collapse., , , , , , , and . ICML, volume 202 of Proceedings of Machine Learning Research, page 40770-40803. PMLR, (2023)Spherical embedding of inlier silhouette dissimilarities., , and . CVPR, page 3855-3863. IEEE Computer Society, (2015)