Author of the publication

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

S. Smith, M. Patwary, B. Norick, P. LeGresley, S. Rajbhandari, J. Casper, Z. Liu, S. Prabhumoye, G. Zerveas, V. Korthikanti, E. Zheng, R. Child, R. Aminabadi, J. Bernauer, X. Song, M. Shoeybi, Y. He, M. Houston, S. Tiwary, and B. Catanzaro. CoRR, (2022)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

David Smith

Veronica Smith

George Smith

Annette Smith

Nicholas Smith

Other publications of authors with the same name

Scalable Label Propagation for Multi-Relational Learning on the Tensor Product of Graphs.Z. Li, R. Petegrosso, S. Smith, D. Sterling, G. Karypis, and R. Kuang. IEEE Trans. Knowl. Data Eng., 34 (12): 5964-5978 (2022)Truss decomposition on shared-memory parallel systems.S. Smith, X. Liu, N. Ahmed, A. Tom, F. Petrini, and G. Karypis. HPEC, page 1-6. IEEE, (2017)Tensaurus: A Versatile Accelerator for Mixed Sparse-Dense Tensor Computations.N. Srivastava, H. Jin, S. Smith, H. Rong, D. Albonesi, and Z. Zhang. HPCA, page 689-702. IEEE, (2020)Blocking Optimization Techniques for Sparse Tensor Computation.J. Choi, X. Liu, S. Smith, and T. Simon. IPDPS, page 568-577. IEEE Computer Society, (2018)Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.S. Smith, M. Patwary, B. Norick, P. LeGresley, S. Rajbhandari, J. Casper, Z. Liu, S. Prabhumoye, G. Zerveas, V. Korthikanti and 10 other author(s). CoRR, (2022)Memory-efficient parallel computation of tensor and matrix products for big tensor decomposition.N. Ravindran, N. Sidiropoulos, S. Smith, and G. Karypis. ACSSC, page 581-585. IEEE, (2014)Constrained Tensor Factorization with Accelerated AO-ADMM.S. Smith, A. Beri, and G. Karypis. ICPP, page 111-120. IEEE Computer Society, (2017)A Medium-Grained Algorithm for Sparse Tensor Factorization.S. Smith, and G. Karypis. IPDPS, page 902-911. IEEE Computer Society, (2016)Weighted-Sequence Problem: ASP vs CASP and Declarative vs Problem-Oriented Solving.Y. Lierler, S. Smith, M. Truszczynski, and A. Westlund. PADL, volume 7149 of Lecture Notes in Computer Science, page 63-77. Springer, (2012)High Performance Streaming Tensor Decomposition.Y. Soh, P. Flick, X. Liu, S. Smith, F. Checconi, F. Petrini, and J. Choi. IPDPS, page 683-692. IEEE, (2021)

BibSonomy

Disambiguation of "Smith, Shaden"

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Please choose a person to relate this publication to

David Smith

Veronica Smith

George Smith

Annette Smith

Nicholas Smith

Other publications of authors with the same name

Disambiguation

BibSonomy

Disambiguation of "Smith, Shaden"

copydeleteadd this publication to your clipboardcommunity posthistory of this postURLDOIBibTeXEndNoteAPAChicagoDIN 1505HarvardMSOffice XML Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Please choose a person to relate this publication to

David Smith

Veronica Smith

George Smith

Annette Smith

Nicholas Smith

Other publications of authors with the same name

Disambiguation

copy delete add this publication to your clipboard
community post
history of this post
URL
DOI
BibTeX
EndNote
APA
Chicago
DIN 1505
Harvard
MSOffice XML

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.