SHEARED LLAMA: ACCELERATING LANGUAGE MODEL PRE-TRAINING VIA STRUCTURED PRUNING

Mengzhou Xia, Tianyu Gao, Zhiyuan Zeng, Danqi Chen

Research output: Contribution to conferencePaperpeer-review

19 Scopus citations

Fingerprint

Dive into the research topics of 'SHEARED LLAMA: ACCELERATING LANGUAGE MODEL PRE-TRAINING VIA STRUCTURED PRUNING'. Together they form a unique fingerprint.

Computer Science

Biochemistry, Genetics and Molecular Biology

Material Science

Keyphrases