An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Total stars
2,398
Stars per day
4
Created at
1 year ago
Language
Python
Related Repositories
A robust Python tool for text-based AI training and generation using GPT-2.
Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training
[NeurIPS'21] Projected GANs Converge Faster
Official code for the CVPR 2022 (oral) paper "Extracting Triangular 3D Models, Materials, and Lighting From Images".
This is the implementation of YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
A high performance and generic framework for distributed DNN training
NVIDIA Kaolin Wisp is a PyTorch library powered by NVIDIA Kaolin Core to work with neural fields (including NeRFs, NGLOD, instant-ngp and VQAD).
A robust Python tool for text-based AI training and generation using GPT-2.
Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training
[NeurIPS'21] Projected GANs Converge Faster
Official code for the CVPR 2022 (oral) paper "Extracting Triangular 3D Models, Materials, and Lighting From Images".
This is the implementation of YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
Homepage
Total stars
1,112
Language
Python
Related Repositories
A high performance and generic framework for distributed DNN training
NVIDIA Kaolin Wisp is a PyTorch library powered by NVIDIA Kaolin Core to work with neural fields (including NeRFs, NGLOD, instant-ngp and VQAD).