Toggle navigation
JUPYTER
FAQ
View on GitHub
Execute on Binder
v0.13.1
branch
AutoPR/0.12.2
AutoPR/0.14.0
AutoPR/0.14.5
CUDA-Graph-support
HeyangQin/deepspeed-ulysses-chinese-blog
HeyangQin/enable_hpz_nograd
HeyangQin/fastgen_moe_h100
HeyangQin/fix_hpz_nograd
HeyangQin/fix_issue_3062
HeyangQin/fix_issue_3068
HeyangQin/fix_issue_3156
HeyangQin/fix_issue_5205
HeyangQin/fix_pr_3462_standalone
HeyangQin/hpz_convergence
HeyangQin/inference_t5_phase1
HeyangQin/mixed_precision_lora_sam
HeyangQin/mixz_tutorial
HeyangQin/skip_bias_quant
HeyangQin/staging-zero-pp-v1
HeyangQin/ucp_blog_chinese
HeyangQin/ulysses_fp8
Megtron-Kernel-Integration
SA_feature_tag
SA_tutorial_update
SA_update_tutorial_link
add-bfp16-support
add-comm-layout
add-inference-comm
add-llama2-support
add-quantizer
tag
v0.16.3
v0.16.2
v0.16.1
v0.16.0
v0.15.4
v0.15.3
v0.15.2
v0.15.1
v0.15.0
v0.14.5
v0.14.4
v0.14.3
v0.14.2
v0.14.1
v0.14.0
v0.13.5
v0.13.4
v0.13.3
v0.13.2
v0.13.1
v0.13.0
v0.12.6
v0.12.5
v0.12.4
v0.12.3
v0.12.2
v0.12.1
v0.12.0
v0.11.2
v0.11.1
DeepSpeed
blogs
deepspeed-fastgen
2024-01-19
assets
images
Name
..
fastgen-hero-dark.png
fastgen-hero-light.png
th_lat_curve_falcon-180B_tp8.png
th_lat_curve_falcon-40b_tp2.png
th_lat_curve_mistralai-Mixtral-8x7B-v0.1_tp4_1.png
th_lat_curve_mistralai-Mixtral-8x7B-v0.1_tp4_2.png
th_lat_curve_phi-2_tp1.png
