Toggle navigation
JUPYTER
FAQ
View on GitHub
Execute on Binder
v2.0.0a2
branch
bug_fix_fused_kernel_layer
chore/typo-optimizers
contributors
cpu_adagrad
data-binarization
deal-with-head
expert_parallel
expert_parllel
feat/fused_optimizers
fix_aib_fusion
fix_data_collator
fix/lazy
fix/rank-transpose
fix_softmax_api
fix-tp2d
fix-tp2d-gather
fix-tp3d
fix-tp-2p5d
fix-tp-2p5d-deparallelize
fused_layer_norm
gpt2
hot-fix-typo
hotfix_multinode
kernel_fusion_rms_norm_layer
lazy
lm-head-mapper
mapping
master
modeling_gpt2
modeling
tag
v2.0.2
v2.0.1
v2.0.0
v2.0.0a2
v2.0.0a1
v2.0.0a0
v.1.1.2
v1.1
v1.0.1
v1.0
oslo
docs
_sources
tutorials
Name
..
activation_checkpointing.md.txt
dataset.md.txt
model_parallelism.md.txt
tensor_model_data_parallelism.md.txt
tensor_model_parallelism.md.txt
tensor_model_zero_data_parallelism.md.txt