Skip to content
GitLab

Reshard Model Parallel Script

Merged Administrator requested to merge reshard_model_parallel_script into main

Created by: klshuster

Patch Description Script for resharding a consolidated checkpoint into arbitrary model (tensor) parallel shards.

cc @ngoyal2707 who wrote it 😄