Merge requests · Administrator / metaseq

load-checkpoint-on-more-gpus 0 of 4 checklist items completed

!646 · created Feb 10, 2023 by Administrator cla signed
- 0
updated Feb 10, 2023
Cherrypicking pos-init-scalar from main

!629 · created Feb 02, 2023 by Administrator bigbig cla signed
- 0
updated Feb 02, 2023
[WIP] code to continue training on larger number of GPUS

!620 · created Jan 26, 2023 by Administrator bigbig cla signed
- 1
updated Feb 10, 2023
Pulling Igors barrierless init change in

!612 · created Jan 19, 2023 by Administrator bigbig cla signed
- 0
updated Jan 25, 2023
Add test_sequence_parallel 4 of 4 checklist items completed

!605 · created Jan 16, 2023 by Administrator cla signed
- 0
updated Feb 12, 2023
Adding flash attention for sequence parallel 0 of 4 checklist items completed

!565 · created Dec 23, 2022 by Administrator cla signed
- 4
updated Jan 18, 2023
Pin numpy version to prevent further upgrade problems

!561 · created Dec 22, 2022 by Administrator cla signed
- 4
updated Dec 27, 2022
Add optional type conversion to FSDP resharding script

!555 · created Dec 21, 2022 by Administrator cla signed
- 3
updated Jan 19, 2023
add log_training_trajectory option

!549 · created Dec 11, 2022 by Administrator opt_instruct cla signed
- 2
updated Dec 12, 2022
[Cleanup] checkpoint_utils: remove opena pathmanager logic

!519 · created Nov 16, 2022 by Administrator cla signed
- 0
updated Nov 16, 2022
Add a script to benchmark generator

!518 · created Nov 15, 2022 by Administrator cla signed
- 10
updated Jan 06, 2023
Recommit dynamic config 0 of 4 checklist items completed

!512 · created Nov 11, 2022 by Administrator cla signed
- 0
updated Nov 22, 2022
[wip] Adding flash attention for sequence parallel 0 of 6 checklist items completed

!511 · created Nov 11, 2022 by Administrator cla signed
- 1
updated Jan 21, 2023
Unify sweep.py and slurm.py between metaseq and metaseq-internal

!507 · created Nov 11, 2022 by Administrator cla signed
- 5
updated Feb 12, 2023
Include run id in train.log

!503 · created Nov 09, 2022 by Administrator cla signed
- 1
updated Feb 12, 2023
Allow to skip batches during training

!500 · created Nov 08, 2022 by Administrator cla signed
- 5
updated Feb 12, 2023
Speech demo 0 of 4 checklist items completed

!495 · created Nov 07, 2022 by Administrator cm3 cla signed
- 4
updated Dec 15, 2022
Check if NFS dir and files exist before trying to copy

!492 · created Nov 05, 2022 by Administrator cla signed
- 2
updated Jan 16, 2023
Dietgpu checkpoints 0 of 4 checklist items completed

!490 · created Nov 04, 2022 by Administrator cla signed
- 1
updated Dec 02, 2022
Update circleci 0 of 4 checklist items completed

!483 · created Nov 02, 2022 by Administrator cla signed
- 0
updated Nov 02, 2022