Merge requests · Administrator / metaseq

check model parallel ranks have consistent data

!566 · created Dec 24, 2022 by Administrator bigbig cla signed
- MERGED
- 3
updated Jan 04, 2023
Adding flash attention for sequence parallel 0 of 4 checklist items completed

!565 · created Dec 23, 2022 by Administrator cla signed
- 4
updated Jan 18, 2023
Updated paper

!564 · created Dec 22, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 27, 2022
Update paper link in OPTIML Readme

!563 · created Dec 22, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 22, 2022
OPTIML landing page

!562 · created Dec 22, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 22, 2022
Pin numpy version to prevent further upgrade problems

!561 · created Dec 22, 2022 by Administrator cla signed
- 4
updated Dec 27, 2022
add sample fetch time logging

!559 · created Dec 21, 2022 by Administrator bigbig cla signed
- MERGED
- 3
updated Jan 04, 2023
Add Sharan to CODEOWNERS

!558 · created Dec 21, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 30, 2022
Fix config.yml dump in training runs.

!557 · created Dec 21, 2022 by Administrator cla signed
- MERGED
- 3
updated Dec 30, 2022
Add a new script to reshard model parallel parts

!556 · created Dec 21, 2022 by Administrator cla signed
- MERGED
- 8
updated Dec 28, 2022
Add optional type conversion to FSDP resharding script

!555 · created Dec 21, 2022 by Administrator cla signed
- 3
updated Jan 19, 2023
Fix an issue with distributed utils to enable launching jobs with tor…

!554 · created Dec 19, 2022 by Administrator cla signed
- MERGED
- 4
updated Dec 19, 2022
Bigbig update

!553 · created Dec 19, 2022 by Administrator bigbig cla signed
- MERGED
- 2
updated Dec 19, 2022
Updates from latest runs

!551 · created Dec 12, 2022 by Administrator bigbig cla signed
- MERGED
- 6
updated Dec 12, 2022
Automatically evaluate checkpoints after copying to NFS

!550 · created Dec 12, 2022 by Administrator cla signed
- MERGED
- 29
updated Dec 14, 2022
add log_training_trajectory option

!549 · created Dec 11, 2022 by Administrator opt_instruct cla signed
- 2
updated Dec 12, 2022
release intermediate checkpoints

!548 · created Dec 09, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 09, 2022
Scale LR instead

!547 · created Dec 07, 2022 by Administrator susan/scale_grads cla signed
- MERGED
- 4
updated Dec 07, 2022
Compute ratio to existing ewm

!546 · created Dec 06, 2022 by Administrator susan/scale_grads cla signed
- MERGED
- 2
updated Dec 06, 2022
Fix test checkpoint saving pt2 0 of 4 checklist items completed

!545 · created Dec 05, 2022 by Administrator cla signed
- MERGED
- 2
updated Dec 12, 2022