Merge requests · Administrator / metaseq

added option to disable elementwise affine in layernorm

!318 · created Aug 23, 2022 by Administrator cla signed
- MERGED
- 3
updated Aug 23, 2022
added code to disable bias

!317 · created Aug 23, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 23, 2022
Remove train OOM recovery logic

!314 · created Aug 20, 2022 by Administrator cla signed
- MERGED
- 5
updated Aug 22, 2022
[Cleanup] Remove unused methods in data_utils: 9/N

!257 · created Jul 26, 2022 by Administrator cla signed
- MERGED
- 6
updated Aug 20, 2022
Fix inclusion of valid subset in opt-baseline

!313 · created Aug 20, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 20, 2022
[Cleanup] Delete unused classes / files: 6/N

!253 · created Jul 24, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 20, 2022
[Cleanup] Remove deprecated Trainer.get_meter: 8/N

!256 · created Jul 26, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 20, 2022
[LM] Remove subshards on validation.

!310 · created Aug 20, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 20, 2022
[QOL] Save the training config in the checkpoint dir.

!293 · created Aug 06, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 20, 2022
[QOL] Log the nodelist.

!291 · created Aug 05, 2022 by Administrator cla signed
- MERGED
- 4
updated Aug 20, 2022
[metrics] Stop logging pnorm etc.

!309 · created Aug 20, 2022 by Administrator cla signed
- MERGED
- 3
updated Aug 20, 2022
fix valid subset when benchmarking 3 of 4 checklist items completed

!286 · created Aug 03, 2022 by Administrator cla signed
- MERGED
- 4
updated Aug 20, 2022
[jsonl] Support other tokenizers.

!305 · created Aug 16, 2022 by Administrator cla signed
- MERGED
- 4
updated Aug 20, 2022
continue opt175b download from the latest available file

!289 · created Aug 03, 2022 by Administrator cla signed
- MERGED
- 14
updated Aug 17, 2022
updating API launch instruction, and adding the supporting script 0 of 3 checklist items completed

!153 · created Jun 16, 2022 by Administrator cla signed
- MERGED
- 6
updated Aug 15, 2022
Do not save checkpoint in benchmark mode 0 of 4 checklist items completed

!301 · created Aug 09, 2022 by Administrator cla signed
- MERGED
- 4
updated Aug 10, 2022
[dummy_lm] Make validation size smaller.

!294 · created Aug 06, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 09, 2022
fix for single gpu model interactive hosted

!299 · created Aug 09, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 09, 2022
fix --benchmark option 0 of 4 checklist items completed

!298 · created Aug 09, 2022 by Administrator cla signed
- MERGED
- 5
updated Aug 09, 2022
Fix the batch size for 175b benchmark 0 of 4 checklist items completed

!297 · created Aug 09, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 09, 2022