175B download script downloads with api key appended to filename
Created by: tsor13
🐛 Bug
When you run the download_opt17b.sh
script to download the weights, it currently downloads as "checkpoint_last-model-part--shard.pt?&Policy=<policy_key>" instead of just "checkpoint_last-model-part--shard.pt".
To Reproduce
Steps to reproduce the behavior (always include the command you ran):
- Run cmd 'bash metaseq/scripts/download_opt175b.sh "<presigned_url_given_in_email>"'
- Run cmd
ls *pt*
Code sample
I believe this is an easy fix, just change wget "${presigned_url/$str_to_replace/$filename}"
to wget -O "$filename" "${presigned_url/$str_to_replace/$filename}"
Expected behavior
I would expect it to save it in the form of ....pt
files.
Environment
- fairseq Version (e.g., 1.0 or master): master
- PyTorch Version (e.g., 1.0)
- OS (e.g., Linux): Ubuntu
- How you installed fairseq (
pip
, source): source - Build command you used (if compiling from source):
- Python version:
- CUDA/cuDNN version:
- GPU models and configuration:
- Any other relevant information:
- wget version: 1.20.3-1ubuntu1