Networking

How to wget download multiple links in the background

Tim Tran

Jan 31, 2023 • 1 min read

First, create a text file (eg links.txt) containing all links you want to download. For example

https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-geo_tags.sql.gz
https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-page_props.sql.gz
https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-page.sql.gz
https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-category.sql.gz
https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-categorylinks.sql.gz
https://dumps.wikimedia.org/enwiki/20210820/enwiki-20210820-site_stats.sql.gz

links.txt

Download all the above in background:

wget -b -i links.txt

To log download progress:

tail wget-log

Sign up for more like this.