wget

Download files from the Web. Supports HTTP, HTTPS, and FTP. More information: https://www.gnu.org/software/wget.

  • Download the contents of a URL to a file (named "foo" in this case):

wget https://example.com/foo

  • Download the contents of a URL to a file (named "bar" in this case):

wget --output-document bar https://example.com/foo

  • Download a single web page and all its resources with 3-second intervals between requests (scripts, stylesheets, images, etc.):

wget --page-requisites --convert-links --wait=3 https://example.com/somepage.html

  • Download all listed files within a directory and its sub-directories (does not download embedded page elements):

wget --mirror --no-parent https://example.com/somepath/

  • Limit the download speed and the number of connection retries:

wget --limit-rate=300k --tries=100 https://example.com/somepath/

  • Download a file from an HTTP server using Basic Auth (also works for FTP):

wget --user=username --password=password https://example.com

  • Continue an incomplete download:

wget --continue https://example.com

  • Download all URLs stored in a text file to a specific directory:

wget --directory-prefix path/to/directory --input-file URLs.txt