wget -o path/to/log.txt enables logging output to the specified directory instead of displaying the log-in standard output.You can also consider the following flags as a partial way to control the output you receive when using wget. Wget can do more than control the download process, as you can also create logs for future reference. wget -t 10 will try to download the resource up to 10 times before failing.wget -c/ wget -continue will continue downloads of partially downloaded files.wget -nc/ wget -no-clobber will not overwrite files that already exist in the destination.This input file must be in HTML format, or you’ll need to use the -force-html flag to parse the HTML. wget -i file specifies target URLs from an input file.This would skip all files with the PNG extension. The asterisk (*) is a wildcard, such as “*.png”. In this case, it will exclude all the index files. wget -R index.html/ wget -reject index.html will skip any files matching the specified file name.For example, -nH -cut-dirs=1 would change the specified path of “/pub/xemacs/” into simply “/xemacs/” and reduce the number of empty parent directories in the local download. wget -cut-dirs=# skips the specified number of directories down the URL before starting to download files.For example, wget would skip the folder in the previous example and start with the History directory instead. In other words, it skips over the primary domain name. wget -nH removes the “hostname” directories.wget -X /absolute/path/to/directory will exclude a specific directory on the remote server.
There are many flags to help you set up the download process. Let’s take a look at two areas in our focus on controlling the download process and creating logs. This is great if you have specific requirements for your download. You’ll find that wget is a flexible tool, as it uses a number of other additional flags. In general, it’s a good idea to disable robots.txt to prevent abridged downloads. This ignores restrictions in the robots.txt file.
0 kommentar(er)
