Friday, December 27, 2019

download - Mass downloading a set of URLs with login




I'm looking a mass-downloader to help me download the entire database from a site I have an account on. The requirements are simple:



  1. Login using my user and password (form-based login)

  2. Download all URLs of the form "http://site.com/ID", where ID is less than 1000.


What should I use?

No comments:

Post a Comment

hard drive - Leaving bad sectors in unformatted partition?

Laptop was acting really weird, and copy and seek times were really slow, so I decided to scan the hard drive surface. I have a couple hundr...