What's the best crawler-like software that could download what I tell it to from a website?
I don't know if it works on windows, or using safari on a windows, but on my mac using safari i can download any file placed on a website (such as flashfiles, vids or pics).
But not 100% sure about what you're asking for.
if you use bash, just use wget.
if you don't use bash, you should probably use bash
Not sure what you're wanting to download, but for vids outside of youtube I use the Firefox addon Download Helper.
https://addons.mozilla.org/en-US/fir...ownloadhelper/
When the 3 balls are doing their animation click the drop down menu and click download