Top 2 website-crawler open source projects

It allows you to download a website from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer.

sponge is a website crawler and links downloader command-line tool