Azitech

Azimout's Linux weblog

web crawling

leave a comment »

Web crawling (for personal use only):

  • wget -r <url>
  • httrack <url> -O <path>

Httrack is slightly more intelligent in converting paths etc…

Advertisements

Written by azimout

19/10/2009 at 15:10

Posted in Howto

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: