How to download the entire contents of an ASP website?

**AtW** · 7 October 2006, 16:22

SKA v2.0 will do it.

hth

**bogeyman** · 7 October 2006, 17:21

Preferably ASP?

It's ok to do this for static sites, but it makes no sense for dynamic ones. You can never be sure you have captured the 'entire' site.

If it's a dynamic site then you're only going to get a snapshot of whatever URIs you request.

Also, dynamic sites can have an infinite (unknowable) number of pages (e.g. they could be DB-driven) so you don't know how much you're going to get for the 'entire site'.

Never mind. I'm sure Atw's SKA will do the job perfectly

Why do you need to do this anyhway?

**MarillionFan** · 7 October 2006, 18:15

Its an online catalogue of products. About 5000. I took a snapshot last year by doing it manually but it took forever. It's passworded and I am allowed to take the photos but it takes for ever.

I can write something in VB (yes VB) but I was hoping there was some software I could point at a site and it would crawl every link etc.

Come on, it cannot be that difficult!!!!

**hattra** · 7 October 2006, 19:46

MF

have a look on download.com - they have a number of utils on there that might do what you want. I think there was one called freedownloader or something like (and there are probably others) that that you could rip off, er sorry, download complete sites with - whether it does everything you want, I don't know - but possibly worth a look.

HTH

**MarillionFan** · 8 October 2006, 14:16

Before I root around for software, can anyone recommend one?

**AtW** · 8 October 2006, 14:50

MF sounds like your day job is consulting - learn how to make your own decisions ffs!

**MarillionFan** · 8 October 2006, 15:08

"MF sounds like your day job is consulting - learn how to make your own decisions ffs!"

So I take it the fkcuing russian know-it-all doesn't know. So f-ck off ***** and dont respond to posts you know f-ck all about - yet again.

In fact don't respond to any of my posts again. Pr1ck.

**AtW** · 8 October 2006, 16:16

Hit some nerve again, just like with the cold beans?

**TheMonkey** · 8 October 2006, 17:50

GNU wget or curl (google for them)

How to download the entire contents of an ASP website?