Site Sucking Software?
| Author | Topic: Site Sucking Software? |
|---|---|
|
Shock Trooper
Member # 3719
|
written Friday, May 21 2004 18:45
Profile
Homepage
Why doesn't someone get a site sucking application, and get all of the forums in one place? I'm not sure how big they are, but surely a reasonably sized HD could handle it all... -------------------- Scandalous Stories, fishing,and great photos Posts: 294 | Registered: Monday, November 24 2003 08:00 |
|
Agent
Member # 2210
|
written Saturday, May 22 2004 01:24
Profile
I'm not sure that Spiderweb would like to have their site ripped... You might want to ask first... http://www.httpweazel.com/downloads.htm -------------------- Wasting your time and mine looking for a good laugh. Star Bright, Star Light, Oh I Wish I May, I Wish Might, Wish For One Star Tonight. Posts: 1084 | Registered: Thursday, November 7 2002 08:00 |
|
Shock Trooper
Member # 3719
|
written Saturday, May 22 2004 05:21
Profile
Homepage
I'm not going to do it, and what's the difference from 10 people downloading the topics anyway? I figured it would just save some folks some time :) -------------------- Scandalous Stories, fishing,and great photos Posts: 294 | Registered: Monday, November 24 2003 08:00 |
|
Skip to My Lou
Member # 40
|
written Saturday, May 22 2004 07:04
Profile
Homepage
Wouldn't choosing the option "save this page for offline viewing" done down one hyperlink save the entire board? (except polls) I will do a small test. -------------------- Take the Personality Test! INTJ 100% 75% 100% 44% Huzzah for the Masterminds! www.Keirsey.com for personality information. The Sloganizer! "Swing your Archmage Alex." Deep down, you wish you were a stick figure. Posts: 1629 | Registered: Wednesday, October 3 2001 07:00 |
|
Lifecrafter
Member # 3608
|
written Saturday, May 22 2004 07:09
Profile
Homepage
If that works as it logically should.. Meh, it'd be a lot easier. *waits for Alex to return from his research* -------------------- The Great Mister kommari@gmail.com[/url] Posts: 972 | Registered: Tuesday, October 28 2003 08:00 |
|
Agent
Member # 618
|
written Saturday, May 22 2004 07:15
Profile
Homepage
I would have EXTREMELY strong doubts about that working. It's possible if he's using a different browser, but still very unlikely to work. -------------------- Aut Tace Aut Loquere Meliora Silencio Posts: 1487 | Registered: Sunday, February 10 2002 08:00 |
|
Skip to My Lou
Member # 40
|
written Saturday, May 22 2004 07:21
Profile
Homepage
I tried quiting part way through to test, but appearantly that was not enough time to let it get down to the actual topics. Although, it did save through the links at the top of the page which I know I would not have had a copy of on my computer. So, while I think it will work, it is going to take some time. I will now attempt to download the whole board. This may take quite a while. EDIT!!! It's working! While it is downloading it displays the web address of what it is downloading. In comparing it to the web address of a multipage topic, it is now in the process of downloading each page of each topic. I can't test it till it's done, so we can't be entirely sure it will work yet, but it seems to be working. [ Saturday, May 22, 2004 07:36: Message edited by: Archmage Alex ] -------------------- Take the Personality Test! INTJ 100% 75% 100% 44% Huzzah for the Masterminds! www.Keirsey.com for personality information. The Sloganizer! "Swing your Archmage Alex." Deep down, you wish you were a stick figure. Posts: 1629 | Registered: Wednesday, October 3 2001 07:00 |
|
Agent
Member # 618
|
written Saturday, May 22 2004 07:29
Profile
Homepage
Hmmm... intriguing... what browser are you using? The whole board is going to take a LONG time unless you have a damn good modem! Broadband (or an equivilent) would be best. -------------------- Aut Tace Aut Loquere Meliora Silencio Posts: 1487 | Registered: Sunday, February 10 2002 08:00 |
|
Infiltrator
Member # 1877
|
written Saturday, May 22 2004 07:39
Profile
If that work, im gona get a tiny bit mad. -------------------- 33111-CRUSADER-4849 Posts: 662 | Registered: Friday, September 13 2002 07:00 |
|
Skip to My Lou
Member # 40
|
written Saturday, May 22 2004 07:41
Profile
Homepage
I am using internet explorer and have 56k dial-up. So it IS going to take a long time. However, it is (at this particular moment) downloading http://www.ironycentral.com/cgi-bin/ubb/ubb/ultimatebb.php?ubb=get_topic;f=1;t=00144 7;p=11 whatever that is. edit: apparantly it is only 8 topics down the first page. Some one with high-speed internet try it too. go Favorites > add to favorites > (check the make available offline box) Customize > )make sure is says make 1 link deep) > hit ok and let it begin downloading. [ Saturday, May 22, 2004 07:46: Message edited by: Archmage Alex ] -------------------- Take the Personality Test! INTJ 100% 75% 100% 44% Huzzah for the Masterminds! www.Keirsey.com for personality information. The Sloganizer! "Swing your Archmage Alex." Deep down, you wish you were a stick figure. Posts: 1629 | Registered: Wednesday, October 3 2001 07:00 |
|
Post Navel Trauma ^_^
Member # 67
|
written Saturday, May 22 2004 07:57
Profile
Homepage
The danger with this is that IE doesn't, as far as I know, store web archives in a form that can be read by anything else. wget is your friend. -------------------- Barcoorah: I even did it to a big dorset ram. desperance.net - Don't follow this link Posts: 1798 | Registered: Thursday, October 4 2001 07:00 |
|
Infiltrator
Member # 1877
|
written Saturday, May 22 2004 08:04
Profile
I have broadband 1 megabit conection, ill try the same... -------------------- 33111-CRUSADER-4849 Posts: 662 | Registered: Friday, September 13 2002 07:00 |
|
Skip to My Lou
Member # 40
|
written Saturday, May 22 2004 08:05
Profile
Homepage
Meh, It did not work very well. Edit! wait! I figured out what went wrong! It saved all the threads on the first page (I checked by going offline and looking at threads I KNOW I hadn't looked at before.) but none of the other pages. This is because I had it only go 1 link deep, which means it did not go to the other pages and make copies. because it only travel 1 link, not 2. Because of the way ubb labels the pages (1,2,3 ... 35,36,37 instead of 1,2,3,4,5,6,7,8,9,10,11,12,13,14,etc.) the pages still need to be done 1 page at time, just not manually. double edit: by the way, just saving the first page that way was nearly 10 MB. [ Saturday, May 22, 2004 08:14: Message edited by: Archmage Alex ] -------------------- Take the Personality Test! INTJ 100% 75% 100% 44% Huzzah for the Masterminds! www.Keirsey.com for personality information. The Sloganizer! "Swing your Archmage Alex." Deep down, you wish you were a stick figure. Posts: 1629 | Registered: Wednesday, October 3 2001 07:00 |
|
Agent
Member # 618
|
written Saturday, May 22 2004 10:57
Profile
Homepage
The subsequent pages should be less - the first General page has several BIG topics that were revived by lazy people who couldn't be bothered to copy them. :) :eek: Who? Me? Never! :rolleyes: -------------------- Aut Tace Aut Loquere Meliora Silencio Posts: 1487 | Registered: Sunday, February 10 2002 08:00 |
|
Agent
Member # 1104
|
written Saturday, May 22 2004 12:24
Profile
Homepage
quote:Including "bandwidth problems" :P -------------------- Austrian Alex - Reality Corp. Posts: 1307 | Registered: Tuesday, May 7 2002 07:00 |
|
Law Bringer
Member # 2984
|
written Saturday, August 14 2004 12:11
Profile
Homepage
Teehee.... I found a site sucking software that can actually handle this, and I set it to download the general forum. :D The only problem which I just noticed is that the forums are by standard set to display only the topics of the last 5 days... and the others are only accessible by selecting a scroll down menu, which the program cannot do. So it's a bit obsolete given that the purge only affects anything beyond 45 days. :( -------------------- The Encyclopaedia Ermariana <-- Now a Wiki! "Polaris leers down from the black vault, winking hideously like an insane watching eye which strives to convey some strange message, yet recalls nothing save that it once had a message to convey." --- HP Lovecraft. "I single Aran out due to his nasty temperament, and his superior intellect." --- SupaNik Posts: 8752 | Registered: Wednesday, May 14 2003 07:00 |
|
Babelicious
Member # 3149
|
written Saturday, August 14 2004 12:16
Profile
Homepage
*sighs* Sarachim could tell you that I thought of using wget days ago. wget -np -m would do it. You wouldn't have to waste your time doing it bit by bit. -------------------- I've got a pyg in a poke. Posts: 999 | Registered: Friday, June 27 2003 07:00 |
|
Law Bringer
Member # 2984
|
written Saturday, August 14 2004 12:39
Profile
Homepage
I use a program called WinHTTrack. Also, I now found a way to bypass the prune - after all, there is a URL that already includes the prune parameters set to "all threads": http://www.ironycentral.com/cgi-bin/ubb/ultimatebb.cgi?ubb=forum&f=1&DaysPrune=1000&submit=Go Using that as a starting point, I can get all the threads that are still available in General. :eek: -------------------- The Encyclopaedia Ermariana <-- Now a Wiki! "Polaris leers down from the black vault, winking hideously like an insane watching eye which strives to convey some strange message, yet recalls nothing save that it once had a message to convey." --- HP Lovecraft. "I single Aran out due to his nasty temperament, and his superior intellect." --- SupaNik Posts: 8752 | Registered: Wednesday, May 14 2003 07:00 |
|
Master
Member # 4614
|
written Saturday, August 14 2004 12:59
Profile
Homepage
Well, when and if PPP3 happens, a sucking software someone has may be useful, but at the rate this is going, it doesn't look like we'll be able to use one for PPP2. :( -------------------- -ben4808 For those who love to spam: CSM Forums RIFQ Posts: 3360 | Registered: Friday, June 25 2004 07:00 |
|
Agent
Member # 2210
|
written Saturday, August 14 2004 13:36
Profile
Speak of the ..... Here goes. This might be a little more powerful if you are having trouble with sitesucking. http://www.softbytelabs.com/Frames.html?f1=Banner.html&f2=BlackWidow/index.html -------------------- Wasting your time and mine looking for a good laugh. Star Bright, Star Light, Oh I Wish I May, I Wish Might, Wish For One Star Tonight. Posts: 1084 | Registered: Thursday, November 7 2002 08:00 |
|
Babelicious
Member # 3149
|
written Saturday, August 14 2004 13:40
Profile
Homepage
HUAUGUAGH. Alec wants me to wget the forums, so I'm doing it. Choke it down, Chinatown. -------------------- I've got a pyg in a poke. Posts: 999 | Registered: Friday, June 27 2003 07:00 |
|
Law Bringer
Member # 2984
|
written Saturday, August 14 2004 13:58
Profile
Homepage
quote:We don't need to (I don't even know if it works yet). Just a note for the future... Also, I'm terminally paranoid and I just couldn't bear the thought of not having the most important (ie, RP and Discussion) threads saved to my own harddrive. What if the computer of the guy who saved them crashes? Or there was a connection error nobody noticed, and a single page didn't get saved? :P -------------------- The Encyclopaedia Ermariana <-- Now a Wiki! "Polaris leers down from the black vault, winking hideously like an insane watching eye which strives to convey some strange message, yet recalls nothing save that it once had a message to convey." --- HP Lovecraft. "I single Aran out due to his nasty temperament, and his superior intellect." --- SupaNik Posts: 8752 | Registered: Wednesday, May 14 2003 07:00 |
|
Warrior
Member # 4710
|
written Saturday, August 14 2004 15:48
Profile
t Aran: I do agree with you about the chance of a harddrive crash or the like, but at least I keep backups :) . -------------------- Life is short. Use a Mac. Posts: 85 | Registered: Wednesday, July 14 2004 07:00 |