Welcome!

By registering with us, you'll be able to discuss, share and private message with other members of our community.

Sign Up Now!

Attempted back-up of FTBL

at the moment, the tool I'm using looks like it maybe an offline back up, so will just need to find somewhere to store it.
 
Muz said:
How big are you talking?
Click to expand...
Will see what happens when the offline backup saves, but so far it's at 1.07GB (which is saying is 2%....)

EDIT: says 13% is 1.2GB so not sure how that works
 
Muz said:
Google gives you 15gb for free.
Click to expand...
Yes that’s the hope, but I think I’ve used a bit of that already.

Basically, I’ve just finally moved into my new place and finally set up my big new desk again, which my computer is hooked up to a TV that must have been draining the power and overheating my PC to turn it off. So I know it got to what was listed as 67% (about 7.5GB) last night, but it had switched itself off by the morning. Have been running it for the past 5 hours (but with TV display off) and the way this scraper works, it has to rescan what I’ve already scraped first before continuing, so I believe it’s about the start doing the final third now as it’s around 7.5GB.

Essentially what it’s doing is scraping everything from the original page (all forums, not just the Football subsection) and creating its own database. The unfortunate thing is it’s saving pages by the thread number, rather than the thread name, so I’m not sure how searchable it will be, but will see how it goes once it’s extracted the whole webpage.

Following that, not sure if the best bet is Google Drive as @Muz mentioned (might set up a different new email address and share with a few people on here to see what can be set up further down the track for it), or if it’s possible at all for @Pasquali to set up a section on here that’s a mirror of the old site to house the archived threads. But - let’s cross that bridge when we get to it. I’m assuming the second option will be a no-go due to possible legal issues with NextMedia and who holds the IP to the old forum threads - and don’t particularly want this website shutdown…
 
Apparently have managed to complete the scraping, is just shy of 11GB - will set up a Google Drive account just for this in the near future.

Not sure how searchable it will be, as the file structure has had the folders named by the thread number, but the webpage within is named after the actual name of the thread.
 
NicCarBel said:
Apparently have managed to complete the scraping, is just shy of 11GB - will set up a Google Drive account just for this in the near future.

Not sure how searchable it will be, as the file structure has had the folders named by the thread number, but the webpage within is named after the actual name of the thread.
Click to expand...
I might actually pop in that Club Logo database in the same Google Drive if it fits, once I'm done.
 
NicCarBel said:
Apparently have managed to complete the scraping, is just shy of 11GB - will set up a Google Drive account just for this in the near future.

Not sure how searchable it will be, as the file structure has had the folders named by the thread number, but the webpage within is named after the actual name of the thread.
Click to expand...
once you figure out how to make it searchable can tell inside sports to turn off the lights :D
 
NicCarBel said:
I might actually pop in that Club Logo database in the same Google Drive if it fits, once I'm done.
Click to expand...

I have over 230 logos from all over South Australia, including amateur and regional clubs, and happy for you to have them with what you've collected (y) Only about 12 MB.

grazorblade said:
once you figure out how to make it searchable can tell inside sports to turn off the lights :D
Click to expand...

Inside Sport have probably lost their own password!
 
HappyGuus said:
I have over 230 logos from all over South Australia, including amateur and regional clubs, and happy for you to have them with what you've collected (y) Only about 12 MB.



Inside Sport have probably lost their own password!
Click to expand...
Have they tried 123456?
 
HappyGuus said:
I have over 230 logos from all over South Australia, including amateur and regional clubs, and happy for you to have them with what you've collected (y) Only about 12 MB.



Inside Sport have probably lost their own password!
Click to expand...
Funnily enough, South Australia is where I’m up to at the moment. Have basically only done the top 3 tiers, and the SAASL Sunday Leagues at the moment.

Have completed all of Western Australia, Northern Territory, Capital Football and Tasmania.

I did technically finish FNSW as well back in 2020, but that was back in 2020.
 
You must log in or register to reply here.
Back
Top