| Page 25 of 28 |
| Theme |
| #1 |
|
7% |
[ 9 ] |
| #2 |
|
3% |
[ 4 ] |
| #3 |
|
1% |
[ 2 ] |
| #4 |
|
87% |
[ 104 ] |
|
| Total Votes : 119 |
|
|
|
 Posted: Mon, 17th Oct 2016 15:27 Post subject: |
|
 |
Last edited by Interinactive on Thu, 4th Dec 2025 09:12; edited 3 times in total
|
|
| Back to top |
|
|
|
|
| Posted: Mon, 17th Oct 2016 15:27 Post subject: |
|
|
|
|
|
| Back to top |
|
|
Nui
VIP Member
Posts: 5720
Location: in a place with fluffy towels
|
| Posted: Wed, 26th Oct 2016 16:08 Post subject: |
|
|
|
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 16:10 Post subject: |
|
|
hah, actually a viable idea 
|
|
| Back to top |
|
|
Nui
VIP Member
Posts: 5720
Location: in a place with fluffy towels
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 16:28 Post subject: |
|
|
OK so...
In a first step:
Go Through each subforum, go into each thread of the first page, go through all pages and dump the content into a local db.
Go through local db, collect all user id's and dump into seperate table.
Go through table and fill each users information with data from user from nfohump and assign random initial pw.
Make sexy time to interinactive.
Insert local db thread and post data into new forum, insert users into new forum, auto pm all users on nfohump with random initial pw.
Don't these phpBB forums always have some views that are more bot friendly? I'd rather go through them...
|
|
| Back to top |
|
|
Nui
VIP Member
Posts: 5720
Location: in a place with fluffy towels
|
|
| Back to top |
|
|
|
|
|
| Back to top |
|
|
tonizito
VIP Member
Posts: 51595
Location: Portugal, the shithole of Europe.
|
| Posted: Wed, 26th Oct 2016 18:41 Post subject: |
|
|
It... it's happening? Can it be? 
| boundle (thoughts on cracking AITD) wrote: | | i guess thouth if without a legit key the installation was rolling back we are all fucking then |
|
|
| Back to top |
|
|
Nui
VIP Member
Posts: 5720
Location: in a place with fluffy towels
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:08 Post subject: |
|
|
I found a ready made phpbb2 crawler. god damn it, don't use it -_- this'll take forever! It really goes from 1 to member 200.000 step by step http call by http call. This thing isn't smart enough! I should be able to only migrate a part of this forum. nfohump is 15 years old god damn it, I can't have all the history by crawling through it! For now the last 10 pages with all their threads of each subforum would've been more than enough...
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:12 Post subject: |
|
|
Last edited by Royalgamer06 on Wed, 30th Nov 2016 21:40; edited 1 time in total
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:18 Post subject: |
|
|
| Royalgamer06 wrote: | | Do we really need all these old topics |
no
| Royalgamer06 wrote: | | and inactive members on this new forum? |
no
| Royalgamer06 wrote: | | Why not just do a reboot. |
that's what I had in mind
| Royalgamer06 wrote: | | Copy important topics. |
Yes, and the members on those topics.
| Royalgamer06 wrote: | | And close this forum. |
That is not up to anyone of us actives around 
Or we just get some db data that is required to move it to phpbb3 and it still runs here with the real data  |
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:37 Post subject: |
|
|
Last edited by Interinactive on Thu, 4th Dec 2025 09:11; edited 3 times in total
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:41 Post subject: |
|
|
Don't even start using those stupid crawlers. I'm writing something myself, that should save the god damn page bandwith and accelerate this crap to the max (also I'm mod and have more powers than your puny user  )
|
|
| Back to top |
|
|
Nalo
nothing
Posts: 13566
|
| Posted: Wed, 26th Oct 2016 23:56 Post subject: |
|
|
Last edited by Nalo on Wed, 3rd Jul 2024 06:02; edited 2 times in total
|
|
| Back to top |
|
|
|
|
| Posted: Wed, 26th Oct 2016 23:57 Post subject: |
|
|
Last edited by Interinactive on Thu, 4th Dec 2025 09:11; edited 3 times in total
|
|
| Back to top |
|
|
Nui
VIP Member
Posts: 5720
Location: in a place with fluffy towels
|
|
| Back to top |
|
|
|
|
| Posted: Thu, 27th Oct 2016 00:25 Post subject: |
|
|
Last edited by Interinactive on Thu, 4th Dec 2025 09:11; edited 3 times in total
|
|
| Back to top |
|
|
|
|
| Posted: Thu, 27th Oct 2016 02:10 Post subject: |
|
|
| Nui wrote: | @ pump
Is speed really important? After all you really only need to beat the admins reaction time  |
I'll just quote my discussion with Inter regarding this
| Quote: | | Even if we only take the very first page of each forum (with it's 50 threads each) we have 1708 threads, 16879 pages (so a minimum of 16879 http calls, at a minimum of 250ms each, this will already take 1+hr; at 800ms each it would take ~4 hours) and roughly 500.000 posts (based on the numbers mentioned before, crawling those each would take an additional 35-112hours) |
Of course we can split this to several persons each and be done with it rather quick. Preferably people that live close to the nfohump servers to reduce the latency as just a couple of hundred milliseconds will add up if we have several thousands of them
@inter: thought that was some generic gif  |
|
| Back to top |
|
|
ixigia
[Moderator] Consigliere
Posts: 65164
Location: Italy
|
| Posted: Thu, 27th Oct 2016 02:13 Post subject: |
|
|
When I read about crawling the only thing that comes to my mind is that Linkin Park song, but if it's what the Humps deserve to abandon the Dark Ages and achieve the long awaited Renaissance, then so be it 
Keep up the good work Humpcrawlers! <3
It's unfortunate that Rinze didn't make it through the zombie apocalypse, he could have found the way to retrieve Mrt's sleeping body in dkkev's castle and finally wake him up with a kiss :'(
|
|
| Back to top |
|
|
TSR69
Banned
Posts: 14962
Location: Republic of the Seven United Provinces
|
|
| Back to top |
|
|
|
|
| Posted: Thu, 27th Oct 2016 15:19 Post subject: |
|
|
| TSR69 wrote: | So this means I should start bumping my fav threads?
Edit: But 1st page of each subforum is not enough. |
In a first step it is. It's more than 16879 pages of content and more than 500.000posts. When and if we take this approach I'll allow my tool to be configurable so that we can later on extract more and more of the older threads too. The current code is very slim (barely 50 lines of code) and I can extend and adjust where needed |
|
| Back to top |
|
|
|
|
| Posted: Tue, 1st Nov 2016 10:42 Post subject: |
|
|
Last edited by Interinactive on Thu, 4th Dec 2025 09:10; edited 3 times in total
|
|
| Back to top |
|
|
Neon
VIP Member
Posts: 18935
Location: Poland
|
| Posted: Tue, 1st Nov 2016 10:54 Post subject: |
|
|
The admins resurfaced? You successfully copied all the important threads? You managed to unban boundle? WHAT HAPPENED
|
|
| Back to top |
|
|
|
|
| Posted: Tue, 1st Nov 2016 12:24 Post subject: |
|
|
Last edited by Interinactive on Thu, 4th Dec 2025 09:10; edited 3 times in total
|
|
| Back to top |
|
|
Neon
VIP Member
Posts: 18935
Location: Poland
|
| Posted: Tue, 1st Nov 2016 12:40 Post subject: |
|
|
|
|
|
| Back to top |
|
|
|
|
| Posted: Tue, 1st Nov 2016 13:29 Post subject: |
|
|
No worries, work continues on the plugin ^_^ I just have a very busy calendar but I try to do my part ^_^ I just made the stupid mistake to host the code locally on my desktop PC
|
|
| Back to top |
|
|
[mrt]
[Admin] Code Monkey
Posts: 1342
|
| Posted: Thu, 3rd Nov 2016 18:10 Post subject: |
|
|
Hello Guys,
Nice to see you got things in-order, and there is no need to go overboard and crawling anything. I'll jump in so that we can get this over with without extra hassle. I'd rather see you put that energy into something more useful for the forum. But do understand that I am personally short on time at the moment so excuse any black-outs, but I'll do the best I can.
Anyway, I'm in-touch with Nalos and Toni and things will get moving now.
teey
|
|
| Back to top |
|
|
|
|
|
| Back to top |
|
|
| Page 25 of 28 |
All times are GMT + 1 Hour |
