NIWA Community Forums

NIWA Community => NIWA Discussion => Topic started by: FlyingRagnar on November 08, 2011, 03:27:30 PM

Title: NIWA Stats
Post by: FlyingRagnar on November 08, 2011, 03:27:30 PM
Using Google Reader, here are some NIWA stats.  Note that these are taken from the recent changes feeds of each wiki and are bound to have differences, config settings, etc that skew the data.

SiteChanges per weekPercentage of total
Bulbapedia4117.436.43%
Mario3354.429.68%
Zelda1677.714.84%
Smash Wiki833.57.37%
Strategy500.74.43%
WikiBound178.31.58%
Metroid145.81.29%
Nookipedia96.90.86%
WiKirby78.20.69%
Golden Sun62.80.56%
Pikmin Fanon56.90.50%
Fire Emblem46.90.41%
Nintendo46.20.41%
Pikipedia310.27%
Donkey Kong28.90.26%
Starfy24.70.22%
Lylat 13.50.12%
Wars Wiki9.80.09%
NIWA Total11303.6100.00%
Title: Re: NIWA Stats
Post by: Foxdude54 on November 08, 2011, 09:05:29 PM
....Wow. Hey Bulbapedia! Spare some users?
Title: Re: NIWA Stats
Post by: BrandedOne on November 08, 2011, 10:06:04 PM
I am saddened. However, this is not surprising.
Title: Re: NIWA Stats
Post by: Jake on November 08, 2011, 11:01:00 PM
Interesting stats! :) I should write a script that will compile a report like this each week and generate some graphs. It would be interesting to see how new game releases affect the wikis.
Title: Re: NIWA Stats
Post by: TurtwigA on November 09, 2011, 03:24:28 AM
Notice how the top 5 are the ones that spun off from Wikia and not made from other NIWA users, and all below are for the most part.
Title: Re: NIWA Stats
Post by: FlyingRagnar on November 09, 2011, 01:50:11 PM
Yeah, Google doesn't keep stats for feeds which are not followed by someone in Google Reader. So a little over a week ago I added all of the feeds and this is the result.  The values will obviously normalize the longer that the feeds are followed, but writing a script to do it manually would certainly be much more accurate.  

Edit: Also, you would need to make the script run multiple times daily.  The $wgFeedLimit is by default set to 50, so you would need to visit often to not miss updates.  Bulbapedia typically has over 500 a day.
Title: Re: NIWA Stats
Post by: FlyingRagnar on November 28, 2011, 09:31:00 PM
Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia4069.134.80%-1.17%
Donkey Kong180.15%-37.72%
Fire Emblem135.31.16%+188.49%
Golden Sun83.30.71%+32.64%
Lylat Wiki180.15%+33.33%
Mario 365831.29%+9.05%
Metroid237.32.03%+62.76%
Nintendo39.20.34%-15.15%
Nookipedia1261.08%+30.03%
Pikmin48.80.42%+57.42%
Pikmin Fanon76.10.65%+33.74%
Smash Wiki863.87.39%+3.64%
Starfy 15.20.13%-38.46%
Strategy Wiki546.94.68%+9.23%
Wars6.10.05%-37.76%
Wikibound1711.46%-4.09%
WiKirby56.20.48%-28.13%
Zelda1523.413.03%-9.20%
Total11691.7100.00%+3.43%
Date11/28/2011


Edit: Made easier to read, added % of change from last update.  
Title: Re: NIWA Stats
Post by: Foxdude54 on November 28, 2011, 09:48:31 PM
Well, Lylat improved in amount edited, just not place.
Edit: 0.15%! WOO!
Title: Re: NIWA Stats
Post by: Koroku on December 02, 2011, 05:48:05 AM
Same with Golden Sun :D
Title: Re: NIWA Stats
Post by: FlyingRagnar on December 28, 2011, 03:07:07 PM
Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia299931.26%-26.30%
Donkey Kong61.10.64%+239.44%
Fire Emblem2211.89%+63.34%
Golden Sun76.30.80%-8.40%
Lylat Wiki26.10.27%+45.00%
Mario3185.933.20%-12.91%
Metroid80.30.84%-66.16%
Nintendo8.20.09%-79.08%
Nookipedia82.10.86%-34.84%
Pikmin44.30.46%-9.22%
Pikmin Fanon102.41.07%+34.56%
Smash Wiki98410.26%+13.92%
Starfy1301.35%+755.26%
Strategy Wiki626.56.53%+14.55%
Wars10.30.11%+68.85%
Wikibound62.80.65%-63.27%
WiKirby17.70.18%-68.51%
Zelda877.19.14%-42.42%
Total9595.1100.00%-17.93%
Date12/27/2011
Title: Re: NIWA Stats
Post by: Seritinajii on December 28, 2011, 03:59:40 PM
Go Fire Emblem Wiki!!! :D
Title: Re: NIWA Stats
Post by: FlyingRagnar on January 28, 2012, 01:10:23 AM
Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia3187.333.22%+6.28%
Donkey Kong34.50.36%-43.54%
Fire Emblem376.13.22%+70.18%
Golden Sun43.20.45%-43.38%
Lylat Wiki22.40.23%-14.18%
Mario 3002.531.29%-5.76%
Metroid101.51.06%+26.40%
Nintendo460.48%+460.98%
Nookipedia217.72.27%+165.16%
Pikmin28.90.30%-34.76%
Pikmin Fanon59.70.62%-41.70%
Smash Wiki1170.612.20%+18.96%
Starfy 119.91.25%-7.77%
Strategy Wiki649.66.77%+3.69%
Wars18.40.19%+78.64%
Wikibound172.41.80%+174.52%
WiKirby175.91.83%+893.79%
Zelda1451.115.12%+65.44%
Total10877.7100.00%+13.37%
Date1/27/2012

Editing was up this month overall.
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 13, 2012, 07:16:48 PM
Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia4428.739.75%+38.95%
Donkey Kong146.11.31%+323.48%
Fire Emblem240.62.16%-36.03%
Golden Sun74.20.67%+71.76%
Lylat Wiki3.50.03%-84.38%
Mario 2595.423.30%-13.56%
Metroid196.91.77%+93.99%
Nintendo390.35%-15.22%
Nookipedia70.50.63%-67.62%
Pikmin62.80.56%+117.30%
Pikmin Fanon50.20.45%-15.91%
Smash Wiki1136.810.20%-2.89%
Starfy 367.73.30%+206.67%
Strategy Wiki5354.80%-17.64%
Wars51.60.46%+180.43%
Wikibound75.40.68%-56.26%
WiKirby61.80.55%-64.87%
Zelda1005.29.02%-30.73%
Total11141.4100.00%+2.42%
Date3/13/2012
Title: Re: NIWA Stats
Post by: Starphoria on March 13, 2012, 08:22:11 PM
Starfy Wiki is in the top 5? Woah. Poor Lylat Wiki... D:
Title: Re: NIWA Stats
Post by: Greenpickle on March 13, 2012, 08:26:06 PM
Nope, 6th.
Title: Re: NIWA Stats
Post by: Starphoria on March 13, 2012, 09:23:40 PM
Didnt see Strategy Wiki there :3 Still, that's pretty high :p
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 13, 2012, 11:23:30 PM
Some of the SEIWA wikis posted low numbers this time as well.  That is what happens on small wikis when the few dedicated editors take a break.

In the future I'm going to add a "average posts per wiki" metric.  This will be the total number of posts for all of NIWA, divided by the number of wikis in NIWA.  This will be a good measure over time of how well NIWA as a whole is doing.
Title: Re: NIWA Stats
Post by: Starphoria on March 13, 2012, 11:32:03 PM
Hopefully the other NIWA Wikis become more active :(
Title: Re: NIWA Stats
Post by: Xizor on March 20, 2012, 10:54:43 AM
This is pretty cool! I wish I'd seen this before.

We should see about finding out how many editors there are at each Wiki, see how many users NIWA "has" overall?

Things are looking good for us, though, it seems. :)
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 22, 2012, 02:45:11 PM
That would definitely be a cool stat to see.  As I mentioned earlier in this thread, I am just using Google Reader to pull the info for each of the feeds.  To get the number of editors, we would need to write our own software most likely.  It would need to run every hour or so (maybe a cron) and check each feed and compile the information.
Title: Re: NIWA Stats
Post by: Vellidragon on March 22, 2012, 06:48:56 PM
What would "editors" include? All registered users or only those with some sort of activity? Just wondering, as there's an "Active users" page with "users who had some kind of activity within the last 91 days" among the special pages. Counting these manually, WiKirby currently has 55, if anyone cares.

(I'm probably completely missing something here, so I apologise for my childish ignorance.)
Title: Re: NIWA Stats
Post by: Greenpickle on March 22, 2012, 07:54:24 PM
Active users sounds like a good measure of the number of editors.  You can easily grab it from the MediaWiki API.  For example, you can get the general statistics, including active users, for Pikipedia, at:

http://www.pikminwiki.com/api.php?format=json&action=query&meta=siteinfo&siprop=statistics

You can fetch and parse this for active users fairly easily - for example, in JavaScript for non-IE:

Code: [Select]
var api = 'http://www.pikminwiki.com/api.php';
var r = new XMLHttpRequest();
r.open('GET', api + '?format=json&action=query&meta=siteinfo&siprop=statistics', false);
r.send(null);
alert(JSON.parse(r.responseText).query.statistics.activeusers);

Or in Python 3:

Code: [Select]
from urllib.request import urlopen
from json import loads
api = 'http://www.pikminwiki.com/api.php'
print(loads(urlopen(api + '?format=json&action=query&meta=siteinfo&siprop=statistics').read().decode())['query']['statistics']['activeusers'])
Title: Re: NIWA Stats
Post by: Xizor on March 25, 2012, 01:37:55 PM
I was thinking just registered members, but active users is probably much better!

Edit: Btw, Zelda Wiki caps it off at 30 days, so there needs to be some consistency between Wikis if we're to use this a valid, uniform stat, but anyway, within the last 30 days, 121 people have edited ZW. :)

Also, another fun stat to compile could be the total article count of all of NIWA. :)
Title: Re: NIWA Stats
Post by: Greenpickle on March 25, 2012, 06:51:43 PM
Pretty sure it's 30 days at every wiki.
Title: Re: NIWA Stats
Post by: Vellidragon on March 25, 2012, 06:59:32 PM
Pretty sure it's 30 days at every wiki.
"users who had some kind of activity within the last 91 days"
That's an exact quote from the Active Users page on WiKirby (http://wikirby.com/wiki/Special:ActiveUsers), so evidently, it's not 30 days everywhere.

EDIT: Just checked random wikis, and Wars Wiki, for instance, also has 91 days. There's definitely wikis with 30 as well, though.

EDIT2: Lylat Wiki and Starfy Wiki also have 91 days. The rest all seem to have 30, unless I forgot one.
Title: Re: NIWA Stats
Post by: Greenpickle on March 25, 2012, 07:15:18 PM
Hmm, okay.  Interesting...
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 27, 2012, 04:29:45 PM
Looks like it should be controlled by $wgActiveUserDays (http://www.mediawiki.org/wiki/Manual:$wgActiveUserDays).  30 is the default.  Not sure why it would be set to 91 for any wiki, weird.
Title: Re: NIWA Stats
Post by: porplemontage on March 27, 2012, 04:56:16 PM
Looks like it should be controlled by $wgActiveUserDays (http://www.mediawiki.org/wiki/Manual:$wgActiveUserDays).  30 is the default.  Not sure why it would be set to 91 for any wiki, weird.

Older versions of MediaWiki.
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 27, 2012, 05:51:04 PM
Yeah that's what I figured, but looking at the history of the article, it never lists a value different than 30.  Probably undocumented in earlier versions or something. 
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 30, 2012, 05:16:41 AM
http://pastebin.com/Ww6MmvPR

Here is a python script I threw together based on Greenpickle's suggestion above.  It grabs various statistics from each wiki and puts it into a very basic html table.  A couple things...

1) Can one of you with better web hosting put this on a cron?  My hosting only has python 2.4 which does not support the JSON library (2.6+). 

2) I could not find the api.php for the Wars Wiki.  Seems like it should be http://www.warswiki.warscentral.com/api.php.  So that wiki is currently missing. 

The script does not do any sort of error handling at all.  The value for active users it spit out for me (minus Wars wiki) was 1893!
Title: Re: NIWA Stats
Post by: Greenpickle on March 30, 2012, 09:13:00 AM
For (1), since you're fetching from trusted sources, and you're quite sure the output will be valid JSON, you can just eval() it.

Quite important: you're fetching and parsing the page for every category, but you only need to do it once per wiki.  This obviously makes it run about 6 times as fast.

As for errors, if you weren't sure, urlopen gives IOError when the page is dead (or maybe it does so on .read()), and the API will give errors in the returned data structure (in the 'error' key, I think?).  Checking a page is valid JSON kind of conflicts with what I said for (1), so maybe you could have a hack like checking for fetched_string.startswith('{"query":') ?

(...And I'm struggling to refrain from complaining about your HTML - I'm telling myself it doesn't matter.)

Edit: looking at the difference between this table each month might be a better way of getting the monthly edits, too.
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 30, 2012, 04:08:31 PM
Haha, you are so critical.  :)  This was just 10 minutes of work, and I never write Python.  Feel free to make some quick changes and post an updated script.  I didn't work on it longer because I figured out that my hosting doesn't have Python 2.6+, so I kinda quit then. 

I will work on it again when I have some time. 
Title: Re: NIWA Stats
Post by: Greenpickle on March 30, 2012, 04:33:09 PM
Hey, the only point of criticism was the bit about only fetching once per wiki, and that's pretty important; the rest were just general thoughts.
Title: Re: NIWA Stats
Post by: FlyingRagnar on March 30, 2012, 04:47:09 PM
Oh yeah, I totally understand.  I'm thinking the cron would only run once a day, more than that and the stats probably aren't more meaningful.  So even if it was a slow process, it wouldn't matter much.  Of course, things are still thrown off by the fact that some wikis have 91 days for active users and others 30.  There are probably other config settings that skew the values.
Title: Re: NIWA Stats
Post by: FlyingRagnar on April 03, 2012, 04:47:38 PM
NIWA Statistics
Wiki NameArticlesEditsMediaUsersActive UsersAdmins
Pikipedia59737422173731889
Bulbapedia2115916471330624428329
Donkey Kong Wiki900116642334465145
Fire Emblem Wiki872237386402237157
F-Zero Wiki218943533258168
Golden Sun Universe1421502934014855125
Icaruspedia2714968620112566
Lylat Wiki1643891410502691611
Metroid Wiki152141021268218131710
Nintendo Wiki5181401061130289
Nookipedia135528669396112373410
Pikmin Fanon Wiki1647263381804231147
Smash Wiki206810506759831194889
Starfy Wiki72513535157792127
Strategy Wiki2355959801880586600087832
Mario Wiki121211272908364072334848912
Wikibound977201812415569134
Wikirby740193852175668454
Zelda Wiki362930153813834976312117
Dragon Quest Wiki2657297244937287153
Totals7711942939611734611642681903184
2012-04-03 12:40:03.384798

Not sure why Bulbapedia has no media/images.  Maybe because they are using a customized storage system for their files?
Title: Re: NIWA Stats
Post by: Moydow on April 03, 2012, 05:05:59 PM
Bulbagarden and Bulbapedia use Bulbagarden Archives (http://archives.bulbagarden.net) for media storage for the entire site instead, similar to Wikimedia and the Wikimedia Commons (http://commons.wikimedia.org).
Title: Re: NIWA Stats
Post by: Bop1996 on April 03, 2012, 05:26:45 PM
Metroid Wiki had a fairly good month compared to what activity has been like lately. Of those 17 active users, three were admins, and most of the rest were people that edited once or twice and then didn't edit anymore, tho.
Title: Re: NIWA Stats
Post by: Greenpickle on April 03, 2012, 05:37:50 PM
Are you still going to be gathering data for the number of edits per week?
Title: Re: NIWA Stats
Post by: FlyingRagnar on April 03, 2012, 07:24:44 PM

Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia4342.336.83%-1.95%
Donkey Kong Wiki111.50.95%-23.68%
Dragon Quest Wiki38.50.33%
Fire Emblem Wiki371.93.15%+54.57%
F-Zero Wiki940.80%
Golden Sun Universe76.80.65%+3.50%
Icaruspedia226.61.92%
Lylat Wiki8.40.07%+140.00%
Mario Wiki2806.323.80%+8.13%
Metroid Wiki190.91.62%-3.05%
Nintendo Wiki47.10.40%+20.77%
Nookipedia60.90.52%-13.62%
Pikipedia69.30.59%+10.35%
Pikmin Fanon490.42%-2.39%
SmashWiki11659.88%+2.48%
Starfy Wiki474.44.02%+29.02%
StrategyWiki765.36.49%+43.05%
Wars Wiki71.60.61%+38.76%
Wikibound102.20.87%+35.54%
WiKirby40.10.34%-35.11%
Zelda Wiki678.15.75%-32.54%
Total11790.2100.00%+5.82%
Avg Posts Per Week561.4380952-9.29%
Date4/3/2012
Title: Re: NIWA Stats
Post by: Toomai on April 03, 2012, 09:54:03 PM
Here, have some graphs:

(http://i.imgur.com/lEX3S.png)
(http://i.imgur.com/x5kS8.png)
Title: Re: NIWA Stats
Post by: Xizor on April 04, 2012, 07:24:45 AM
lol it speaks to the size of those franchises that those wikis are so huge. :P
Title: Re: NIWA Stats
Post by: Greenpickle on April 04, 2012, 07:35:49 AM
Yay.
Title: Re: NIWA Stats
Post by: SnorlaxMonster on April 04, 2012, 10:51:00 AM
Probably not the best measure of Bulbapedia's admins. I assume it only counts users in the sysop group (http://bulbapedia.bulbagarden.net/w/index.php?title=Special%3AListUsers&username=&group=sysop&limit=50), which is just the Administrator rank (see here (http://bulbapedia.bulbagarden.net/wiki/Bulbapedia:Staff) for BP's staff structure).

Unfortunately, I don't see a better way to do it. Is there some way (perhaps just by giving all staff usergroups a "staff member" user right that has no other purpose than as a flag) that this could be worked around?
Title: Re: NIWA Stats
Post by: FlyingRagnar on April 04, 2012, 12:57:33 PM
I wouldn't worry much about it.  That is probably the least important stat listed for all the wikis.  I really just listed it because it was there and I could.
Title: Re: NIWA Stats
Post by: Xizor on April 05, 2012, 08:13:43 AM
I was speaking more to users and articles/edits in general, anyway.
Title: Re: NIWA Stats
Post by: FlyingRagnar on May 01, 2012, 07:37:35 PM

Wiki NameAverage Posts Per WeekPercentageChange
Bulbapedia4578.736.97%+5.44%
Donkey Kong Wiki130.91.06%+17.40%
Dragon Quest Wiki61.60.50%+60.00%
Fire Emblem Wiki505.24.08%+35.84%
F-Zero Wiki60.40.49%-35.74%
Golden Sun Universe171.31.38%+123.05%
Icaruspedia397.43.21%+75.38%
Lylat Wiki12.80.10%+52.38%
Mario Wiki3143.225.38%+12.01%
Metroid Wiki139.51.13%-26.93%
Nintendo Wiki18.20.15%-61.36%
Nookipedia75.10.61%+23.32%
Pikipedia45.70.37%-34.05%
Pikmin Fanon85.90.69%+75.31%
SmashWiki968.37.82%-16.88%
Starfy Wiki300.32.42%-36.70%
StrategyWiki771.26.23%+0.77%
Wars Wiki61.40.50%-14.25%
Wikibound34.30.28%-66.44%
WiKirby590.48%+47.13%
Zelda Wiki765.36.18%+12.86%
Total12385.7100.00%+5.05%
Avg NIWA Posts Per Week589.7952381+5.05%
Date5/1/2012

Title: Re: NIWA Stats
Post by: goombashoe on May 20, 2012, 06:25:50 PM
Notice how the top 5 are the ones that spun off from Wikia and not made from other NIWA users, and all below are for the most part.
I know this is extremely late but that's incorrect only one of the top 5 were spun off from Wikia the other 4 were created prior to NIWA
Title: Re: NIWA Stats
Post by: KidIcarus on February 25, 2013, 01:11:35 AM
For next week's update, can you also include statistics about the forum relative to the wikis? I am looking forward to that. ty