Automated regional activity reports

r3naissanc3r

Honoured Citizen
Citizen
Hi all,

The admins have implemented a procedure to automatically compile and publish some basic statistics for the region and forum:

http://z6.****************/Europeia/index.php?showforum=1130

This report is updated every week, on Sunday. At the end of the month, a monthly version will also appear. All past reports, including the related data and image files, are made available 1) in the archive post in the above forum; and 2) in the server where all of the work happens: http://54.243.84.166/broadcast/europeia/reports/

The whole process is fully automated; no manual input whatsoever is required. In the past, the Interior Ministry and HEM had been compiling such reports manually, so we hope this will relieve them from some of the workload.

Currently, the report only keeps track of region population, forum posts, and forum members, and plots some corresponding graphs. But, adding more statistics and visualizations is easy. Think of the current version more as a demonstration of what we can do; if you like what you see and have requests for additions, please post them.

Also, if you would like to see similar automation in other areas, we welcome ideas so please submit them.

Best,
r3n.
 
You are quite awesome, Penguin! :clap:
 
I have one question about it - does it store the stats week-to-week or overwrite them?
 
It stores them. You can go to the link:

http://54.243.84.166/broadcast/europeia/re...12_11_17_files/

where you replace the date with the week you are interested in (right now there's only one). Inside you'll find a stats.dat file with the stats for that week, as well as the .png files with the graphs.

You can also explore the higher-level directory:

http://54.243.84.166/broadcast/europeia/reports/

There, you can see a list of all of the reports, as well as a file stats.dat with aggregate stats since I started collecting them about a month ago.

All of the .dat files are just simple notepad files, which can also be imported to Excel or other similar program.
 
Posts per day would probably be a more interesting graph than total posts (in the second chart).
 
Oh awesome! Cheers for explaining it as well.

Do the files get get stored on the IF board itself or elsewhere? I'm just wondering if there'll be a time when we run out of free space and end up having to move forums/pay for the forum.
 
Posts per day would probably be a more interesting graph than total posts (in the second chart).
For the record, this has been done. I have also changed the graph of forum members to show new members per day instead.

In case anyone is using the files on the server, the reports for the previous weeks are still in the old format (total forum posts and members instead of daily counts).
 
For the record again, the first monthly report was produced and published this morning.

HEM also asked me to include a daily-updated historical graph, which is now the first thing you see in the Euro Stats page. As I've only been tracking data for a month, the daily and monthly graphs are identical today.
 
Quadruple post!

There was a small bug in the data parsing code, meaning that the last three days would not show up in the reports. This has now been fixed, and the reports updated.
 
*breaks r3n's post chain so he doesn't feel guilty about posting, if he would otherwise have, which he probably wouldn't have*
 
Back
Top