SoV Statistics Portal

[rev]

I assume that most of you have seen the stats signature that Shamoox and Thayne have been using from www.planetsidegaming.com. It's quite informative and simple.

Well, I wanted to take it to the next level and include a ton more detail. In my spare time starting this past Saturday I have been working on a little statistic portal specfic to our outfit. I do not have enough done to show anything off, but I can share some of the features that I am shooting for - sside from the obvious, overall, statistic mining.

- Daily points acculated which includes total outfit points and individual points. Save stats on a daily basis for every indivdual in the outfit so that over time we can even create some nifty graphs, etc...

- Display all certs for a given character.

- Automatically detect new users added to the roster.

- Automatically detect increases in BR and CR by a given player and posting recogniztion for that player.

- Automatically obtain your rank and update your namesake on this board as such.

- Add support for you to link players. I.E. If you have more than one character listed in the outfit, to combine the literal stats. Such as kills, hacks, etc...

- Create a graphic signature that you can use as you wish.

Let me know if you have any further ideas of features that you would like to see. I have no idea when I will get this thing to a working copy, but the hard part is done - parsing SOE's HTML output of the stats. Let's just hope they do not change their mind and reformat the layout of their HTML template per the stats pages. ;) Let's also hope that SOE gets off their ass and offers stats in XML format which would make things a lot more simple instead of me having to write nasty-parsing methods that are strictly dependent upon SOE not changing their stat templates.

[Shamoox]

You evil coder you.....

I would have done it but you beat me to the punch =). Let me know if you have any side projects that a humble coder like me can do.

[rev]

Thanks, Shamoox. If I run across a stumbling block I will certainly ask for assistance.

[Thayne]

wow, sounds great maen ^^ i can't wait to see what it's gonna be like;)

[FlashViper]

On a side note:

Im a networking guy so basically you guys are dabbeling in the black arts to me.

Rev, what did you do to get into programming? I do vb but thats the extent of my knowledge. How the hell do you just throw together a parsing method on the weekend?

lol

Thanks

[rev]

Rev, what did you do to get into programming? I do vb but thats the extent of my knowledge. How the hell do you just throw together a parsing method on the weekend?

I'm lucky to be able to make a living writing programs because I enjoy it. I do not really even remember how I got it into all... I'll certainly continue to develop programs until it bores me into submission. :)

[rev]

The majority of the back-end has been written and is running presently. I plan to let it run for a week and see if it explodes. Hopefully, if things go smoothly, I will be showing it off in 7-10 days.

[rev]

New Features:
- Began adding some of the statistical elements to the front of the site. More stats will be added as I find time...
- Each player can now be clicked to reveal specific stats for this player. This will also have several additions as I find free time...

[Shamoox]

Rev,

You rock buddy! The stats are looking great! Oh, and don't spend too much time coding and not playing =)

[rev]

New Features:
- Added ability to sort main player listing based on name, cr, br, points, hacked facilities, nc kills, tr kills, and total kills.

[rev]

It seems that SOE failed to update their web site with stats from yesterday (July 22). Soon as anyone notices that they have finally updated, let me know and I will re-run the stats update process.

I have seen several posts about it on SOE's PS site concerning the problem of stats not being updated. So, hopefully SOE is aware of the issue.

This will not really cause a problem with our overall stats upon them fixing the problem on their end. But, it will screw up my daily stats for each individual... if I am unable to see stat differences on a day-by-day basis, then there is no way that I can calculate your daily stats, unfortunately. :( So, hopefully they will fix this problem sometime today, otherwise we will lose daily stats until they fix their problem.

[rev]

Seems that stats are updated, finally. Go SOE! blah

[LilianNiN]

They were too sidetracked with their LLU idea to do anything remotely rational... including scrapping the LLU idea.

[rev]

New update.

I have been wanting to add graphs to the stats portal for a while now but I have not had much time, unfortunately. Well, I finally found some free time and added a couple graphs to the each player's stat portal.

The first graph is a simple bar graph that shows the total points scored on a daily basis over the past 50 days.

The second shows total kills, nc kills, and tr kills over the past 50 days. It's done with a bar graph and two line graphs for the faction-specific kills.

Let me know what you think. Below is a link to my stat portal with the new graphs displayed.

http://www.sonsofvanu.com/stats/stats_player.php?player_id=272798

One more note I should add. The graphs are presently dynamically generated from data in the database. So, if it takes a few seconds to generate, this is why.

[rev]

rev, thankyou for spending time to work with the stats, however I need to say that the Bargraph + Connected Line graph just doesnt look right. Whats the point having that line graph for daily kills. There is no relation between day 1 and day 2 for kills. its a descreate value. I suggest make a paired bar graph, one red the other blue for each day, just make it simple to read.

Isux,
In response to your post that you do not like the line graphs on top of the bar graphs. What is it about it that makes you say 'it does not look right'?

For me, it shows exactly what I was after. It shows a trending factor of which faction I was fighting more that day and over a given time period. There are some spans evident on my kill graph that show I was killing a lot more TR on a daily basis compared to NC. And, sure enough, those spans are probably where I was on Amerish and Forseral.

Are you suggesting that I add two more bars beside each total to display distinct faction kills? If so, this takes a lot more horizontal space which I do not have to waste.

[Isux]

well, the line graphs ontop of the bar is not illogical, it still display important information. I suggest paired bar graph because it will display what you wanted in a less messy format. cuz right now, without looking carefully the lines are just big flucuations in a cramped horizontal space.

[rev]

So, you are suggesting that I add two more 800x500 graphics to each page instead of having all three displayed in one graphic, as it is now?

The gist of your original post was that it did not look good. You even stated that there were no relations between day 1 to day 2, which is completely untrue.

So, let me get it straight. You are now saying that there is legit data there, but it's just too much data in one place?

I'm just trying to follow ya here.

[Isux]

no u got me wrong.. I am saying that instead of the "daily NC,TR kill line + Total KillBar" graph, replace it with a "daily NC,TR kill bar with different colors" (something that looks like)

. T N
NT N
NT NT . T
NT NT NT
NT NT NT
--------------------------
_1__2__3__ <- day

and maybe the line graph ontop of that that shows total daily total kill.

[rev]

New Update.

Something I have been meaning to add for a while. Finally added functionality to retire an ex-member of the outfit and not display their contributed stats.

[Chadly]

Woohoo!! Thanks for the hard work rev, looks good and having it remove old members is a nice fix.

-Chad

[rev]

Thanks, Chadly.

More updates.

I have rearranged some of the layout of the stats page. There was just too much information on the front page (320k on average). I have now put two summary graphs on the main listing and split the outfit listing and daily totals into two seperate pages. Also, I have added a dropdown on every page with all active characters in the outfit.

[Chadly]

I think Isux means something more like this... which I would also probably prefer. I think it moves things around so it's not as cluttered. I apologize for my not-so-leet PhotoShop skills, but I had exactly 2.5 minutes to make this :P



NC and TR kills for each day are color-coded bar graphs. The line above is the combined total kills for the day. This way, no part of the graph is transposed on top of another.

Even since I posted my last message rev has made even more updates that improve the functionality of the stats. I really like the drop-down list of members. Thanks again rev.

-Chad

[rev]

I see what you are saying now.

I will think about it, but the addition of another bar could be impossible with the horizontal space available.

For me, the graphs do not look cluttered at all. Sorry if they appear cluttered to you.

[Chadly]

Ah I see, yeah it probably wouldn't fit in the space you've got set up now. I like the way it is now, but this is just an alternative. One suggestion though, can you add a list of certs a person has to their individual stats page?

Hmmm, I just had another idea too. Instead of a text list of certs, how about small icons to designate each cert? I have almost zero programming experience so I don't know how hard that would be, but I can make the icons if you'd like.

-Chad

[martyr]

so these stats are awesome, i wanted to dig through old topics and see what their story was. it's one of my two favorite things to show off to people when i'm telling them about the outfit.

i have a question about it too - when does each day start/end, and when does it usually update the previous day's data?

[Rahl]

There is a program which runs at 6:30 am. It grabs all the stats and stores them in mysql.

SOE isn't really too good about updating their website, so somtimes a few of your kills and points form one day might get pushed into the next day, but it all evens out.

[martyr]

6:30. perfect, i think rotto and i logged right around then.

let me reiterate, our stats > all, including dicepoint

[Drizzt421]

It'd be tight if we made a dicepointstyle sig outta the stats. Anyone got any ideas?

[rev]

Code it up... don't suggest it. ;)

[Drizzt421]

I could draw a scetch on paint of what it might be like, no coding though, havn't learned any. If you could lead me to a free (or nearly free) way to learn to code, I might give you a cookie.

[rev]

www.php.net

[rev]

Just updated the graphs for both outfit totals and individual totals to look a bit more pretty. Also removed the in-line line plot of seperate TR and NC kills as many of you complained that you did not like that feature... alas...

[LilianNiN]

Just updated the graphs for both outfit totals and individual totals to look a bit more pretty.
Looks a lot more pretty. :D

[MuffinMonkey]

its pretty :o

[snipegrzywa]

NICE :D

[rev]

Added some outfit averages.

- Overall points/kills average since I began data mining the SoV stats (June 16, 2002)
- Last seven day daily point/kill average
- Last 14 day daily point/kill average
- Last 30 day daily point/kill average
- Changed graphs for both outfit and individuals to reflect last 30 days instead of last 50 days. 30 days is an average month, and is a better scope of play compared to the last 50 days.

Upcoming additions in the pipe:
- Last seven day average point/kill leaders.
- Last 14 day average point/kill leaders.
- Last 30 day average point/kill leaders.
- Top daily average point/kill leaders.

[rev]

Added daily trending stats, much like the newly added outfit daily trending stats, for individual players.

Each player's stat page will now include the following:

- Overall points per day average
- Last seven days point per day average
- Last 14 days point per day average
- Last 30 days point per day average
- Overall kills per day average
- Last seven days kills per day average
- Last 14 days kills per day average
- Last 30 days kills per day average

Example:
http://www.sonsofvanu.com/stats/stats_player.php?player_id=272798

[martyr]

::glee::

[rev]

Before I forget mention. I added a simple aspect to the overall Outfit Stats page last night. Only players are listed that are active within the past 30 days. For example, presently we have 236 members but only 123 have logged in and played within the past 30 days.

http://www.sonsofvanu.com/stats/outfit_stats.php

[rev]

Just to let you guys know.

I will be making some changes to the stats portal tonight. SOE's web servers are not easy to work with... at all. So, I am going to try to figure something out to better accomodate their lack of responsiveness.

This is what has been causing stat update failures of late.

So, if you see strangeness in the stats today it is because of a failure to update last night and I cannot fix it while at work.

[rev]

I fixed most of the problems. Stats are back up.

[rev]

New Feature additions:

- Outfit top 10 daily kills and points leaders (main stats page) *
- Top 10 daily kills and points for each individual player
- Removed 30-day limit on each player's daily stats. All are listed now. **

* Only current outfit members listed.
** Graphs are still last 30 days.

[martyr]

/me does a jig

rev wins at internetting again

[rev]

New feature additions:

- Removed Top 10 one day total kills/points from main stats page.
- Created new section named "Records", linked from SoV Stats navigation at the top of every stats page. Includes Top 10 Kills: One Day Total, Top 10 Kills: Last Seven Days, Top Ten Kills: Last 14 Days, Top Ten Kills: Last 30 Days, Top Ten Points: One Day Total, Top Ten Points: Last Seven Days, Top Ten Points: Last 14 Days, Top Ten Points: Last 30 Days

SoV Stats Records:
http://www.sonsofvanu.com/stats/records.php

[rev]

When I get another chance to work on the stats, I plan to add links to each record boxes to a longer list... top 10s are nice for a quick glance, but more rows are needed. Some of us are not losers and cannot play hours a day to make the lists each week. ;)

[LuckYx]

yeah the only time i got #1 out of 5 with ~140 kills i played at least 7 or 8 hours split up over the day.

[snipegrzywa]

Some of us are not losers and cannot play hours a day to make the lists each week. ;)

Or some of us have 4 characters they use regularly so theres no way they could get up there 8)