This forum is archived and read only.
Please move to the new forum!

by **Softly** » 20 Nov 2016, 04:15

So I was wondering what it would take to do some truly epic stats for FA games, e.g. analysis + comparison of builds for every spot on every map. Imagine breakdowns of your energy and mass over time, and heat maps of fights in air and land for all maps.

The kind of info that would be required is detailed eco information, mass and energy every 10 secs or so, as well as information on what units you made/killed etc.

I thought that it may be possible to record as a separate event in the FAF DB every single time someone builds or kills a unit in FA.

Some estimates of storage requirements:
100 bytes per line in the db, storing unit type, gameid, playerid, gametime, maybe some other things?.
1000 lines per player per game, say 500 units made and 500 destroyed on average.
~2800 people-games (games, but counted according to the number of players, so 4v4 => 8 people games), source: viewtopic.php?f=2&t=13449#p138924

=> ~280MB a day which is a feasible amount to store. (Takes more than 10 years to generate a Terabyte of data)

Also this is almost certainly an overestimate.

Coding effort:
1) Game code, to pull these stats out.
2) DB code + API code to store and retrieve stats
3) Stats effort/web code, to view the data usefully

I'd need someone else to do 1), I'd do some of 2), and I'd be happy to do lots of stuff on 3).

What I need from other people is expressions of interest, and/or offers to help.

by **Aulex** » 20 Nov 2016, 04:58

I don't know if this is feasible at all, but if you start something I may start working on the games api again.

by **Exotic_Retard** » 20 Nov 2016, 13:25

i dont really know how faf stats works tbh, should look at achievement code as well since that records a bunch of stuff, theres already tons of 3) that you can do with what we have already. so dont let 1) and 2) put you off. start with making the current stats nicer maybe? xD like put in a zoom function and maybe somehow eliminate those absurd mass income spikes we get sometimes

since im a game coder the way i see it is you could just record position and instigator in OnKilled and save that somewhere in the global sync table selen-style then the game would fish it out at the end. so yeah sounds feasible to me game-side, not sure what the "correct" approach would be though.

i think waaaay more work will be required to make the stats viewer and make the server save the stats, or save them in the replay somehow? i dunno much about replays. also replayparser is a thing, that already has access to every command ever, and probably its position as well, so look at that and improve that too?

by **Softly** » 20 Nov 2016, 20:06

The volumes of data certainly seem feasible, so the main work is in the implementation as I see it.

Exotic_Retard wrote:i dont really know how faf stats works tbh, should look at achievement code as well since that records a bunch of stuff, theres already tons of 3) that you can do with what we have already. so dont let 1) and 2) put you off. start with making the current stats nicer maybe? xD like put in a zoom function and maybe somehow eliminate those absurd mass income spikes we get sometimes

since im a game coder the way i see it is you could just record position and instigator in OnKilled and save that somewhere in the global sync table selen-style then the game would fish it out at the end. so yeah sounds feasible to me game-side, not sure what the "correct" approach would be though.

i think waaaay more work will be required to make the stats viewer and make the server save the stats, or save them in the replay somehow? i dunno much about replays. also replayparser is a thing, that already has access to every command ever, and probably its position as well, so look at that and improve that too?

I'm sure there's plenty of graphs I could show using the existing achievements data too, I'm just not sure any of them would actually be interesting. The stuff being collected there is designed for showing cumulative achievement, not for analysing gameplay.

As for making something to see the stats with, I don't think it is particularly more complicated than the voting app I made. That took 1 day to prototype, and then another day to make it FAF server compatible (which wouldn't have to happen for this app).

Also this kind of information can't be recovered from replays without running the full simulation, so improving the replay parser won't help. (I don't have enough compute left in my PC to run every FAF game from the beginning of time).

OnBuilt and OnKilled (or whatever the names are) functions sound like exactly the ones to hook, if you know where those are I'd be happy to steal your code for it ^.

by **TheKoopa** » 20 Nov 2016, 20:09

Honestly I think that the aftergame graph should be fixed to display properly before we make any addons

by **Viba** » 20 Nov 2016, 20:22

Well the stats function Softly is planning to do would be more advanced and kinda separate from the graphs after the game. I don't see why he can't embark on this project, if he wants to do this I don't think people can tell him to go fix the current in-game stats before this project?

Besides, if and when these more advanced stats are in working order, maybe they could be integrated and replace the current stats?

by **Cuddles** » 20 Nov 2016, 21:04

your storage estimate will be way out of you don't included indexes...indexes often take up more storage than the data on tables with lots of rows.

by **JoonasTo** » 20 Nov 2016, 21:06

TheKoopa wrote:Honestly I think that the aftergame graph should be fixed to display properly before we make any addons

The current stats work perfectly. There are no bugs there as far as I can see.
If you're speaking of the NoData error, that's because there is no proper replay file from the game and possibly requires way different kind of fixing than stats.

by **KeyBlue** » 20 Nov 2016, 21:31

No data error also can be caused by leaving the game too fast.
There is apparantly a 3second delay for syncing the score at the end of the game.

Not sure if it is the only cause, but in my last couple of games, i only had no data whenever i went to the score screen immediatly.
(purely anecdotal evidence ofcourse)

by **Downlord** » 21 Nov 2016, 00:02

Let's do the calculation with a random sample.

I replayed a 18.5min Gap of Rohan. These were the resulting stats:

Spoiler: show

it contains how many of each unit were built, killed and lost, same for some unit categories, each per player, plus the total eco stats. It's ~20KiB or 2.5KiB per player.
Now there are of course different games with more/less player/time/units and the first 15min (until the game reaches T4) there would be fewer data than for 15min+ (where data stored per second stays +/- the same), but let's just assume this is the average.

If we wanted to store this data every 10s, we would produce a total of ~277.5KiB per game per player (ignoring the size of the replay). Multiplied by 2800 people-games results in ~758 MiB per day - producing 1TiB in about 3.5 years, ignoring all other data we produce. But then again, we can compress this metadata, maybe down to 1/4th of its original size which leaves us with 189MiB per day (additional replay data only) - so far within your estimation.

But let's calculate with more extreme values: A 60min 12 player games would produce a 12x60x6x2.5KiB = 10MiB replay file - with 2800people-games / 12player, this would be a total of 2.3GiB per day and, by the way, would cause all 12 players to upload 10MiB of data at the end of every game. For some, this can take quite a while.

To make a better estimation, we need to know what the average number of players and average game time is.

This forum is archived and read only.
Please move to the new forum!

Forged Alliance Forever

Next level FAF stats

Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Re: Next level FAF stats

Who is online

This forum is archived and read only.Please move to the new forum!

Who is online

This forum is archived and read only.
Please move to the new forum!