FAF is not reporting games correctly

This is for troubleshooting of problems with the FAF client and Forged Alliance game.

Moderator: PhilipJFry

FAF is not reporting games correctly

Postby FunkOff » 06 Sep 2011, 05:52

It's becoming increasingly evident to me FAF does not record ranked games correctly. Incorrect or non-reports are at least a quarter of all games, as best I can tell. As Zep has pointed out, there are numerous problems with the overly simplistic return that FA gives to the client and this, itself, is the cause of many problems. However, I have a rather novel solution to the problem:

Ask the player what the result of this game was.

Whenever the game client is closed, ask the player to report what happened, then have them click a button: Win, loss, draw, desync/disconnect. In the even both players pick the same thing, take that and compare it to the results to help improve the systems accuracy. If not, take the system-generated result as truth and note it as a disagreement. Keep records of the player's disagreement %.

This isn't a perfect system... players will lie... but this will improve accuracy above that of the current system. Again, this is because it will take players' word if they agree, and take the system word if they disagree. It is unlikely, because they have incentive not to, that any two players will willingly give false results that equal each other. At worst, this system will do what the present system does.

Zep, others, thoughts?
FunkOff
Supreme Commander
 
Posts: 1860
Joined: 26 Aug 2011, 17:27
Has liked: 14 times
Been liked: 42 times
FAF User Name: FakeOff

Re: FAF is not reporting games correctly

Postby Ze_PilOt » 06 Sep 2011, 08:17

A quarter of games seems really a lot.
I really want to know when it happens, just after the game if possible, and with the name of the opponent, the map and the excepted result. Otherwise it's nearly impossible to find the game in the logs :)

Saying that something is not working in the chat will *not* help me debug the thing. Chances are that I will not see that.
Tell me in PMs, on Aeolus or here !

Again, if something is not reported to me, for me it's working correctly ! That's why I'm suprised by you saying that 1/4 game are reported incorrectly !

I'm suprised because it should be correct like GPGNet now. Even they were errors pretty often in GPGnet too :)

- Non report
If someone doesn't disconnect, the server still think they are in game. The game will be reported after that person host a new game or relog to FAF.

- Incorrect results
Sadly, FA sends incorrect result a lot more than you can expect. I have some modifications ready in the lua for avoiding that. Didn't had time to test yet.
Nossa wrote:I've never played GPG or even heard of FA until FAF started blowing up.
User avatar
Ze_PilOt
Supreme Commander
 
Posts: 8985
Joined: 24 Aug 2011, 18:41
Location: fafland
Has liked: 18 times
Been liked: 376 times
FAF User Name: Ze_PilOt

Re: FAF is not reporting games correctly

Postby Moritz » 06 Sep 2011, 14:58

thats why I parse replays and have 100% correct results.
Moritz
Avatar-of-War
 
Posts: 175
Joined: 25 Aug 2011, 21:05
Has liked: 0 time
Been liked: 4 times
FAF User Name: Moritz

Re: FAF is not reporting games correctly

Postby Ze_PilOt » 06 Sep 2011, 15:05

I've looked at the game that doesn't get reported correctly, with the same result ..
I remember having these kind of problem on GPGNet too.
Nossa wrote:I've never played GPG or even heard of FA until FAF started blowing up.
User avatar
Ze_PilOt
Supreme Commander
 
Posts: 8985
Joined: 24 Aug 2011, 18:41
Location: fafland
Has liked: 18 times
Been liked: 376 times
FAF User Name: Ze_PilOt

Re: FAF is not reporting games correctly

Postby FunkOff » 06 Sep 2011, 18:22

Well, two games were reported incorrectly last night, here's the info:

5 september, Spindrah v FunkOn, Isis, (actual result) FunkOn win, no score update, no server score given in chat
5 september, Spindrah v Barry_Soetoro on Roanoake's, (actual result) both lost conn to each other, barry given defeat
FunkOff
Supreme Commander
 
Posts: 1860
Joined: 26 Aug 2011, 17:27
Has liked: 14 times
Been liked: 42 times
FAF User Name: FakeOff

Re: FAF is not reporting games correctly

Postby Reddev32 » 06 Sep 2011, 18:33

3v3 Twin rivers 06/09/2011 @ 16:30 Game start

Players,
Me, Miruzuki, Cobrand, Rae83, Leshaadv, Syava.

I killed 2 acus and Mir 1 kill Cobrand 1 kill
Reddev32 ~ Reddev GPGnet ~ Obliterating Wave ~ GPGnet ~ SC-Vanilla ~ FA ~ Supcom 2

GPGnet Vault
User avatar
Reddev32
Priest
 
Posts: 342
Joined: 26 Aug 2011, 17:59
Has liked: 0 time
Been liked: 3 times
FAF User Name: Reddev32

Re: FAF is not reporting games correctly

Postby Ze_PilOt » 06 Sep 2011, 19:45

FunkOff wrote:Well, two games were reported incorrectly last night, here's the info:

5 september, Spindrah v FunkOn, Isis, (actual result) FunkOn win, no score update, no server score given in chat


Found the game :

Code: Select all
09-06 03:39 FAGame SpinDrah -  DEBUG    Game outcome  : SpinDrah : Defeat, FunkOn : Victory,
TS 1vs1 Results
FunkOn : original score : mean=1832.8101, standardDeviation=79.1207
mean=1834.9080, standardDeviation=78.9146
SpinDrah : original score :  mean=1194.0154, standardDeviation=126.8680
mean=1188.6344, standardDeviation=125.4662
found players online

The game counts, result is correct, and the results are send. Must be a lobby problem.


FunkOff wrote:5 september, Spindrah v Barry_Soetoro on Roanoake's, (actual result) both lost conn to each other, barry given defeat


Code: Select all
09-06 05:08 FAServer     DEBUG    SpinDrah Vs Barry_Soetoro
DEBUG    SCMP_020

TS 1vs1 Results
SpinDrah : original score : mean=1154.0502, standardDeviation=118.0903
mean=1217.5564, standardDeviation=113.4244

Barry_Soetoro :original score : mean=1592.7303, standardDeviation=86.0205

mean=1558.9799, standardDeviation=84.3348

found players online
Game finished - Removing game


Correct too. Barry_Soetoro disconnected from the server, but spindrah stays, so the game count as a loss for Barry_Soetoro. (otherwise, it's easy to pull the plug to avoid a defeat)
Nossa wrote:I've never played GPG or even heard of FA until FAF started blowing up.
User avatar
Ze_PilOt
Supreme Commander
 
Posts: 8985
Joined: 24 Aug 2011, 18:41
Location: fafland
Has liked: 18 times
Been liked: 376 times
FAF User Name: Ze_PilOt

Re: FAF is not reporting games correctly

Postby FunkOff » 06 Sep 2011, 19:50

Are you sure about the barry vs spindrah game? I was watching the replay, and when the game DCed I checked chat and both players were there. Barry told me he ejected Spindrah in the in-game connection manager after 1 minute, Spindrah said he did the same after 1 minute and 5 seconds.
FunkOff
Supreme Commander
 
Posts: 1860
Joined: 26 Aug 2011, 17:27
Has liked: 14 times
Been liked: 42 times
FAF User Name: FakeOff

Re: FAF is not reporting games correctly

Postby Ze_PilOt » 06 Sep 2011, 19:52

I'm pretty sure.

Here is the log of Barry disconnection :

Code: Select all
09-06 05:20 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:20 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '5829.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '11829.5']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '17698.6']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '23095.8']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '29095.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '35095.4']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '41095.2']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '46261.8']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '51675.1']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '56675.1']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['Bottleneck']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [['ack', '6612', '354', '62674.7']]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['BottleneckCleared']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [[]]
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    ['GameResult']
09-06 05:21 FAGame SpinDrah - thread(139642811934464) Game (<ladder.ladder.ladderGame object at 0x2157cd0>) DEBUG    [[2, 'defeat']]


Bottleneck is connection problem (packet not received).
I can check but I'm sure that player 354 is Barry.

Then the cleared (kick out of game), then SpinDrah send Barry result (defeat).
Barry never sent a Bottleneck or a result, so the server is taking SpinDrah as the only one in game.
Nossa wrote:I've never played GPG or even heard of FA until FAF started blowing up.
User avatar
Ze_PilOt
Supreme Commander
 
Posts: 8985
Joined: 24 Aug 2011, 18:41
Location: fafland
Has liked: 18 times
Been liked: 376 times
FAF User Name: Ze_PilOt

Re: FAF is not reporting games correctly

Postby FunkOff » 06 Sep 2011, 20:00

Oh okay. Hmm. Can you please add an in-game notification for disconnects? Perception is a big deal... Barry and Spindrah both thought FAF just messed up (and I sort of did too) because neither of them got warning and Barry certainly did not get a notice that he was having connection troubles. If he did, at least it would help him understand that the system was not simply being unfair.
FunkOff
Supreme Commander
 
Posts: 1860
Joined: 26 Aug 2011, 17:27
Has liked: 14 times
Been liked: 42 times
FAF User Name: FakeOff

Next

Return to Tech Support

Who is online

Users browsing this forum: No registered users and 1 guest