Tester team

Talk about general things concerning Forged Alliance Forever.

Moderators: FtXCommando, Ze Dogfather

Tester team

Postby keyser » 04 Feb 2016, 12:28

Hello everyone,
I will give you my opinion about what to improve after yesterday.

linked to this topic too : viewtopic.php?f=42&t=11637

There is 2 choices (imo) :

either raise people awareness about change like this one.
- Make Big Yellow text in aeolus asking people to test beta thing..
- Ask caster to spread the information about testing beta.....

either make a tester team : (this is something that i want to be done since quite sometime to be honest)

Why a tester team would be more useful than using the community ?
Because tester know their shit, they will write proper report, have a better organization....
atm the only "tester team" is for the balance team, we are 2-3 guys. We have a good organization, are fast (little lazzy though), and we don't require much more people because we don't need to rush balance patch that much. (it's already going at a decent rate)

So, I'm thinking about a "tester team" of 10 to 20 persons (not sure about exact number).
=> a good organization : proper chat for them, part of the forum, excel table, proper tools for testing (ex : http://content.faforever.com/patchnotes ... lator.html)
=> efficient guys : been "trained" to not waste time for their test (= know how cheat works, can do test on their own, tips to be faster...); doing proper report (with brief description, logs and replay) on tech forum + repost on github with linked to the topic on the tech forum.
=> about minimum rating : i'm not sure it's necessary, as long as only good/top player do balance test. The other test require less "skill".
=> more recognition about them (as BH said viewtopic.php?f=42&t=11637#p119097). Give them avatar, make them as a real part in contributor.

What to test ?
Server change/patch, client patch, faf beta patch, faf balance patch...
tracking bug in actual game is more tricky, but tester team will know what to do when they find one.

This would help so that patch aren't release later because of lack of testing. The slowing factor should be coders.

i've already some name idea :
ZLO (doesn't have time i guess), petrick (too lazyi guess), me, nojoke, giebmass.....
Zockyzock:
VoR is the clan of upcoming top players now
keyser
Councillor - Game
 
Posts: 1870
Joined: 17 May 2013, 14:27
Has liked: 424 times
Been liked: 540 times
FAF User Name: keyser

Re: Tester team

Postby Aulex » 04 Feb 2016, 14:32

Call it the QA team
"Let's start beating ass and die" - drunk TA4Life

"Just because you have a d*** doesn't mean you need to be one...pussy" -Blackdeath

SCOUTING SAVES LIVES
http://imgur.com/YGk0W0o

How to play Sup Com by Ubilaz
http://goo.gl/je83z
User avatar
Aulex
Contributor
 
Posts: 1050
Joined: 17 Nov 2012, 05:29
Has liked: 299 times
Been liked: 225 times
FAF User Name: VoR_Aulex

Re: Tester team

Postby Luminareo » 04 Feb 2016, 15:08

Luminareo
Crusader
 
Posts: 15
Joined: 09 Dec 2014, 08:30
Has liked: 3 times
Been liked: 1 time
FAF User Name: Luminareo

Re: Tester team

Postby yorick » 04 Feb 2016, 22:12

you can put my name on the list as well if you want. i know a bit of the client code and tiny bits of the games lua code (just scratching on the surface), but i never made any greater debugging/testing attempts ( apart from trying to fix my own code :) )
To clarify this team is meant to test both client(/server) and game stuff ?
yorick
Avatar-of-War
 
Posts: 113
Joined: 01 Oct 2014, 02:53
Has liked: 16 times
Been liked: 27 times
FAF User Name: yorick

Re: Tester team

Postby Downlord » 04 Feb 2016, 23:21

The QA team should be the one to give green or red light before any release.
Developers should never be allowed to deploy without QA permission.
The QA team must not contain a developer.

Separation of powers
Working on FAF is my passion. Most of you know me for the feature-rich Downlord's FAF Client, but I also program and maintain the FAF server. Visit my Patreon page to get some insights on my work.
Downlord
Councillor - DevOps
 
Posts: 226
Joined: 14 Jul 2013, 14:55
Has liked: 161 times
Been liked: 213 times
FAF User Name: Downlord

Re: Tester team

Postby IceDreamer » 04 Feb 2016, 23:45

Downlord wrote:The QA team should be the one to give green or red light before any release.
Developers should never be allowed to deploy without QA permission.
The QA team must not contain a developer.

Separation of powers


This cannot work in a small, community driven project like this. Sometimes, the developers might have fixed something small. Something that simply cannot have gone wrong. Such as changing a typo in a string, or adjusting an icon type, etc. These kind of things could be done, pushed, a deployed with nobody really noticing come a new patch system which doesn't require huge downloads every time, or even with the current one for things like the game beta.

People aren't online 24/7. Don't slow the devs down any more than they already are by given them yet another layer of red tape to navigate.
IceDreamer
Supreme Commander
 
Posts: 2607
Joined: 27 Dec 2011, 07:01
Has liked: 138 times
Been liked: 488 times

Re: Tester team

Postby Downlord » 04 Feb 2016, 23:55

Let's not focus on the tiny edge cases but on the big picture. If it's a typo, surely you don't need the QA team.
But I'll remind you of that when the first developer who "just fixed a typo" accidentally also committed something else and break things.

Believe me, I've seen too many quick-fixes-in-production-bypassing-QA-because-it-cannot-break-anything gone wrong.
Working on FAF is my passion. Most of you know me for the feature-rich Downlord's FAF Client, but I also program and maintain the FAF server. Visit my Patreon page to get some insights on my work.
Downlord
Councillor - DevOps
 
Posts: 226
Joined: 14 Jul 2013, 14:55
Has liked: 161 times
Been liked: 213 times
FAF User Name: Downlord

Re: Tester team

Postby Sheeo » 05 Feb 2016, 00:00

Downlord wrote:Let's not focus on the tiny edge cases but on the big picture. If it's a typo, surely you don't need the QA team.
But I'll remind you of that when the first developer who "just fixed a typo" accidentally also committed something else and break things.

Believe me, I've seen too many quick-fixes-in-production-bypassing-QA-because-it-cannot-break-anything gone wrong.


Indeed ;)
Support FAF on patreon: https://www.patreon.com/faf?ty=h

Peek at our continued development on github: https://github.com/FAForever
Sheeo
Councillor - Administrative
 
Posts: 1038
Joined: 17 Dec 2013, 18:57
Has liked: 109 times
Been liked: 233 times
FAF User Name: Sheeo

Re: Tester team

Postby EcoNoob » 05 Feb 2016, 00:05

Well I'd like to help out here, since helping on the programming proved to be too hard ;)
EcoNoob
Avatar-of-War
 
Posts: 238
Joined: 20 Nov 2015, 22:05
Has liked: 155 times
Been liked: 70 times
FAF User Name: EcoNoob

Re: Tester team

Postby theeggroll » 05 Feb 2016, 01:17

Volunteering
GMT - 6 http://spooky.github.io/unitdb/#/
When in doubt, Blame Gorton
User avatar
theeggroll
Priest
 
Posts: 442
Joined: 22 Dec 2014, 23:57
Has liked: 228 times
Been liked: 98 times
FAF User Name: theeggroll

Next

Return to General Discussions

Who is online

Users browsing this forum: No registered users and 1 guest