IDEA - Replay - Cast Syncer

Everything about mods can be found here.

Moderator: Morax

IDEA - Replay - Cast Syncer

Postby Androish » 24 Apr 2016, 05:30

One thing I always feel I want to do while watching a cast is to zoom around and watch stuff.
If you have 2 screens you can do that, watching a cast on one screen and running the rerplay on the other. But the problem is syncing the replay with the cast

So I was thinking if you had a script to use Optical character recognition on time of both the youtube video and the replay, and compare them
And based on whoever is ahead, make the game either +1 or -1 in speed(or more but one inclination every check)

I found a Possible candidate for OCR engine, it is based on autohotkey so it should be possible to do some tricks with autohotkey
http://capture2text.sourceforge.net/ I did a quick test with it and it seems to be working, I dont know if it works flawlessly every time however(did not check multiple times)

It has option to output to Clipboard, not sure how easy it is to use that... But I assume it is possible to act on it directly instead, if we look into the source code(a autohotkey script)

I might just try this on my own because it seems like a fun challenge to get it working. But I am afraid I might be lacking in coding skills to be able to get it to work.

As far as I see the problem will be to easily collect the 2 values that need to be collected, the comparison of the two and the following actions to preform should be fairly trivial in autohotkey. And if it is to be used by more people it needs some kind of UI to say what part of the screen to be collected(for my own needs it can be hard coded :P).

If anyone that is a competent coder wants to do this please feel free to do so :) I will probably try myself if no one voulenteers
Androish
Avatar-of-War
 
Posts: 115
Joined: 18 Mar 2013, 23:40
Has liked: 9 times
Been liked: 14 times
FAF User Name: Androish

Re: IDEA - Replay - Cast Syncer

Postby nine2 » 24 Apr 2016, 06:01

Ambitious
nine2
Councillor - Promotion
 
Posts: 2416
Joined: 16 Apr 2013, 10:10
Has liked: 285 times
Been liked: 515 times
FAF User Name: Anihilnine

Re: IDEA - Replay - Cast Syncer

Postby Crotalus » 24 Apr 2016, 15:07

Time would be better spent adding support in the FAF client to save down the camera movement / microphone audio-stream when someone is casting a replay and then send it to the server so it can available when watching a random replay. Then FAFers don't have to use youtube at all when watching casts.

One obvious problem is if the casters computer is faster (probably a common case?) than the one watching, would have do some time stretching of the audio stream in that case. I guess it could sound funny late game ;) Optimal would be to pad some extra silence when there is no output already.
Crotalus
Priest
 
Posts: 319
Joined: 27 Jan 2013, 20:37
Has liked: 2 times
Been liked: 102 times
FAF User Name: Crotalus

Re: IDEA - Replay - Cast Syncer

Postby Androish » 24 Apr 2016, 17:21

Problem with just collecting the audio stream is that you don't get to see the casters point of view, witch is quite essential sometimes.

The problem with late game is also something I did think about. But did not see any easy solution to. It will defietly be a problem for people with slower computers than casters lategame.

I checked you can indeed slow down youtube vids! Only problem is all casters will sound reetarded at 0.5x speed :D 0.75 works pretty OK tho. so that may give some leeway for a bit slower computers!

But that is a possible sulution!
Androish
Avatar-of-War
 
Posts: 115
Joined: 18 Mar 2013, 23:40
Has liked: 9 times
Been liked: 14 times
FAF User Name: Androish


Return to Mods & Tools

Who is online

Users browsing this forum: No registered users and 1 guest