Race Engineer - You are NOT alone on track [WIP]

Discussion in 'Other' started by GauchoRS, Sep 22, 2013.

  1. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    I would like to share my experience with speech recognition and a simulated dialog with an virtual race engineer in rfactor2.
    Using GlovePIE you can really talk to your mate in the pitstand and ask him
    - for modifications in pitstrategy
    - get motivational words from him
    - earn more or less sarcastical randomly changing answers
    - invoke overlays like as HUD, pit menu, trackmap
    - as admin invoke/revoke the safety car with your voice
    ....

    You will never feel alone on the track anymore.....



    OBS.:
    GlovePIE will not receive any data from rFactor2. So infos like car position, race state or car status will not be processed ....
    UNTIL somebody will do the necessary work with the internal plugin interface. Come on programmers, get your hands on.

    Here you may study how it works and which commands will be available
    View attachment 10024

    PLEASE print this documentation on paper and READ (mostly the first page) !!

    ________________________________________________________________________

    Now its YOUR turn. Try the WIP version as it is. Any constructive annotation welcome. HAVE FUN !@!

    How to install/use:

    1. Extract the contents of the zip archive on any partition

    2. Open the folder ``GlovePIE`` and run ``FreePie.exe``

    3. Open the rF2_race_eng_V.081 script in /GlovePIE/Voicescripts

    4. Verify if you can use Joystickbutton.8 for Speech Recognition or moidify it in script. If you want to change the name of your race eng. modify ``Hi Sam`` line.

    5. click on RUN
    to verifiy the recognized voice commands switch on
    ``Show Speech Recognition Progress`` under tab ``TroubleShooter``


    6. Use joystickbutton8 to start speech recognition.
    You must hear a bleep and radio background shutter fo about 3 seconds.

    7. Keep joystickbutton8 pushed and say ``Hello box`` or ``Hi Sam``
    Have a look to the Debug window, may be you must repeat it some times.
    You should get a random answer from pitcrew stuff.


    8. Go through the documentation and try some other commands
    Are you satisfied with speech recognition?
    If not, try to train your windows speech recognition

    Sometimes it helps if you repeat so say ``Voice ON``

    9. If all is going fine, you may start your rFactor2 and modify/set the keystrokes
    mentioned in the documentation

    10. Go to track (Race button) and try to ``talk to your race engineer``


    Dowload here:
    https://docs.google.com/file/d/0B7qlqZM1cmwVSUNsNHRmbndqQWM/edit?usp=sharing
     
    Last edited by a moderator: Sep 23, 2013
  2. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    Love this idea, I look forward to trying it :D
     
  3. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    First version of documentation added in first post
     
  4. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    WIP version 0.8.1 added
     
  5. elbo

    elbo Registered

    Joined:
    Feb 19, 2012
    Messages:
    625
    Likes Received:
    182
    Nice work. This seems like it will be a natural fit for racing with the oculus rift.
     
  6. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    I am getting no audio, speech recognition is picking up commands, but nothing is being output to my headphones
     
  7. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    please verify if you opened the ENGLish version script: rF2-race-ing-ENGL-V-0-81.PIE
    there are other scripts (german language etc.) which will not work

    do you hear the ''bleep'' and 3 sec radio shutter if you press your joystickbutton(8) ?
     
  8. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    Yup English version, and no bleep or or 3 secs of radio static when I press JB 8
     
  9. elbo

    elbo Registered

    Joined:
    Feb 19, 2012
    Messages:
    625
    Likes Received:
    182
    make sure you are loading rF2-race-ing-ENGL-V-0-81.PIE and not rF2-race-ing-ENGL-V-0-8.PIE because the latter has an error and points to GlovePie\WAVES-DEUTSCH instead of GlovePie\WAVES-ENGL
     
  10. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    Yes that is the one I am loading,
     
  11. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    do you click `Run` to start the script?
    do you keep JB8 pressed
    are your commands recognized ? *(do you see words recognized in Debug window?)
     
  12. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    Yes to all three questions.
     
  13. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
    mmmh, no more ideas ... sorry
    if you want more help, write me a PM to combine a TEAMVIEWER session
     
  14. Knight of Redemption

    Knight of Redemption Registered

    Joined:
    Jun 23, 2012
    Messages:
    881
    Likes Received:
    56
    It's okay I'll wait for the release version, if I still have problems then we will look deeper. I will play around some more and see if I can get to the root of it.
     
  15. GauchoRS

    GauchoRS Registered

    Joined:
    Nov 23, 2011
    Messages:
    471
    Likes Received:
    9
  16. Rizashi

    Rizashi Registered

    Joined:
    Aug 6, 2013
    Messages:
    3
    Likes Received:
    0
    This would be awesome with the Rift as I obviously can't see any button box :)
    Great idea! Will try this out tomorrow.
     
  17. elbo

    elbo Registered

    Joined:
    Feb 19, 2012
    Messages:
    625
    Likes Received:
    182
    I get this error because I am using Open Track. If I start Open Track first then GlovePIE second, the error appears. The work around is simple in my case; I open GlovePIE first then Open Track and everything is fine.

    Don't know if it is the same for you.
     
  18. Mr.Thor

    Mr.Thor Registered

    Joined:
    May 25, 2013
    Messages:
    244
    Likes Received:
    48
    Hi, i have just tried GlovePie. But it doesn't work for me.
    I installed like in post 1. opened ...ENGL-v-0-81.pie and pressed run. in debug window i can see that it recognizes "hello box" but i don't hear anything.
    also when i pressed button8 or anything else on G27 wheel. I tried with button4, but also no bleep or anything else.
    is my wheel really joystick1 ??? how i can find out, which one it is? it's the only wheel or joystick which is connected on any usb-port.
    any ideas?
     
  19. Mr.Thor

    Mr.Thor Registered

    Joined:
    May 25, 2013
    Messages:
    244
    Likes Received:
    48
    No ideas?? Or are you working on updates?
     
  20. Robert Gödicke

    Robert Gödicke Registered

    Joined:
    Oct 5, 2010
    Messages:
    409
    Likes Received:
    11
    I found the solution to why some of you guys probably can't hear any sound at all.
    In the script, I had to edit the file locations in all lines which included the "Playsound" command.


    Here is an example:

    Playsound ("\GlovePie\WAVES-ENGL\bleep.wav")

    needs to be

    Playsound ("WAVES-ENGL\bleep.wav")

    for me to work.


    HERE'S an already edited file you can download and replace the original with (it's located in your "GlovePIE\VoiceScripts" folder).

    If you won't hear the loud beep now when pressing the Button #8 (on a G27, it's the button on the wheel on the upper left, for example), you may want to edit the "joystick1.Button8" in line 26 and line 31 to "Joystick.Wheel.Button8".

    Hope this helps.


    Greez Rob
     

Share This Page