AI-based Virtual Race Engineer incl. Pitstop Handling

Another big step for the Assistants: If they are connected to a GPT service, the LLM can now trigger any action inside Simulator Controller. A handful of actions are predefined and you can define your own ones, but this requires some serious technical skills.



Actions can be triggered as a result of your conversation with the Assistant, but the LLM can also decide to trigger an action on its own.

I will now have a summer break. Supoort and minor functional additions will be secured during this time, but since no on-track testing is possible until end of July, there will be no major updates.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-576
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

The big, fat summer release is here. Three major changes are waiting for you to explore.

1. It is now possible to integrate an LLM using an external GPT service into the reasoning process of the Race Assistants. This will potentially make them much smarter in handling unforeseen situations and you can define your own types of events and actions to be executed by the LLM.



2. Full support in all applications for a very nice looking dark UI theme.



3. The documentation has been extensively reorganized, rewritten and extended. Details can be found in the Release Notes.

We will have a live seminar / coaching session for the new LLM capabilities in our Discord on 29th July at 19:00 CEST. Don't miss that.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-580
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

This week we made a lot of small improvements to the recently introduced features. Of particular note is the advanced handling of pit stop situations through an LLM, including a comprehensive understanding of the available tire compounds and their use for different weather conditions. Additionally, the event and action editor UI has been improved in many aspects.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-581
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Release 5.8.2 brings more events and actions for the GPT / LLM integration for the Assistants. Additionally, the "Practice Center" and the "Race Center" will now save a recorded session to the session database, from there it can be shared with your team members or your crew chief or coach for evaluation. And the release contains a new, fully rewritten runtime for local LLMs.

As an addition, I have a TL;DW recording from our latest coaching session in our Discord for you. It as an 1-hour trip into the rabbit hole of using GPT-based large language models to boost the intelligence and extend the capabilities of the Race Assistants.



--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-582
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Release 5.8.3

14 majors changes and additions are part of this release. A couple more events for the LLM integration, a browser for sessions stored in the session database and - most notably - a new, simplified UI for the "Race Center". Details can be found in the Release Notes.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-583
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Lots of new stuff this week:

1. Non-circuit tracks like Rally stages, hill climb tracks and even street roads can now be mapped correctly. After you gut a track map, you can use Track Automations to create pace notes, or automate car settings depending on track position.



2. Many new events and actions for the LLM integration are provided for Spotter. One of which enable you to automate actions like saving the replay after a pitstop or at the end of the race.

3. The local LLM runtime now supports non-Nvidia GPUs using the Vulkan driver.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-584
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Beside several important bug fixes, we have two major changes this week:

1. If you have configured an LLM to boost the intelligence of the Race Assistants, it si now possible to let the Assistants collaborate on a given task. Example: The Spotter recognized that your direct opponent ahead is pitting. The LLM can then trigger an action, which informs the Strategist by an event, so that he will check the strategy and probably call you to the pit as well. Addionally this release once again comes with several new predefined events and actions for the LLM integration.

2. You can now open almost any report in the "Practice Center" in a separate window. This makes it easier to compare laps and other important data. This feature has already been around in the "Race Center", but is now available for the "Practice Center" as well.



--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-585
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

This time I renamed two applications. "Practice Center" has become "Solo Center" and "Race Center" has become "Team Center", which reflects much better, the purpose and scope of these applications. The "Solo Center" got a lot of love in the area of tyre handling and we have a new LLM event for the Spotter.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-586
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

This week we have a couple of fixes for AMS2 and R3E as well as a rework of the muted mode of the Assistants and some improvements for the "Strategy Workbench".

Additionally, a critical bug has been fixed for "Solo Center" and "Team Center" which results in saved sessions having the wrong file extension, which made them useless. All those sessions will be recovered automatically.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-587
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Today we introduce a new data category in Simulator Controller. Car telemetery data can be collected lap by lap in the "Solo Center" and can be stored in the session database, thereby sharing them with your team or even with the whole community. Telemetry data can be compared, for example to find out why a lap was slower then the best reference lap.



Future releases will integrate this feature also into the "Team Center", so that you can view the telemetry data of your team mate in real time and in the long run, the AI of the Driving Coach will have a full understanding of this data and will be able to discuss areas of improvement with you.

Beside that, lap times and sector times have been fixed for RaceRoom Racing Experience.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-590
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

Thanks to @diego Falcone Dev_Dk HawkOne we introduce today the full support for the Italian language inc. conversation with the Assistants.



Beside that, we have many improvements for the new telemetry support, incl. integration for the "Team Center". And the internal database engine got a substantial performance boost, which benefits all applications. Take a look at the Release Notes for detailed information.

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-591
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6

 

I have no doubt its a great tool but i have no clue how to just get it started. I mean of course there is a so called simulator startup, secondary applications from there ( are they mutually exclusive as they say ?). But for example the only way i could have the assistant hearing and answering was via an arrow button ( like the standard play icon ) on a voice control tab of an app called simulator configuration.

There must be another way. I mean i must, its not an option, probably choose somewhere to tick the option control that ask wether i wan't to start this simulator (rf2), i can't find it anymore, to start rfactor 2

Because what you call simulator startup is not what you mean by simulator which is the particular game your tool will interact with.
I mean to start your tool we launch simulator startup but thats your tool that we start up...

To rephrase another way, do i have to independtly start the game or do i have to enforce your tool to start it somewhere.
Right now the assistant here me while ingame, answer simple question ( i though have to change my mic because when the sound of the game is at a decent level, its difficult to interact with assistant that is as deef as me...)

I know RTFM etc but i won't read 500 pages just to make it start.
I'm sorry for the dumb question, i'm ready to erase my post after your answer.

Solo center for exemple doesn't seem to work. I launch it then start rf2, do a race, close rf2 and look at the dialog... that stay the same as before the so called session.
Setup workbench work well after having allowed connexion to get google chart library.

 

Hi, no problem at all, and please don't delete your post. I know, that this suite is not easy to master. That is to some extent the price for the depth of functionality. Anyway, I try to answer some of your questions:

1. "Simulator Startup" is your central dashboard, from where you start all other tools and processes. Special is here the green "Play" button which you have to click before you enter a session in your simulator.

2. Yes, you can configure that the sim is started automatically together with all the Simulator Controller stuff, when you click on the "Play" button, but you can also start it independently.

3. On the other hand, the small gray "Play" button in "Simulator Configuration" or "Simulator Setup" is a tool for testing your configuration. It starts 2 Assistants, you can interact with, but they do not connect to a sim. Used to test out your voice control configuration.

4. Interacting with the Assistants need a proper voice configuration (see 3.) and of course you need to know the available commands (can be found in the Wiki).

5. Tools like the Solo Center and Team Center use the data, the Assistants collect while you are driving. So you won't see anything, if the Assistants are not running ("Play" button). You can mute the Assistants, if you are only interested in the data.

This suite is huge, very huge, definitely not a simple tool for the weekend race. And if you want to master it, you will have to read at least some of the documentation. I recommend starting with "Using Simulator Controller", it answers many of your questions.

And come over to our Discord. You will get instant help there usually.

 

Do you mean by the green play the icon of the simulator startup application or the one we find once fired labeled startup standard ?
Once i start simulator startup its good to go then?

Ok as for voice recognition i saw yesterday that there are two engines, plus online services, i probably use the wrong one, windows engine which can be adapted to your voice but is more troubled by noise, the other called microsoft engine is more robust they say.

thx for your answers

 

"Simulator Startup" is only the control panel, from where you start everything. You must click there the green "Play" button with "Startup Standard" beneath. By the way, if you click the small cog wheel inside the "Play" button, you can configure the whole startup process and configure what to start.

Voice Recognition:

1. "Windows Server" is an engine targeted for telephone line quality. Very forgiving to noise, but the recognition quality is not that good.
2. "Windows Desktop" has a good recognition quality but needs a "quite" environment. Best with headset.
3. Azure and Google - best of both worlds.

I highly recommend using Azure. With the free contingent available I never paid a penny.

 

Alright, i'm dumb sometimes, i thought this was a basic configuration start up that would have overriden the carefull manual configuration i did before. Thank you very much, clever idea to use AI for that and great skills to make it happen !

Though why do i have to permanently lower security for setup workbench to access each and everytime a google library for bar charts ? You use cdn or something like that ? Why not bundling it with the app ?

 

The Google Chart Library is a Javascript package that is run in a browser plugin. It must be included using an URL.

But: If you have run "Simulator Setup" and have unblocked the DLLs and Apps, the registry key must have been set and there should be no more security alerts on your side.

 

3 new channels have been added to the telemetry data system and telemetry is now also available in the "Setup Workbench" during setup development. Last but not least, an integration with "Second Monitor", a sophisticated telemetry tool has been finished with the kind support of @winzarten.

A critical bug has been fixed for iRacing, which prevented the Spotter from alerting about nearby cars.

Infos about additional changes can be found in the Release Notes.

We will have a live coaching session about all the new stuff on Monday, 19:00 CEST in our Discord. Feel free to join...

--------------------------------------------------------------------------------------------------
Download: https://github.com/SeriousOldMan/Simulator-Controller#latest-release-build
Release Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Release-Notes
Update Notes: https://github.com/SeriousOldMan/Simulator-Controller/wiki/Update-Notes#release-592
Discord Server: https://discord.gg/5N8JrNr48H
Become a Patreon: https://www.patreon.com/simulatorcontroller
Support the project: https://www.paypal.com/donate?hosted_button_id=7GV86ZPS95SL6