[WIP] League Streamers: AI broadcast director with live-generated commentary - need testers

thoraxe

thoraxe

Registered
Hi there,

With help from @Tnadz and others at CMS Racing, I am working on an AI-powered broadcast director that features live-generated commentary. This is kind of like the rF2tv application, but with a tremendous number of improvements, including the ability to generate broadcast commentary in real-time. It also has some support for using the Elevenlabs cloud service for generating much more lifelike voices.

Please DM me if you are interested in testing this. You don't need an Elevenlabs subscription for testing - the commentary can be generated 100% locally.

This software runs on the same computer that you would run your spectator rF2 client and uses two rF2 plugins: the existing Iron Wolf one that most apps like CrewChief, Tinypedal, and others use, and an additional plugin that I've developed.

For an example of the generated commentary, please take a look at the following CMS broadcast:

If you hop forward towards the race, you can find commentary.

I'm actively developing this application with a plan to support it via sales on Steam, but it will additionally be open-sourced under an MIT-FSL license for those who wish to build it from source themselves.
 
I've continued to develop my broadcast director and commentary app. You can watch it in action here:

  • automatic camera control tracking interesting battles
  • automatic instant replay supporting OBS scene switching hotkeys
  • automated commentary about what's on camera, including commentary about things happening off camera
  • uses a TTS engine that supports voice cloning on CPU, but supports using the ElevenLabs API for even more voices
and more features coming every day! I'm looking for additional beta testers for rF2 and LMU
 
Coutie said:
Do you use the crew chief distance call outs to do the voice lines?
Click to expand...
There is no code from CrewChief's app in here, but we do use IronWolf's shared memory plugin. Some code is inspired by Crew Chief's features, and both CrewChief's and TinyPedal's codebases were examined for "how do they do X?", but neither program is directly used by BattleDirector.
 
What We've Been Shipping

BattleDirector has been in active development for a while now, with over 1,100 fixes and improvements shipped. The core experience: picking the right car to watch, cutting to the right camera, triggering replays, and calling the action is solid and production-ready.

What's Coming Next

The commentary is getting a major overhaul.

Right now, it's pretty good at calling what's happening in front of you. What we're building toward is commentary that actually understands the race [who's under pressure, who's sandbagging, what the strategy situation looks like...] and talks about it naturally, the way a real broadcast would.

The goal is that it stops feeling like a system reading off events and starts feeling like there's someone in the booth who's been watching the race.

After that lands, expect more variety, better timing, and smarter reactions to what's unfolding on track.

The Boring (But Important) Stuff

We're also wrapping up a batch of reliability fixes before the big work begins. Things like commentary not stepping on itself, cleaner replay handling, and pit detection edge cases. The kind of stuff you don't notice when it's working right.

Want In?

This is a private project right now during the beta. If you're interested, DM me, and I'll get you into the Discord.
 
You must log in or register to reply here.
Back
Top