AI Croft- F1 Game Commentator that provides commentary in realtime
I built a pipeline that takes UDP packet data meant for steering wheels, converts it into TypeScript objects, then translates it into natural language with a tuned prompt that gets sent to
gpt-3.5-turbo (finetuning in the future?). Finally, gets sent to Tiktok’s open TTS api, which is then ffmpeg'd and piped into a discord bot which controls settings and reports race results.First demo was done in one night, then tested and tuned over a race league with my friends.
Full in-depth overview and open sourcing are my next steps.
Demo (Funny Moment)
