Project · 1 min read
AI Crofty
A realtime F1 23 commentator and race engineer that turns game telemetry into speech with OpenAI and TikTok TTS, with a Discord bot interface.
· TypeScript · AI/ML · Game Dev
- Year
- 2023
- Role
- Solo build
- Stack
- TypeScript · AI/ML · Game Dev
AI Croft- F1 Game Commentator that provides commentary in realtime
I built a pipeline that takes UDP packet data meant for steering wheels, converts it into TypeScript objects, then translates it into natural language with a tuned prompt that gets sent to gpt-3.5-turbo (finetuning in the future?). Finally, gets sent to Tiktok’s open TTS api, which is then ffmpeg'd and piped into a discord bot which controls settings and reports race results.
First demo was done in one night, then tested and tuned over a race league with my friends.
Full in-depth overview and open sourcing are my next steps.