Training an unbeatable AI in Trackmania

12,680,575
0
Published 2023-09-30
I trained an AI in Trackmania with reinforcement learning, until I couldn't beat it.

I just opened a Patreon page, where you can support this YouTube channel with a donation (link below). Between research, programming and editing, these videos take a long time to produce. Any support will help me to spend more time on that in the future ! This one in particular took up most of my time over the last six months. I hope you like the result, and I'm open to any feedback to improve the quality of these videos :) I'll post more details on the Patreon page to explain what I plan to do next.
• Patreon : www.patreon.com/Yoshtm

If you want to try these maps, you first need to have both Trackmania Nations Forever (TMNF) and TMInfinity installed. Then, you can download the maps on Trackmania Exchange (TMX). Everything is free, and you can use the links below.
• TMNF : files.trackmaniaforever.com/tmnationsforever_setup…
• TMInfinity: unlimiter.net/download
• Download the maps on TMX : tmnf.exchange/tracksearch?query=author%3a+yoshtm

Contact
• Discord : yosh_tm
• Twitter : twitter.com/yoshtm1

Special thanks to Donadigo, for TMInterface !

All Comments (21)
  • @culleng.1653
    Showing the AI's multiple training runs simultaneously and color coded is one of the most gorgeous and elegant depictions of machine learning I've ever seen. Thank you for this video!!
  • @One_Stale_Donut
    Insane production value, the editing that went into this, and the time it must have taken.
  • @florrex4136
    That drift-overtraining and then training off the excess is a really interesting approach to let the Ai discover new mechanics👍🏻
  • @rafaelnubile
    Now we want a race between programmers to see who makes the fastest AI!
  • @Bassalicious
    This is nuts. The sheer amount of work involved boggles the mind. Such a well paced and chill presentation too, love it!
  • @darkranger116
    I always love these training AI videos. Its like the "wizard knows his apprentice will be more powerful than him one day, but only if he is guided there" vibe
  • @adkh2112
    As a an AI engineer who played lots of trackmania growing up i thoroughly enjoyed this video. Great editting too and great to follow your journey and thought process!
  • @JeffreyBoles
    This is the third Trackmania documentary I've watched on YouTube. I have never played Trackmania. I do not play racing games at all. Yet these docs are incredible!
  • The way you taught it to drift, then taught it to use drifting to go faster was brilliant
  • @RacetasClub
    What a magnificent video and what an incredible journey. This got me excited all over again. You sir took quality to a whole new level, you & the AI should both be very proud :)
  • @InTehFace1
    Really great work, and guys like you are going to be talked about in 10 years as the pioneers of training AI in various applications. Very inspiring
  • For the AI to be able to reintroduce its new isolated drift skill to its arsenal after the reward was removed is so cool to me. I feel like that is such a massive way to teach AI new skills. Doesn't that imply that you could isolate a thousand different skills, and then have the AI incorporate it all into something massive?
  • @plebiain
    I would unironically watch hours of you facing off against this AI on different maps to see what it does, please make more!
  • @johnbrooks6243
    Watching your own creation grown and outperform you has such a paternal feeling its amazing.
  • Thats so awesome. I remember watching these videos years ago, and being blown away by what you were doing - even with having never played the game. Now... You've taken it to an entirely other level. Its cool to see you're still at it. When someone puts that much passion into a game so old, it only means one thing - and thats the immense embracement of the time they've shared with the game, good and bad. It takes a rare breed to really bunker down and commit to something for so long, looking past all other options, and even the cons you will inevitably find over time, really just focusing on what it has brought you and all the time you have shared with it. Props my friend. Keep at it, and keep enjoying!
  • @Jb-db5kj
    This is absolutely incredible I can’t even imagine the work and frustration that went j to this.
  • I absolutely love the part where it becomes the drift king for optimal rewards. Just styling by doing micro drifts constantly.
  • @benslater4997
    16:19 I love how the Ai found a way to abuse the crap out of the reward system 😂
  • This was amazing, like watching a child start to walk then slowly just full sprint. I’m subbed from this video alone
  • @jed3269
    The edit and production is A1!! I loved the whole thing!