Highlights of the Fireside Chat with Ilya Sutskever & Jensen Huang: AI Today & Vision of the Future

Xiao Yang
Xiao Yang
207,056
0
Published 2023-05-16
This is the condensed version of the "Fireside Chat: With Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future (March 2023)". In this video, I've carefully selected the top 10 questions from the original hour-long talk and condensed them into just over 30 minutes. Additionally, I've created a timeline of these questions asked by Jensen to Ilya, accompanied by relevant research papers. As machine transcription is often inaccurate, I manually transcribed the entire video (laborious), recognizing the importance of accurate captions for those with hearing difficulties. Anyways, you may find this information useful.

If you're interested in more AI-related content, consider subscribing to my channel. Stay tuned for future uploads!

Time-codes:

00:00:00 Q1. Intuition behind deep learning?
00:02:20 Q2. Initial motivations behind OpenAI?
00:07:54 Q3. Intuition about scaling laws (and RLHF)?
00:11:07 Q4. Aspects of ChatGPT and their abilities?
00:14:57 Q5. Major differences between GPT-4 and previous versions?
00:18:37 Q6. Reasoning capability of GPT-4 and limiting factors?
00:23:47 Q7. Importance of multi-modality?
00:28:53 Q8. How multi-modality helped improve GPT-4 over GPT-3?
00:30:46 Q9. Predictions for the next 2 years?
00:32:57 Q10. Surprising results?

Relevant research papers:

Learning to Generate Reviews and Discovering Sentiment
arxiv.org/abs/1704.01444

Scaling Laws for Autoregressive Generative Modeling
arxiv.org/abs/2010.14701

Training language models to follow instructions with human feedback
arxiv.org/abs/2203.02155
All Comments (21)
  • @XYang2023
    Thank you all for the comments. I hope Ilya is alright. From what I gather, he's supporting OpenAI's social contract, aiming to create safe AGI for everyone. The way he went about it may be open to discussion, but it highlights the importance of AI safety—a serious matter that shouldn't be overlooked. I also appreciate Ilya for sharing talks on LLMs, shedding light on how and why they work for those who are interested.
  • @var309
    hats off to Jensen. He’s the CEO of Nvidia but is giving all the spotlight to Ilya and doing an amazing job of asking thoughtful questions
  • @federicocucinotta7772
    "It may look on the surface that we are just learning statistical correlations in text, but it turns out what the neural network learns is some representation of the process that produced the text. This text is actually a representation of the world." So well explained.
  • @nownomad
    Founder and CEO of one of the most influential companies of our time is sitting there and interviewing someone. Jensen is something else. I wish I started watching his YouTube content earlier.
  • @MatthewMS.
    To see Jensen asking genuine questions is something. This guy just be important. So much incredible changes happening right now with the new technologies.
  • @FuyangLiu
    The more I listen to Ilya, the more I like about this guy 😅
  • @behthiansu
    Is it only me? I feel Llya looks like coming from another planet? The way he explains things slowly and patiently.
  • @user-hm8uw9yd1o
    My heart breaks knowing this highly intelligent, honest man is tied to some big egos with different intentions. It's so nice to listen to someone with deep knowledge of the subject they're being interviewed on.
  • @ZoOnTheYT
    These two guys arguably are making the most important contributions to humanity right now. Now to be fair, AGI or superintelligence may be our downfall, but that would still make it the most impactful thing on humanity. Huang's hardware and Sutskever's software/algorithms are bringing us into a new way of being in the World. It's kind of scary and exiting at the same time. Take a deep breath everyone, the AI wave is upon us!
  • @joaoguerreiro9403
    Ilya is one of my favourite computer scientists! This guys is a CS genius 🔥
  • @robfel68
    Everything Ilya does like drinking,speaking,sitting straight up freaks me out. Yet, i'm hypnotized and can't stop watching this man.
  • @stevereal-
    Great interview! Dude from Nvidia is so patience. Scientist are kind people for the most part. I’m glad they made this interview accessible for people like me.
  • @suryaseayes
    Through the ages people like Ilya have been pushing the frontiers of human intellect. It's great to be alive!
  • @y1.5
    After listening to Ilya feels like he is smarter than Sam Altman
  • @brianpalmer967
    This is the best interview I've seen from I.S. I haven't seen that many, but this one is fantastic, as he explains some of the key ideas going on in the background of LLMs in a beautiful, and personal way. He's sharing some of his hard-won wisdom with us.
  • @SiimKoger
    You can feel how passionate Ilya is about it. He isn´t doing it for money or fame and maybe not even betterment of society; he does it because it calls him.
  • @R0cky0
    It's very enlightening to hear these two talk, especially Ilya. Thanks for sharing
  • @sreekaranreddy7740
    The way ilya explains things is so interesting. The analogy at 17:50 is so well put together. Thank you Ilya for all your efforts for a greater future.