I Built a CoPilot+ AI PC (without Windows)

299,818
0
Published 2024-06-04
Raspberry Pi AI enters the chat.

The new AI Kit is $70 and you can find more on Raspberry Pi's website: www.raspberrypi.com/news/raspberry-pi-ai-kit-avail…

Full disclosure: Raspberry Pi sent the AI Kit I've been testing for this video—they did not sponsor the video nor did they have any input into the content of this video (or a chance to review it before it was published).

Some of the things I mentioned in this video:

- Frigate NVR video:    • I Spy, with my Little Pi...  
- Hailo AI: hailo.ai/
- Google Coral TPUs: coral.ai/
- Pineboards (the HATs I used): pineboards.io/
- Tam Hanna's video on the AI Camera:    • Raspberry Pi AI Camera - hands on, an...  
- Alftel 12-slot M.2 PCIe expansion card: pipci.jeffgeerling.com/cards_m2/alftel-12x-pcie-m2…
- My Pi PCI Express Database site: pipci.jeffgeerling.com/
- Hailo examples for Pi 5: github.com/hailo-ai/hailo-rpi5-examples
- Raspberry Pi AI Kit docs:
www.raspberrypi.com/documentation/accessories/ai-k…

Support me on Patreon: www.patreon.com/geerlingguy
Sponsor me on GitHub: github.com/sponsors/geerlingguy
Merch: redshirtjeff.com/
2nd Channel:    / @geerlingengineering  
3rd Channel:    / @level2jeff  

Contents:

00:00 - Total Recall
00:33 - Raspberry Pi AI Kit
01:05 - AI AI oh.
01:38 - Cameras
02:59 - AI architecture
04:22 - YOLO (and other Demos)
06:04 - LLMs and Generative AI
06:28 - 51 TOPS attempt - the build
09:42 - No magic smoke!
11:02 - Any other way?
11:49 - Other AI options (that are actually useful)

All Comments (21)
  • @JeffGeerling
    0:53 - My brain must've been turned off when I was making that slide. The Coral does 4 TOPS, not 2. And the Hailo-8L is more like 3-4 TOPS/W, not the 8 I put in the slide. Sorry about that, wish I could edit that bit in the video but YouTube doesn't have any mechanism to allow it! Thanks to @thijsp for pointing out my glaring mistake! Good night, I'm getting some sleep—it's morning in the UK, middle of the night here ;)
  • @kenzieduckmoo
    One of the quotes i heard that i really liked was "Its only called AI till it has an actual practical use. Then we just call it what it is". Think things like automatic captioners or OCR tools, or some of the earlier tools of CGI.
  • @nfugitt89
    Love your attitude towards the AI hype. Much of it seems like a manager or executive's idea of what problems people have, like forgetting what they were doing on their computer an hour ago or summarizing emails
  • @dudeh9702
    "Ah yes, with our new AI-POWERED DNS RESOLVER, all your problems are over!" evil laughter
  • @TheJonathanc82
    Jeff: i want all the TOPS RaspberryPi: We don’t recom… Jeff: ALL THE TOPS!!!
  • @jeremyjedynak
    The killer app for the Co(Pi)lot around Geerling Engineering will be to use pose detection to sound an alarm and activate a water cannon whenever Red Shirt Jeff is about to do something that would release the magic smoke.
  • This is exactly what AI should be used for, not constantly watching what your doing on your PC and not telling you to eat "at least one small rock per day" 🤣 Glad to see that the RPI foundation is tapping into the best form of AI tools, the ones that are actually helpful and fun, all at a fairly low cost.
  • @michaelturk9625
    Jeff: don’t forget that you can use a Coral TPU with each USB port as well. A couple of years ago I attempted to use a webcam and coral TPU (based on a YouTube tute) to use eye-gaze and muscle twitch, to control a mouse … to control a PC as a communication device for my late wife who had ALS. However, a much more sophisticated (and $$$$$) device with integrated software was loaned to her by our state ALS support team before I completed it. However, there's a practical use for AI and a raspberry 5 and AI device for probably 10% of the cost of what they provided on loan.
  • @dazryan3463
    Looking forward to seeing this tried with the Alftel 12x PCI Express M.2 Carrier Board
  • @FluffyFoxUwU
    Jeff: "Wildly unsupported configuration" Jeff also: daisy chains 5 pineberry M.2 hats
  • @AndrewBawitlung
    Not useless like R1 or Ai Pin 💀💀💀💀💀💀💀💀💀💀
  • @kryptonic010
    Good stuff Jeff. Can't wait to see more. Keep up the good work!
  • @TaylorAlexander
    This looks great! For my farming robot I’m planning to add eight raspberry Pi HQ cameras to four Raspberry Pi 5’s, and I originally planned to send those feeds over gigabit to an Nvidia Orin. And while centralizing has value, I could perhaps use these with some decentralized processing. Really cool to see raspberry pi focused on real world automation. That’s what I’m doing! I don’t need another chat bot I need computer vision for my farming robot.
  • @TwstedTV
    I fell off my chair LMAO when you said "It's not like the Rabbit" 😂😂😂😂😂
  • @Debloper
    Titile: "I Built a CoPilot+ AI PC (without Windows)" My Brain: we trust Jeff... let's watch the video.
  • @TT-it9gg
    Nice video. Looking forward to the next try!~
  • @sweetasdude
    Very cool Jeff, I really like your approach to this.