Explaining Digital Video: Formats, Codecs & Containers

This is a subject I've taken for granted for decades, without actually understanding it. Thanks for this!

This topic is so complex, and this video only scratches the surface. You could literally make it your career to explain everything about digital video.

My goodness you've shown up my ignorance! That was a fantastically informative video.

EC: Mentions common containers MKV: *Sad noises*.

After 20 years in photography, I need to go back to school after watching this tutorial. Thanks a lot.

This is by FAR the best, briefest and most comprehensive simplification of digital video formats I've seen... fantastic job, thank you!! 🥰 From now on, anytime someone asks me to explain it - which I do very poorly - I can send them here.

You put a lot of time and energy into a very good presentation. Thank You!

This clearly explains why we haven’t heard from alien life as they don’t know what format to use with us, or they are so confused they gave up.

Scrolling the comments, I see I was hardly alone in raising an eyebrow at the absence of Matroska/.mkv containers. I have also seen the numerous replies from our charming host regarding his focus on the production/editing side of things. If I might be so bold, Chris, could I suggest the idea of a future video that dives deeper into video containers including the pros and cons of each relatively popular type. It is not inherently obvious to a novice why one might choose MP4, MKV, MOV, the venerable AVI or whatnot over the other options. MKV clearly has a strong user base with video that has multiple language options, for example, but understanding why would be quite interesting. Why do those unique Android containers when MP4 exists? That sort of thing. Great video as always!

I wrote a paper in college 16 years ago exactly about this topic. MP4 was a new format/container at the time, using mostly H.264 (H.265 didn't exist yet), HD files were almost non-existent, and most everything was SD with a few 480p or 576p videos. 3GP was also kind of new at the time (used in mobile phone videos). Good times...

As a heavy user of various digital video/media solutions, it was certainly a pleasure to see a refresher on all of this stuff. Just thought I'd share a couple additions from my experience: 1) Media containers like MP4 can not only contain several audio streams and subtitle streams but also several video streams too! Some of the videos I encode have three or four different video tracks showing playback from different perspectives. 2) Media containers can have any or all of the items you listed (e.g. video streams, the audio stream(s), and subtitles). Some projects I've worked on use MP4 but simply contain a bunch of audio streams which is super handy if you're trying to transcribe audio from an interview and have a combination of combined and individual speaker's audio, enabling the transcriber to swap between the various speakers. Since it's all contained within that mp4 file it's very easy for them to work with. 3) Containers can also contain a bunch of other meta-data that may be handy for some projects. For instance, did you know that you can label each audio stream, video stream and transcription track, enabling viewers to clearly tell what they viewing? 4) Not all media playback software handles these containers the same way. I'd encourage anyone to try opening an MP4 file containing several audio, video, and transcript tracks in QuickTime and tell me what they see. Compare this with VLC which lets the user choose which audio, video, and closed captioning tracks they want to see. 5) Similar to the roll of 35mm film you held up at the end, modern-day video can also be created by threading together a bunch of still images. Some of the videos I'm creating right now use tens of thousands of ultra-high-resolution screenshots to put together 4K video at about 90 frames-per-second. 6) Although there are a number of great video editing tools out there, one tool I am using a lot is FFmpeg (from the terminal). It lets you do all sorts of stuff from creating multi-track audio MP4 files to creating multi-track audio, video, and closed captioning videos with sophisticated overlays. The best part is since it's a command-line tool you can use shell scripting to automate the whole video encoding workflow. Instead of spending hours in handbrake or other tools going project by project to define a workflow and wait for the processing to resume, I can write a clever script run it overnight on my computer and when I get up all the media files are encoded for me to view.

Here I am again with my cuppa. Sitting down with a brew to watch the new EC video is a habit I very much enjoy! The only time I have issues with codecs is on DVD players as the selection of formats supported is so random & varied. As far as Windows goes, at least you can download VLC or MPC-HC and pretty much forget about what format your files are in. This is one respect that things have definitely changed for the better!

I really wonder who had the glorious idea to throw in "I-Frame" as an abbreviation when we're trying to distinguish between interframe and intraframe.

MKV (Matroska) container is widely used too :)

This is definitely one of those videos which falls into the category of "Things I didn't realise I didn't know", or - more precisely - "Things about which I didn't realise how much there is not to know"! By that I mean both the things you've explained in the video and all the questions which arise from it because it's quite clear you've only really scratched the surface!

Just graduated Film School and have never been explained this stuff so well in any of my editing classes. I took notes during this video. Great stuff.

As a comment said earlier, I never really understood anything about this. Another excellent explanation, minimal jargon, clear, well planned and, as is rarely the case, useful.

And then there's the mkv container?

Fascinating topic. I remember learning years ago that MPEG video from a source such as digital satellite and cable used (perhaps still do) the interframe compression mechanism, where it would only compress the moving parts of a video and not the still parts of the video. Too much movement on the screen and you can begin to see blocks of video (also known as pixelation) on the screen. A good example is the New Years celebration in Times Square with all the confetti raining down on the crowd below. I believe YouTube also uses the interframe compression as well. The DV tape demonstration in the video really cleared up a lot of confusion I had between the codec and the container. Very well done Chris, thank you sir!

This is the best video on formats and codecs I’ve ever seen! It’s so clear and concise. I now have a WAY better understanding on the subject. I’m saving it a a reference to whenever I have questions or need a refresher. Thank you SO much!