How Streaming Video and Audio Work

By: Chris Pollette  | 
Netflix logo
The Netflix logo seen displayed on a smartphone screen. Netflix is a global provider of movies and television series via streaming and currently has more than 208 million subscribers. Rafael Henrique/SOPA Images/LightRocket via Getty Images

When the internet first caught on with consumers in the mid-to-late 1990s, people had to buy a modem, hook it up to their computer and a phone line and dial the phone number for their local internet service provider (ISP). Connections were miserably slow.

The web was not designed to stream audio or video when it was first created in the 1960s, but enterprising developers found a way to help customers listen to real-live audio and the first live audio streaming event was broadcast on Sept. 5, 1995, for a game between the Seattle Mariners and New York Yankees. It was novel at first, and there wasn't a lot of long-form content. Between maddeningly slow connections and glitchy software no one was going to sit down to watch a movie on their home computer.

Advertisement

In just a few short years, technologies improved to make streaming video and audio more of an everyday occurrence. Companies like Netflix and Hulu delivered live movies and television. Content creators such as Paramount and Disney started their own video streaming networks, and tech giants like Apple and Amazon joined in. You can watch old classic TV shows or the latest movies on demand.

Streaming audio has matured as well. You can listen to live sports around the world, or turn your computer or smartphone into a custom radio channel with music providers like Deezer, Pandora, and Spotify. People commute to work or the grocery store listening to true-crime podcasts or the latest audiobooks.

In the last decade, audio and video streaming became popular enough to encourage cable and satellite TV providers to "cut the cord" and canceled their cable or satellite TV subscriptions for cheaper streaming options. In June 2021, media research company Nielsen revealed that streaming video has become more popular than over-the-air TV in the United States. Streamers' share of the market was 26 percent to over-the-air TV's 25 percent. That may not seem like much, especially when cable TV still had 39 percent of the market, but streaming media is likely to continue to grow, and cable subscriptions likely to decline.

You may have participated in a live streaming broadcast yourself. During the COVID-19 pandemic many people tuned in for remote meetings or online classes. Tools like Zoom, Microsoft Teams or Google Meet can handle live audio and video streaming simultaneously in one broadcast. It's a little like when the telephone companies promised us videophones in the mid-20th century, only better.

Advertisement

Finding and Playing Streaming Video and Audio

Roku
A sample of the channels you can access through Roku. Tiffany Hagler-Geard/Bloomberg via Getty Images

If you're brand-new to streaming, you'll need a high-speed internet connection. You'll also need a device to enjoy the video or audio content on — that could be a smartphone, a computer, a tablet or a TV. Computers may be the easiest to set up for streaming. You can access the websites for many streaming video and audio providers and enjoy the media right in your browser window. You may also find a dedicated desktop application for a streaming service.

Although smartphones and tablets have web browsers, you're far more likely to use an app developed specifically for that particular service. If you wanted to watch or listen to a live game in progress, you might open the ESPN app. To hear the news, you might listen to TuneIn Radio, which offers live and recorded broadcasts from all over the world. Many services require paid subscriptions, but many others are ad-supported or completely free. For streaming audio, most people rely either on go to the website of the program in question or to a podcast platform which has a host of programs, like Apple Podcasts, Google Podcasts, Spotify or Stitcher. These can be found on your smartphone.

Advertisement

TVs require hardware to make live streaming connections. Often this is a device you plug into a port on the television such as Roku, Amazon FireStick or Google Chromecast — these are the devices that allow your TV to access the apps for streaming live content. If you have a smart TV, this hardware is already built in. Just turn on your TV, go to the "Apps" section and you'll see an operating system designed to run streaming apps for Netflix, Amazon Prime Video, PlutoTV, YouTube and many more. The most popular apps are usually pre-installed but your device or TV will let you download new apps as well. (If you still subscribe to a cable service, the newer cable boxes allow you to stream videos and apps through them, too.)

Once you've selected the app you want, you'll see an array of programs, along with descriptions and ratings. You just click on the show you want to get started. If it is a paid app (like Netflix, Hulu or Amazon) you'll have to create an account or sign in if you already created an account and paid for the service online. The good news is once you've signed in, the streaming app will save that information so you don't have to do it again.

Most apps have an interface that lets you choose your favorite shows and browse others. With on-demand streaming you can watch one at a time, or "binge-watch" several in a row. You can pause the show to get something from the kitchen, usually even for live events like sports. Streaming media's flexibility is one of the key reasons it has become so popular.

Advertisement

Encoding Streaming Media

Celebrating America Primetime Special
Demi Lovato performs during the Celebrating America Primetime Special on Jan. 20, 2021. The livestreamed event hosted by Tom Hanks featured remarks by president-elect Joe Biden and vice president-elect Kamala Harris and performances representing diverse American talent. Handout/Biden Inaugural Committee via Getty Images

Streaming providers must determine the best way to get their content to your device in a way that's easy for you to use.

High-quality images, audio and video files often start out very large. Although still imagines aren't streaming, as an easy-to-imagine example let's say your smartphone has a 12-megapixel camera. A still photo you take with that camera has a print size of 9.7 by 14.5 inches (17.8 by 36.8 centimeters). That's larger than you need for a quick social media snapshot, but the larger file size means you can use the photo for other things, in this case perhaps a poster. Our phones create bigger sound, video and image files because it's generally a better idea to create a large file and shrink it down. It's harder to enlarge a smaller media file with a high-quality result.

Advertisement

Streaming providers use file formats that maximize quality over typical internet speeds. Compressing them is done using codecs, instructions for coding and decoding visual and audio information in a standard file format. Lossless formats capture more of the original file's fidelity but have larger file sizes. Many formats, however, are lossy — they remove some of the information in the file but attempt to keep as much of the original as possible.  

To compress audio and video files, a lossy-format codec may identify parts of the video that it can copy and apply later in the show. It deletes the redundant information to keep the file size down. Codecs may also reduce the number of colors in the video, lower the resolution of the video or reduce its frame rate. Lossy audio codecs may remove frequencies from the original recording that most people can't hear, around 20 Hz to 20,000 Hz.

While that may help save on streaming bandwidth, it can cause problems, too. You may have experienced some side effects of file compression while you watch a show if images seem washed out or pixilated. If you're running with your earbuds in, you may not hear a heavily compressed music file, but with nice headphones, you just might.

Advertisement

Streaming Infrastructure

Streaming providers want to make sure their service is as fast and reliable as possible, which means developing specialized systems to handle the traffic.

In 2016 researchers at Queen Mary University of London published a report on the content delivery network (CDN) used by Netflix. At the time, the streaming video company had just become a global service with 4,669 servers in 243 locations around the world. It had been developing its own CDN since 2011 to get the service ready for global traffic. Netflix Open Connect, as it's called, requires the assistance of internet service providers (ISPs) all over the world.

Advertisement

Netflix encourages these ISPs to join the system by giving them its proprietary streaming devices, called Open Connect Appliances (OCAs), for free. Their ISP partners embed the equipment in their networks. Netflix then uses the devices to connect customers to the closest service point in the network. It speeds up the service and prevents the network architecture from being stretched too thin.

Streaming a live conference call works a little differently. Each participant is streaming live audio and video to and from their device at the same time as each other participant. Providers prioritize connection over video quality and offer telephone-based options for those who need to attend but can't use the internet.

Business computer network security presents another hurdle. Part of Zoom's streaming software, called the Intelligent Transport Layer, determines the best communication protocol to connect multiple callers over different networks. Zoom uses a distributed network and its own proprietary codec to encode and share information during its calls. The company says it keeps 50 percent excess capacity available to accommodate increasing traffic.

Advertisement

Video and Audio Streaming Customers

TV remote control
This detail of a TV remote control shows various streaming platform buttons on Dec. 16, 2020 in Krakow, Poland. Beata Zawrzel/NurPhoto via Getty Images

What happens to the streaming video and audio at your end? On smartphones and tablets, we're often using a proprietary application designed by the streamer that takes care of the business for us. If you tune in to a Disney+ stream on your phone, you don't have to worry about whether you'll be able to watch it.

In a web browser, however, streaming works a little differently. Your computer and internet connection affect how well the media stream works on your machine. With the release of HTML 5 — the language webpages are written in — streaming providers can embed audio and video files in their webpages without forcing you to rely on browser plugins.

Advertisement

Smart TVs and devices that plug in to TVs, such as a Roku or Apple TV, have their own operating systems and dedicated apps for streaming services. It's a lot like the experience on a smartphone or tablet. Your experience may vary on the deals streamers and hardware manufacturers work out — or don't — among themselves. In 2021 Roku removed YouTube TV from its channel store in a contract dispute.

Some content providers use their corporate structure to offer deals to potential subscribers of multiple services. At the time of writing in June 2021, AT&T offers the HBO Max streaming service free to anyone subscribing to its highest-end video, internet or wireless plans. HBO Max is part of WarnerMedia, owned by AT&T. Similarly, Comcast's Xfinity service customers get Peacock Premium for no extra charge (Comcast owns NBCUniversal and its library of content). The device you own and the internet service you subscribe to may affect which content you can access, for good or bad.

Advertisement

Streaming Video FAQ

What is streaming, and how does it work?
Streaming is a method of watching videos or listening to audio content without the need to download the media files before watching. When you stream video and audio, information travels in a stream of data from a server. The decoder, which is a stand-alone player or a plugin, works as part of a web browser. The server, information stream and decoder then work together to allow you to watch live or prerecorded broadcasts.
What is a streaming service for TV?
A streaming service for TV is the digital distribution of television content, usually TV shows, over the internet. The video content is then played on user devices as streaming media. Ever since the launch of YouTube and Netflix, there's been a substantial increase in the use of streaming web television.
What is a live streaming platform?
A live streaming platform is a video hosting platform that allows you to upload and broadcast video content for viewers.
Do you need internet for streaming TV?
Yes, you need a reliable internet connection, a device to stream on and some streaming content of your choice to watch.
Do you have to pay for streaming?
There are many streaming platforms like Netflix and Hulu for which you have to pay a subscription fee to watch their video content. However, if your budget doesn't allow, there also are many options that allow you to stream videos and movies free as they are mostly supported by ads.

Advertisement

Loading...