One of the big problems with video, especially when watching it online, is the amount of bandwidth it often takes up. This problem of bitrates is particularly a problem when it comes to things like live streaming and video conferencing. Researchers at Nvidia think they’ve found a way around the limitations of existing video streaming codecs, though, with the development of a new neural network engine.

The new engine works by completely ignoring every traditional video codec out there in order to bring the amount of bandwidth required for video streaming down to a fraction of what it might normally use with something like h.264.

The new technology is possible due to Nvidia Maxine, their cloud-AI video streaming platform for developers. Nvidia posted a video explaining the new technology to YouTube, which you can see above.

It essentially works by sending along the usual keyframes like you’d expect with h.264, but instead of generating whole in-between frames and sending those down the pipe, as would happen with h.264, it creates a sort of mask of the subject, focusing on key parts of their face. The movements of these key locations is then sent instead of image data for each frame, and the recipient sees an AI-reconstructed image.

This means that the bandwidth is drastically reduced as only a relatively tiny data set is sent to the recipient instead of entire images or blocky chunks of changed pixel data.

Nvidia says that this technology also offers some other advantages for video conferencing, too, such as being able to reposition the subject’s head to face the camera. For most of us, looking directly at the camera isn’t possible. Our cameras are usually either on top of the monitor that’s displaying the other side of the conversation or they’re off to the side – so we’re not looking directly at the camera. The new Nvidia technology solves that problem, by helping to make sure subjects are looking at each other while they talk.

And, naturally, because it’s able to understand the shape and structure of your face, you’re able to swap yourself out for things like virtual characters – although that isn’t really anything new. My phone’s been able to do that for a couple of years already now.

The technology is still in its early days, and you can see that there are some issues with this technique in the video up top. When you compare the quality vs the amount of bandwidth used, though, there’s really no comparison when it comes to something like video conferencing.

As time progresses and the technology gets more advanced and more reliable and cameras and screens keep increasing in resolution, this or a similar technology could potentially become the key to streaming super high resolution and high frame rate data of all types into our homes without having to go through major hardware upgrades to increase the available bandwidth.

John Aldred is based in Scotland and photographs people in the wild and animals in the studio.

You can find out more about John on his website and follow his adventures on YouTube.

Dunja Djudjic is a writer and photographer from Novi Sad, Serbia. You can see her work on Flickr, Behance and her Facebook page.

John Aldred is based in Scotland and photographs people in the wild and animals in the studio.

You can find out more about John on his website and follow his adventures on YouTube.

Ole Henrik Skjelstad is a Norwegian math teacher and landscape photographer who fell in love with photography after receiving his first camera as a birthday present in 2013. You can follow his work on 500px, IG and Flickr.

Adam Frimer is a Guinness World Record holder, producer, and DoP based in Tel-Aviv, Israel. Adam owns a production company that specializes in corporate marketing and brand strategy. His work has been commissioned by Adobe, Microsoft, Nike, Samsung, Dell, AVS, Starbucks, Viber, and WeWork.

His videos have over a hundred million views, have been extensively published by news outlets, and has even received recognition from a few film festivals, such as International Ocean Festival

Tom Saimon is a fashion and editorial photographer based in Haifa, Israel. You can see more of his spectacular work on his website say hi Facebook and Instagram

Copyright © DIYPhotography 2006 – 2020 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy


Nvidia, Videotelephony, Artificial intelligence, Cloud computing

World news – GB – Nvidia has developed neural network that could revolutionise video streaming – DIY Photography

En s’appuyant sur ses expertises dans les domaines du digital, des technologies et des process , CSS Engineering vous accompagne dans vos chantiers de transformation les plus ambitieux et vous aide à faire émerger de nouvelles idées, de nouvelles offres, de nouveaux modes de collaboration, de nouvelles manières de produire et de vendre.

CSS Engineering s’implique dans les projets de chaque client comme si c’était les siens. Nous croyons qu’une société de conseil devrait être plus que d’un conseiller. Nous nous mettons à la place de nos clients, pour aligner nos incitations à leurs objectifs, et collaborer pour débloquer le plein potentiel de leur entreprise. Cela établit des relations profondes et agréables.

Nos services:

  1. Création des sites web professionnels
  2. Hébergement web haute performance et illimité
  3. Vente et installation des caméras de vidéo surveillance
  4. Vente et installation des système de sécurité et d’alarme
  5. E-Marketing

Toutes nos réalisations ici


Please enter your comment!
Please enter your name here