Nvidia AI live streaming tool adjusts speaker’s eyes as if looking into camera

Nvidia has updated the Broadcast live streaming tool with new features, including Eye Contact. Eye Contact adjusts the eyes of the filmed speaker to make it appear as if they are looking into the camera, even though they are not actually doing so. Background and blur effects have also been improved.

The Eye Contact function ‘treasure’ where the eyes of the filmed speaker should be if they were looking into the camera and then adjusts it. Speakers keep their eye color and keep blinking, says Nvidia. The AI ​​tool also breaks eye contact if the speaker looks too far away, smoothing the transition between the simulated eye contact and the speaker’s actual eyes.

Nvidia says the new feature is suitable for people who want to film themselves reading their notes or a script, for example, or want to avoid looking directly at the camera. Such eye contact is actually good for such videos, because according to Nvidia they increase the connection between speaker and viewer. Eye Contact is currently in beta; the company is therefore asking users for feedback.

In addition to Eye Contact, Nvidia adds the Vignette update, which, together with Background Blur, should provide a ‘bokeh effect’. Nvidia has also improved the Blur, Replacement, and Removal Virtual Background effects with temporal information that should make these effects more stable and better differentiate between background and speaker. Finally, the update allows users to take screenshots and mirror their webcam image.

Background is an Nvidia AI tool dedicated to video calling and live streaming, which only works with Nvidia RTX GPUs. The tool comes standard on some laptops from Acer, ASUS, Gigabyte, MSI, Lenovo and Razer, and some effects can also be used with other programs via an SDK. Virtual Background is for example in OBS, Streamlabs and Elgato Camera Hub.