Nvidia AI livestream tool adjusts speaker’s eyes as if they were looking into the camera

Nvidia has updated the Broadcast livestream tool with new features, including Eye Contact. Eye Contact adjusts the eyes of the filmed speaker, making it appear as if they are looking into the camera, even though they are not actually doing so. Background and blur effects have also been improved.

The Eye Contact function ‘treasure’ where the filmed speaker’s eyes should be when looking into the camera and then adjusts this. Speakers retain their eye color and continue to blink, Nvidia says. The AI ​​tool also breaks eye contact if the speaker looks too far away, ensuring a smooth transition between the simulated eye contact and the speaker’s actual eyes.

Nvidia says the new feature is suitable, for example, for people who want to film themselves reading their notes or a script, or avoid having to look directly at the camera. Such eye contact is actually good for such videos, because according to Nvidia they increase the connection between speaker and viewer. Eye Contact is currently in beta; the company therefore asks users for feedback.

In addition to Eye Contact, Nvidia adds the Vignette update, which, together with Background Blur, should provide a ‘bokeh effect’. Nvidia has also improved the Blur, Replacement and Removal Virtual Background effects with temporal information, which should make these effects more stable and better distinguish between background and speaker. Finally, the update allows users to take screenshots and mirror their webcam image.

Background is an Nvidia AI tool intended for video calling and livestreaming that only works with Nvidia RTX GPUs. The tool comes standard on some laptops from Acer, ASUS, Gigabyte, MSI, Lenovo and Razer, and some effects can also be used with other programs via an SDK. Virtual Background is included in OBS, Streamlabs and Elgato Camera Hub, for example.