Nvidia Introduces RTX Broadcast Engine Software With AI Greenscreen

Nvidia has announced the RTX Broadcast Engine. With this development kit, streamers can virtually dress up their live streams thanks to, among other things, an AI greenscreen. An early version of the software will be available to developers soon.

Nvidia made the announcement in response to the upcoming TwitchCon event. The RTX Broadcast Engine uses the Tensor cores in Nvidia’s RTX video cards. The software is specially made for streamers and introduces a number of features powered by artificial intelligence. One of these features is a so-called RTX green screen. This virtual green screen is supposed to remove the background from a webcam. This feature will be integrated into OBS for RTX video card users.

The new SDK also contains RTX AR. These augmented reality effects can recognize and track faces. It allows to create a model of the face, allowing users to control 3D characters with their own face. Furthermore, the sdk also contains RTX Style Filters. Allows changing the look of a webcam based on the style of an image of your choice. For example, it allows users to stylize their webcam as a Van Gogh painting. It is not known exactly how the various functions work. Good lighting is expected to be necessary to achieve the best results.

The SDKs are immediately available as early access software for some Nvidia partners, but they will soon come to more developers, who can build the techniques into their apps. Nvidia says the RTX encoder, announced earlier this year, will now also work with Twitch Studio, Discord Go-Live and Elgato’s 4k60 Pro Mk2 capture card.