Oh wow! AI lighting system has reached a whole new level!
Watch the moment his hand crosses the glow. The light disappears behind it instantly, no lag, exactly the way a real one would.
Konrad Reczko calls the technique depth-aware light injection.
He dropped a virtual light into a live webcam feed and gave it enough awareness of the room to swing around a person, pass in front of a raised hand and slip behind a shoulder at the right instant.
That awareness comes from a depth model reading every frame and estimating how far each object sits from the camera. Without it, the light has no idea what stands in its way.
Then there's the speed. About 8 milliseconds per frame on an M4 Pro, comfortably inside the budget for a live feed.
The engineering decision underneath is the interesting one.
Reczko wrote the inference directly in TypeGPU, so the depth model runs on the graphics card in the same place as the lighting.
Nothing gets copied back to the processor, nothing waits on a handoff, and inference, lighting and drawing all travel through a single command encoder.
Demos like this one become products only when the right people see them, and that's the business GenAI Works runs: go-to-market for NVIDIA, Oracle, Google and 300+ AI brands through a 14M+ community, with revenue up 2.5x last year and 150+ people already onboard.