Virtual Production Solutions

Hi Virtual Production team,

Currently, using Portal/XR, the image outside the broadcast camera's shot is unrendered/garbage/distorted. Usually this is fine since it isn't visible in the shot of the camera (and therefor being distorted to probably save performance). However, suppose there would be a spotlight in the part of the virtual scene which is distorted (so not visible to the broadcast camera) and you want the light emitted from the virtual spotlight, i.e. emitted from the LED-screen, to reflect on an object or person which is visible in the shot of the camera. Currently (Voyager 4.0 build 0192) that's not possible since the spotlight is not rendered because it is not in the actual shot of the broadcast camera. It would however be great if, at some point in time, this would become possible.

Kind regard,

------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands
------------------------------

Hi Gerard,

Yes we are discussing this.
Currently I do not have a date for when Portal will change. At the time the focus was on creating the effect for the camera.
In the meantime we have implemented Epic's nDisplay in Voyager with Lucid control, so although a slightly more involved setup, you would be able to get your reflections.

Cheers
Hall

------------------------------
Hall Hutchison
Senior Technical Product Specialist, Virtual Graph
Ross Video
------------------------------

Original Message:
Sent: 04-09-2021 11:52
From: Gerard de Vries
Subject: Real reflection of virtual content in Portal / XR

Hi Virtual Production team,

Currently, using Portal/XR, the image outside the broadcast camera's shot is unrendered/garbage/distorted. Usually this is fine since it isn't visible in the shot of the camera (and therefor being distorted to probably save performance). However, suppose there would be a spotlight in the part of the virtual scene which is distorted (so not visible to the broadcast camera) and you want the light emitted from the virtual spotlight, i.e. emitted from the LED-screen, to reflect on an object or person which is visible in the shot of the camera. Currently (Voyager 4.0 build 0192) that's not possible since the spotlight is not rendered because it is not in the actual shot of the broadcast camera. It would however be great if, at some point in time, this would become possible.

Kind regard,

------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands
------------------------------

Hi Hall,

I know the focus first was to implement the effect on camera: we were the ones requesting it for a demo for a client (who has now been using it on prime time for about 4 months)  ;-)

Since you suggest nDisplay in Voyager could be a solution, does that mean that, when using nDisplay for Voyager, the other screens are fully rendered? I would assume that nDisplay for Voyager is an extension to the portal and on the screens not visible in the camerashot you would also have the distorted image.


------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands
------------------------------

Original Message:
Sent: 04-30-2021 13:51
From: Hall Hutchison
Subject: Real reflection of virtual content in Portal / XR

Hi Gerard,

Yes we are discussing this.
Currently I do not have a date for when Portal will change. At the time the focus was on creating the effect for the camera.
In the meantime we have implemented Epic's nDisplay in Voyager with Lucid control, so although a slightly more involved setup, you would be able to get your reflections.

Cheers
Hall

------------------------------
Hall Hutchison
Senior Technical Product Specialist, Virtual Graph
Ross Video

Original Message:
Sent: 04-09-2021 11:52
From: Gerard de Vries
Subject: Real reflection of virtual content in Portal / XR

Hi Virtual Production team,

Currently, using Portal/XR, the image outside the broadcast camera's shot is unrendered/garbage/distorted. Usually this is fine since it isn't visible in the shot of the camera (and therefor being distorted to probably save performance). However, suppose there would be a spotlight in the part of the virtual scene which is distorted (so not visible to the broadcast camera) and you want the light emitted from the virtual spotlight, i.e. emitted from the LED-screen, to reflect on an object or person which is visible in the shot of the camera. Currently (Voyager 4.0 build 0192) that's not possible since the spotlight is not rendered because it is not in the actual shot of the broadcast camera. It would however be great if, at some point in time, this would become possible.

Kind regard,

------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands
------------------------------

Hi Gerard,

nDisplay has both an Inner Frustrum (which is tracked and is what the camera sees - just like our Portal) and an Outer Frustrum which is not tracked but is the static rendered scene over which the Inner Frustrum is rendered.  This way you do have the scene on the whole screen(s) for reflections.

Cheers
Hall

------------------------------
Hall Hutchison
Senior Technical Product Specialist, Virtual Graph
Ross Video
------------------------------

Original Message:
Sent: 05-06-2021 14:34
From: Gerard de Vries
Subject: Real reflection of virtual content in Portal / XR

Hi Hall,

I know the focus first was to implement the effect on camera: we were the ones requesting it for a demo for a client (who has now been using it on prime time for about 4 months)  ;-)

Since you suggest nDisplay in Voyager could be a solution, does that mean that, when using nDisplay for Voyager, the other screens are fully rendered? I would assume that nDisplay for Voyager is an extension to the portal and on the screens not visible in the camerashot you would also have the distorted image.


------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands

Original Message:
Sent: 04-30-2021 13:51
From: Hall Hutchison
Subject: Real reflection of virtual content in Portal / XR

Hi Gerard,

Yes we are discussing this.
Currently I do not have a date for when Portal will change. At the time the focus was on creating the effect for the camera.
In the meantime we have implemented Epic's nDisplay in Voyager with Lucid control, so although a slightly more involved setup, you would be able to get your reflections.

Cheers
Hall

------------------------------
Hall Hutchison
Senior Technical Product Specialist, Virtual Graph
Ross Video

Original Message:
Sent: 04-09-2021 11:52
From: Gerard de Vries
Subject: Real reflection of virtual content in Portal / XR

Hi Virtual Production team,

Currently, using Portal/XR, the image outside the broadcast camera's shot is unrendered/garbage/distorted. Usually this is fine since it isn't visible in the shot of the camera (and therefor being distorted to probably save performance). However, suppose there would be a spotlight in the part of the virtual scene which is distorted (so not visible to the broadcast camera) and you want the light emitted from the virtual spotlight, i.e. emitted from the LED-screen, to reflect on an object or person which is visible in the shot of the camera. Currently (Voyager 4.0 build 0192) that's not possible since the spotlight is not rendered because it is not in the actual shot of the broadcast camera. It would however be great if, at some point in time, this would become possible.

Kind regard,

------------------------------
Gerard de Vries
Solution Architect Live Graphics & Virtual Graphics
United / EMG
The Netherlands
------------------------------