The Adobe Research team is pushing the boundaries with an early-stage mixed reality exploration called Project Glasswing. An experimental display prototype, Project Glasswing explores the possibility of bringing Adobe's design tools to the physical world, creating the illusion of a Photoshop, After Effects or XD layer appearing in space in front of 3D real objects, without the need for phones or special glasses. This touch-enabled experiment enables Adobe to demonstrate new experiences that blend digital content and interaction with real and physical objects, unlocking new possibilities for the 3D ecosystem.
To get a sense of how this exploration works, see the video below:
For example, in-store advertising could allow shoes to be displayed inside a window with accompanying text, graphics, and video to create a compelling experience for customers. A vending machine could use a masked video of sloshing water to augment the view of real-physical bottles of water behind it. Or imagine a museum exhibit of a rare artifact displayed in a glass case. The glass could allow a clear view of the encased item, with overlaying graphics offering information about its history. For more information see the IDTechEx report on Flexible & Foldable OLED Displays 2019-2029.
Adobe is exploring how to create content for this exciting class of display that has only emerged in the research community in the last few years. Today's mainstream displays are typically limited to 2D, but the vision here is to democratize the entire ecosystem of 3D objects. With Project Glasswing, digital media assets created in Adobe tools such as Adobe After Effects, Adobe Premiere Pro and Adobe Dimension can now be shown on the display for a new generation of storytelling. By controlling the opacity and emissive color of each pixel independently, the display acts like a conventional monitor or could have transparent windows to see physical objects.
Source and top image: Adobe