Creating your digital twin – AI-Day 2019

Creating a 3D digital replica of yourself will be demonstrated by a global expert on computational photography and computer vision at the AI Day 2019 conference in Auckland on March 27 and 28.

That may provide a 3D future for the telecommunication, tourism, entertainment and gaming industries, says professor Jingyi Yu, of ShanghaiTech University and DGene, using a combination of light field acquisition and reconstruction technology to generate a digital doppelganger.

Light field technology works by capturing all light emitting from an object, such as a person, in place of 2D images. Advanced machine learning and image processing technology is used to recover ultra-high resolution and realistic dynamic human models from their real twins, in real time.

The technology is expected to become common within a few years, with 3D available for most digital communications.

Yu says the potential is huge.

“We have lived in a 2D image world for decades but we are close to when 3D imaging will become normal, and bring a new dimension and more reality to our digital experience,” he says.

“We can now capture all aspects of a person’s appearance automatically including skin reflection, light, depth, colour, clothing textures and aspect, to provide an ultra-realistic and finely detailed reproduction of anyone in real time. We can now all have a ‘digital twin’,” Yu says.

“A larger scale use would be for a live broadcast and using it for 360 degree and 3D imaging – people will never miss a single angle and even freeze any moment and replay. The personal TMO is not far away, which may solve some discussions about the referee’s decision.”

All of this is possible using current broadband speeds, which will accelerate and improve once 5G arrives, Yu believes.

Replica imaging can use up to 80 cameras to capture constant images of every angle that are then reconstructed in 3D instantly. The technology is powered by accelerated computer and algorithm speeds.

AI Forum of New Zealand executive director Ben Reid says this is an incredible example of visual technology enabled by and working with AI.

“Managed correctly, this will open up enormous potential in any industry or service where digital communication plays a role, and increasingly this is just about everywhere,” Reid says.

“China is one of the world’s leading centres of AI investment and it is essential that New Zealand’s AI innovators build strong and lasting links with the Chinese AI market.”

AI Day 2019 is at the ASB Waterfront Theatre in Auckland’s Wynyard Quarter, presented by the AI Forum NZ and NewZealand.ai.

It starts on March 27 at 4pm with international speakers from the US and China, as well as Kiwi trailblazers.

On March 28, AI’s impact on people, business and society is covered during a full day conference with keynote speakers, panels and more from 9am to 6.30pm.

Workshops at AUT follow on April 3-4, with a Hackfest on April 6-7.

Visit https://www.ai-day.com for more information.