Jaunt Volumetric AR Avatar

PRE-PRODUCTION & PLANNING

Creating content for AR has been since its inception a problem of HOW to deliver experiences that are truly exceptional and also WHEN to introduce them into the commercial sector. Letting people feel and experience TRUE AR as a form of volumetric avatars is a viable solution as an AR product.The results are extremely compelling! See for yourself

We knew that AT&T wanted to create an experience to promote their brand new 5G network, They contected Jaunt to deliver on such promise. Our answer was a volumetric experience based on camera rigs, stages, ipads, connections to servers and a lot more. we called it the 5G Hologram Experience.

It started with a piece of paper and some ingenuity. How to capture a person in 3D, reproduce the avatar live in an ipad as an AR object and have a multitude of the same captures dancing at the Atlanta Stadium....Let's look at the process!

User Journey

Every experience starts with a Journey, not a flow! In this scenario I drew a journey of both digital and human flow as an experiential and experimental process, to understand better how, where and why we needed the rest of the processes involcved by engineering and other teams. Let's go trough them:
•1. Tent at the stadium in Atantla which would hold the stages as wellas the hardware and link to servers to capture people
•2. Performer walks into tent
•3. Performer registers on iPad: name, phone number(id) and email(id)
•4. Performer receives an arucco marker which is registered in database and has a unique ID
• 5. Performer walks to the stage
• 6. Operator app starts countdown
• 7. Performer dances on stage
• 8. Performer wlaks out of stage
• 9. Performers goes to table field (decored with NFL field theme and AT&T branding)
•10. Performer places marker on table
•11. Points iPad to marker •12. Performer sees volumetric avatar as AR on iPad
• 13. Field also has several othe relements or assets in AR such as Blimps, logo Brandings ( falcons and AT&T), Mascots, cheerleaders as well as a LIVE stage where they preview other performers as they are being captured
•14. Performer receives email or text from step 3 and opens link
•15. Redirects to landing page where they are welcome with a FTUE (Firts Time User Experience)
•16. Performers sees Volumetric Avatar in WebGl
•17. Changes Themes as well as enters AR Mode from Phone
•18. Has the ability to share to Facebook

From this user experiential journeyh I was able to now draw processes and flows for each specific areas of development (engineering, Design, Art, etc...)

User Flows

Once the User Journey has been drawn and reviewed we can now proceed to usr flows. Here they are for each of the parties involved:

From here on out there will be some minor changes as we proceed to production, but the journeys and flows are complete. We now move to prototyping, art, design and engineering

Art Design & Prototype Concepts

Art Concept design & for the table at the stadium


Take Away Prototype: Here is a quick prototype of the "Take Away" or phone experience


iPad Prototype: Here is a quick prototype of the iPad experience on the stadium.



My Involvement

• Lead UX/UI Designer
• Flow Charts
• Wireframes
• 3D Artist
• Ridiculous amounts of Unity Prototyping
• Scoping features and planning
• Information Architecture
• Interaction Design
• UI Style Direction
• UI Style Production
• User Journey
• User Testing

Project Overview

Achieve true presence for live action AR through volumetric captures. It is an AR powered solution built to support the entire scope of producing high quality volumetric avatar experiences, from planning to production through to mastering, and finally to delivery on tablets as well as mobile devices using only your browser, no more Apps!!

Details

Worked with Camera Engineers, Event producers, to develop a digital and a human flow and a process for what was to become Jaunt XRCast.

Tools Used

• Adobe XD
• Maya
• Unity3D
• Substance Painter
• Substance Designer
• Photoshop
• ProtoPie
• ARToolkit
• ARKit
• Three.js
• WebAr Components