With the rise of virtual spaces and interactive entertainment, music labels and artists are exploring new ways to connect with audiences beyond traditional concerts. Sony Music saw an opportunity to bring Myles Smith’s music to life in an innovative way, a fully immersive virtual concert inside Fortnite, where players could experience his performance in a custom-built digital environment tailored to his artistic vision. This project pushed the boundaries of digital entertainment, offering fans a fully interactive and visually stunning way to experience live performances.

Instead of relying on expensive marker-based motion capture suits, Sony Music turned to Move AI’s markerless motion capture technology, which provided studio-quality motion capture. This allowed for a seamless and cost-effective production, eliminating the need for complex suits or specialized hardware while still delivering high-fidelity, fluid character animation that captured Myles Smith’s unique performance style.

Why Sony Music Needed a New Mocap Solution

Sony Music had a clear vision:
1. Create a digital avatar of Myles Smith that moved naturally and felt authentic.
2. Produce a visually stunning concert inside Fortnite, blending music, gaming, and storytelling.
3. Deliver everything under a tight deadline, where traditional mocap workflows would have been impractical.

In conventional motion capture, artists wear marker-based suits, requiring complex calibration, setup, and post-processing, a process that can take weeks. With Move AI’s multi-cam system, Sony and Racquet Studios could record, process, and implement Myles Smith’s performance in a fraction of the time, making it the perfect solution for fast-paced productions.

‍

The Role of Move AI & Multi-Cam Motion Capture

To create a lifelike and dynamic avatar of Myles Smith, the production team utilized Move AI’s Move Pro multi-cam system. By setting up multiple cameras to capture Smith’s movements from different angles, Move AI was able to generate high-precision motion data that was then applied to a 3D character inside Fortnite.

The Move Pro multi-cam setup allowed Racquet Studios to capture:

• Full-body motion with incredible accuracy, ensuring Smith’s signature movements were preserved.
• Seamless, natural animation, avoiding the robotic feel often associated with procedural animation.
• Efficient production workflow, significantly reducing the time and resources typically required for motion capture.
  

By utilising Move AI’s AI-powered motion capture solution, the team bypassed the limitations of traditional mocap suits and instead used camera-based capture, making the process faster, more scalable, and accessible.

Racquet Studios played a crucial role in designing a custom Fortnite island that would serve as the perfect stage for Myles Smith’s virtual performance. Every detail—from the lighting and stage effects to the interactivity of the environment—was carefully crafted to reflect Smith’s musical aesthetic and storytelling.

During the concert, fans could experience Smith’s performance as if they were inside the world of his music, moving through different interactive spaces, each designed to complement the mood and theme of his tracks. The highlight of the event was his performance of "Stargazing," which was brought to life with stunning visual effects and motion-driven interactions.

The Impact: A Glimpse Into the Future of Virtual Entertainment

The success of Myles Smith’s virtual concert in Fortnite proves that music experiences don’t have to be limited to the physical world. With Move AI’s markerless motion capture and multi-cam system, Sony Music and Racquet Studios have set a new benchmark for how artists can perform, engage, and connect with fans inside virtual worlds.

This project also highlights how motion capture technology is becoming more accessible. Where traditional mocap required specialized suits and costly studio time, Move AI is empowering creators, production studios, and game developers to bring professional-grade motion capture to digital experiences without traditional barriers.

This Fortnite concert isn’t just an innovation, it’s a glimpse into the future of live entertainment, where motion capture, gaming, and music seamlessly converge to create experiences unlike anything before.

Want to explore what Move AI’s multi-cam technology can do for your projects?

Schedule a demo today!

‍