Vortex Gaming

· VTubers show natural movements as if they are crossing between real and virtual spaces, such as rotating on a real chair or controlling a toy car.
· Scenes where Hololive members play tug-of-war or grab props utilize tracking technology so sophisticated that it's hard to distinguish from reality.

· The most commonly used Vive or Tundra trackers are optical, but they are difficult to use without a headset and their large size limits live performances. Additionally, the accuracy is limited by a maximum of 5 trackers.
· IMU trackers like Slime VR and Rebocap are small, resistant to obstacles, and don't require a headset, but they can suffer from inaccuracies and drift due to inertia, which can be problematic for long-term use.
· While these trackers might be suitable for solo VTubing, accurate and stable tracking is essential in environments where multiple members interact, like Hololive.

· We need to look at the technologies from the film and game industries, which are leaders in the 3D tracking market, beyond just the VTuber domain.
· Unlike simple animation methods of the past, modern AAA games and blockbuster movies achieve realistic and lively character movements through Motion Capture (Mocap) technology.

· Motion capture began in 1985 and was initially called 'brute force animation.' Currently, it's used in various fields like gaming, film, and broadcasting to achieve realistic movements.
· Professional motion capture systems like Vicon utilize special cameras and numerous retroreflective markers attached to the actor's body. These cameras use infrared light to measure the 3D coordinates of the markers, enabling sub-millimeter accuracy and drift-free tracking.

· Motion capture systems use multiple high-speed cameras to capture an actor's movements. Each camera emits infrared light, and detects the light reflected from the retroreflective markers attached to the actor's suit and body to accurately determine their position in 3D space.
· To solve the 'occlusion' problem where markers are hidden, multiple cameras are placed at various heights and angles to minimize blind spots. It also optimizes tracking performance by reducing interference from external light sources.

· Vicon's flagship VK26 motion capture camera, used by Hololive, costs about $20,000 per unit, and a single studio can cost millions of dollars. This is a very high cost.
· Specially designed motion capture gloves for finger tracking, or high-precision headcams (Faceware, Captive Devices, etc.) for facial tracking are used. iPhone's facial recognition technology can also be utilized.

· Vicon offers systems including 16 cameras, suits, markers, and software starting around $60,000, which can be reduced to $40,000 depending on needs. This is a viable option for general VTubers.
· More affordable alternatives include Waro software, iPhone-based facial tracking (iPhone X or later recommended), neck-mount or Rokoko helmets, UD Cap VR gloves, Vive/Tundra trackers, Flux Pose, and Rebocap trackers.