Edison Labs
  • Home
  • Blog
    • Innovation
    • Artificial Intelligence
    • Virtual Reality
  • Imagination
  • Ideas
  • Innovation
  • More
    • Artificial Intelligence
    • Virtual Reality
No Result
View All Result
Edison Labs
  • Home
  • Blog
    • Innovation
    • Artificial Intelligence
    • Virtual Reality
  • Imagination
  • Ideas
  • Innovation
  • More
    • Artificial Intelligence
    • Virtual Reality
No Result
View All Result
Edison Labs
No Result
View All Result

Body Tracking From VR Controller Cameras

admin by admin
May 3, 2022
in Virtual Reality News
0
Body Tracking From VR Controller Cameras
400
SHARES
2.4k
VIEWS
Share on FacebookShare on Twitter



Carnegie Mellon researchers built a body tracking system using cameras on VR controllers.

Consumer VR systems today only track the position of your head and hands. No system on the market comes with tracking for your torso or limbs, but some PC VR enthusiasts attach HTC’s Vive Trackers to their hip and feet, a use case supported by software like VRChat and LIV. Since Vive Trackers cost $139 each, if you don’t already have SteamVR Base Stations the total extra cost exceeds $700. There are unofficial body tracking solutions using old hardware with community made drivers, such as for Microsoft’s Kinect, but this only works from a front-facing angle and the tracking quality isn’t great.

Extra cameras on headsets pointing down at your body could theoretically track limbs, but the view to your legs would often be occluded by your torso or arms, especially as headsets get thinner. Companies like Meta could alternatively release wireless external tracking stations with a camera, battery and mobile chipset running computer vision algorithms, but developers couldn’t rely on users buying and setting up such a costly accessory.

ControllerPose is a prototype solution using two fisheye cameras attached to each VR controller, pointed back at you. The software stitches together the view of the two cameras to achieve an even wider field of view, to see as much of your body as possible. Their pose estimates are accurate to within 8.59 cm, the researchers report.

To process the cameras the researchers tried two approaches: streaming to a nearby PC, and processing onboard with a Raspberry Pi Compute Module 4 and Google Coral. Using a PC (or the standalone headset) would be cheaper, but processing onboard would result in lower latency.

In September last year screenshots emerged appearing to show the upcoming Project Cambria’s controllers with three onboard cameras for self contained inside-out tracking. These cameras don’t appear to be pointed toward you, but a leaked tutorial video did appear to show body tracking. It’s possible that either Cambria or a future Meta headset could perform body tracking using a technique similar to ControllerPose.

The downside of ControllerPose is, according to the researchers, 32% of the time in “typical VR experiences” the controllers don’t have a good view of the body – they’re either too close or off to the side. Future systems could perhaps integrate cameras on the controllers and cameras on the headset, but it seems that only an external solution could achieve fully reliable body tracking. Still, could such a solution work in enough scenarios to be useful to most people?




Source link

Previous Post

Cambria/Quest Pro Price ‘Significantly’ Higher Than $800

Next Post

Fracked Graphics Comparison – PSVR vs PC VR!

Next Post
Fracked Graphics Comparison – PSVR vs PC VR!

Fracked Graphics Comparison - PSVR vs PC VR!

Season 5 Episode 15 Ft. Ben Lang of Road To VR

Season 5 Episode 15 Ft. Ben Lang of Road To VR

May 21, 2022
Apple Headset Probably Won’t Ship This Year

Report Details Troubled Development Delaying Apple Headset

May 20, 2022
Beat Saber Gets A New 3D Level Editor On PC

Beat Saber Gets A New 3D Level Editor On PC

May 19, 2022
Eolia Hits Oculus Quest 2 In June

Eolia Hits Oculus Quest 2 In June

May 18, 2022
TCL Presents Ultra Compact 2K VR LCDs

TCL Presents Ultra Compact 2K VR LCDs

May 17, 2022
Quest 2 Refurbished For $249 Remains VR’s Best Deal

Quest 2 Refurbished For $249 Remains VR’s Best Deal

May 16, 2022

About

Welcome to Edisonlabs.net Find the latest innovative technology news articles, videos on edisonlabs.net. Read about new inventions shaping the world and the future.

Categories

  • Innovation & Imagination
  • Innovation Technology
  • Innovation Ideas
  • Artificial Intelligence
  • Virtual Reality

Quick Links

  • Home
  • Blog
  • Privacy Policy
  • Disclaimer

Recent

  • Season 5 Episode 15 Ft. Ben Lang of Road To VR
  • Report Details Troubled Development Delaying Apple Headset

© 2021 Edisonlabs.net - All Rights Reserved

No Result
View All Result
  • Home
  • Blog
    • Innovation
    • Artificial Intelligence
    • Virtual Reality
  • Imagination
  • Ideas
  • Innovation
  • More
    • Artificial Intelligence
    • Virtual Reality

© 2021 Edisonlabs.net - All Rights Reserved

Sign Up For Occasional News, Gifts & Surprises!

Sign Up

This Website Is For Sale – For Details Please Call 360 256-1117 or email thewaymarketing88@gmail.com

Your email is private with us and will never be shared.

x