Head Tracking for Desktop VR Displays using the wiiremote

Posted by admin On March - 18 - 2010

Using the infrared camera in the Wii remote and a head mounted sensor bar (two IR leds), you can accurately track the location of your head and render view dependent images on the screen. This effectively transforms your display into a portal to a virtual environment. The display properly reacts to head and body movement as if it were a real window creating a realistic illusion of depth and space. By Johnny Chung Lee, Carnegie Mellon University. For more information and software visit johnnylee.net

Wii

25 Responses so far

omudan Said,
@WorldWideWeirdness You can theoretically do the same thing with just a webcam and track eyes instead. Some knowledge of what you’re doing is required though

Posted on March 18th, 2010 at 8:58 am
CliffThomasm Said,
eyinterresting Btw anyone up for some dity talk

Posted on March 18th, 2010 at 9:17 am
ge0rgecz Said,
simple idea, but only on of the milion can realy make it … respect

Posted on March 18th, 2010 at 10:11 am
ge0rgecz Said,
well, he works for evil hm

Posted on March 18th, 2010 at 11:04 am
fighterpilot87 Said,
Does anyone know what the maximum number of LEDs are for the wii remote to detect?

Posted on March 18th, 2010 at 11:45 am
cprich22 Said,
he works for microsoft

Posted on March 18th, 2010 at 12:17 pm
cprich22 Said,
he works for microsoft

Posted on March 18th, 2010 at 12:43 pm
SeanIkon Said,
This guy is the shit!

Posted on March 18th, 2010 at 1:00 pm
sdpagent Said,
how do you overcome the issue of the angle of the head with the glasses? Surely if your not facing directly as the mounted wii remote, then there will be a discrepency with the depth it thinks your at. I take it your measuring the head distance from the remote by measuring the distance between the two LED’s. Turning head will make distance between LEDs appear closer, the same as moving away from the remote.

Posted on March 18th, 2010 at 1:58 pm
Mehuge Said,
Only any good for a single viewer

Posted on March 18th, 2010 at 2:17 pm
janey1029384756 Said,
Lol, thats so funny. They are so cute.

Posted on March 18th, 2010 at 3:14 pm
dylanroo Said,
Dude, this looks awesome!

Posted on March 18th, 2010 at 4:11 pm
Xialoh Said,
wow, that’s amazing..

Posted on March 18th, 2010 at 4:32 pm
WorldWideWeirdness Said,
I will buy a Wii, just to experience this. Pure awesome.

Posted on March 18th, 2010 at 4:54 pm
99UnavailableNames Said,
Respect

Posted on March 18th, 2010 at 5:53 pm
RDRLRA Said,
has someone done a game yet?

Posted on March 18th, 2010 at 6:14 pm
thetosman Said,
holy shit that blew my mind.

Posted on March 18th, 2010 at 6:45 pm
Grandoneliner Said,
Yeah so basically if it wasn’t for Avatar all of this talk about 3D wouldn’t exist…thats some real BS.

Posted on March 18th, 2010 at 7:33 pm
Berra0199 Said,
the guy works for microsft

Posted on March 18th, 2010 at 8:21 pm
Berra0199 Said,
Dude!!?!?!? Why don’t you work for nintendo, sony or microsoft? This was AWESOME!

Posted on March 18th, 2010 at 9:04 pm
shossofe Said,
damn straight.

Posted on March 18th, 2010 at 9:25 pm
ChocoboAuCitron Said,
Nintendo makes money with shitty games like Wii Music. Why would they spend money to make something that’s actually good ?

Posted on March 18th, 2010 at 10:12 pm
HillsideFirstSchool Said,
Good demo.
I want one of those

Posted on March 18th, 2010 at 10:53 pm
rymen Said,
this guy posted this video in 2007

now how DA F**K no company such as Nintendo, Sony or Microsoft came with something?????

This guy told them everything about it.
We’r in 2010 for Christ Sake…whats the problem???? Money? I say FUCK YOU.

Posted on March 18th, 2010 at 11:13 pm
MyFoodIsBad Said,
OMG YES!!

Posted on March 18th, 2010 at 11:48 pm

Add your comment

www.youtube.com Click here to watch Inside Gaming: Capcom Ripoff, IGN Has An Ego, Green with Envy- 1/15/11 (Video Game News)! Inside Gaming: Cross Platform Co-op, Akuma is back, MindJacking & Weekly Game Releases – 1/19/11 (Video Game News) S07E03 Cross platform Co-op, Akuma is back, MindJacking, and your game releases for the week. This is Inside Gaming for January 19, 2011. Best video ever can be found at www.youtube.com Killzone 3 Preview on our blog blog.machinima.com Check out IG’s blog! bit.ly Check out our Facebook app at apps.facebook.com – - – - – - – - – - – - – - – - – - – - – - – - – - – - – - – - – - – - – - Follow Machinima on Twitter! Machinima twitter.com Inside Gaming twitter.com Machinima Respawn twitter.com Machinima Entertainment, Technology, Culture twitter.com FOR MORE MACHINIMA, GO TO: www.youtube.com FOR MORE GAMEPLAY, GO TO: www.youtube.com FOR MORE SPORTS GAMEPLAY, GO TO: www.youtube.com FOR MORE MMO & RPG GAMEPLAY, GO TO: www.youtube.com FOR MORE TRAILERS, GO TO: www.youtube.com TAGS: Inside Gaming IG news machinima dead pixel Kovic twitter youtube facebook yt:quality=high Sony PS3 Playstation Cross platform Co-op Akuma Ted Wiiliams Valve E3 portal steamworks dlc EA PC xbox shadowrun Jonathan Coulton zodiac nintendo friends code ds 3ds Street Fighter marvel vs capcom 3 comic book fear 3 pokemon bulletstorm breach game releases little big planet mass effect 2 Square Enix MindJack ps3 Justegarde killzone 3 blog itunes destructoid

Tags: carnegie mellon university, Desktop, display, Displays, Head, Johnny Chung Lee, Tracking, using, wii remote, wiiremote