Celestia controlled by Kinect – proof of concept

Posted: April 3, 2011 in Independent Learning Module, Kinect

This evening I made a huge step in achieving the technical element of my research project. Up until now using Kinect to control anything other than tech demos was little more than theory. Tonight I hooked up Kinect to Celestia and performed a few simple actions. The upshot is: it’s possible!

I used the excellent FAAST – Flexible Action and Articulated Skeleton Toolkit – from the University of Southern California. It’s a relatively simple piece of middleware for OpenNI NITE. This is currently a closed development but they intend on making it open source once some new features have been added and some stability issues resolved. It’s good enough for me for now. It offers the ability to rapidly prototype by emulating key presses/holds based on the detection of a number of stock gestures.

My final product will need to be greatly refined over this, but at least it gives me some confidence that I haven’t bitten off more than I can chew.

Here it is. Not bad for an hour’s work.

  1. Tony says:

    Freaking amazing mate, good job.

  2. Guillem says:

    I was intending on taking a stab at Celestia Kinect after seeing Microsoft’s Worldwide telescope demo at MIX 11 (http://live.visitmix.com).

    I’ll check your blog for updates!

    • rymixxx says:

      Still do! I might not have the time to do as thorough a job as I’d like. My main concern is whether to embed gesture code in the Celestia code or to use an external interface layer to trigger Celestia events. The former is arguable more thorough but the latter is likely to yield much faster and more feature-rich results given my timeframe. And anyway, different takes on the same subject are always interesting :)

  3. The Mock-Sun says:

    This is awesome! Can you post the FAAST action bindings, please?

  4. […] checking in « Oasis in the sand on Official Microsoft Kinect SDKrymixxx on Celestia controlled by Kinect – proof of conceptThe Mock-Sun on Celestia controlled by Kinect – proof of conceptGemma on Guide to setting […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s