Flexible Action and Articulated Skeleton Toolkit (FAAST), a project from University of Southern California posted a new video on YouTube which shows Microsoft Kinect, an Xbox 360 peripheral alongside the Bluetooth headphone used to control characters in the PC version of best-selling game, The Eder Scrolls V: Skyrim.

FAAST is a project that utilizes OpenNI Framework in order to modify the applications so that they could use Kinect controller as a gaming peripheral in games more complicated than the regular motion detection ones.

FAAST middleware (currently available version 0.09) translates movement into keystrokes of typical movement in games (W,A,S, D, Space, Ctrl etc.). Combining this with VAC (Voice Activated Control) app enabled researchers to enjoy near full interaction with virtual characters of Skyrim.

This is the list of currently supported voice commands:

  • saying "Left hand" or "Right hand" to equip an item to a particular hand when in menu
  • saying "Hello" to activate a conversation with a store owner or NPC
  • saying "Journal" to access the journal
  • saying "Skills" to access the skill trees
  • saying "Switch View" to change between 1st and 3rd person perspectives.

 Without further adue, see the video for yourself:

Just like the original Quake RT (Ray Tracing) project by then young student Daniel Pohl, who is now an Intel Ray-Tracing researcher, seeing university projects like this only makes us wonder why more companies do not get engaged with universities such as University of Southern California.