Fubi is a framework for full body interaction using a depth sensor such as the Microsoft Kinect or the Asus Xtion with OpenNI/NiTE or the Kinect SDK. It further supports the Leap Motion Controller. FUBI is written in C++ and additionally includes a C#-Wrapper. FUBI releases are only tested on Windows 7/8, but the community has already successfully built it under a Linux environment.
Fubi's main functionality is providing gesture and posture recognition capabilities. The Framework therefore distinguishes between three gesture categories:
* Static postures: Configuration of several joints (positions or orientations), no movement, e.g. "arms crossed".
* Linear/Angular movements: Linear movement of several joints with specific direction and speed (e.g. "right hand moves right") or angular movement of a joint (e.g. "turn head right").
* Combination of postures and movements: Combines sets of 1 and 2 in a sequence of states with specific time constraints (e.g. "waving right hand").