Projects

6dofstreamer

This project uses the non-commercial version of FaceAPI to obtain 6 degrees of freedom headtracking through a webcam. This data is exported through a socket connection.

wiimote-spacial-locator

This is part of a larger project to get "proper" head tracking into first person shooter. Previously, head tracking software used the head tracking as a means of controlling where your avatar in the virtual world was facing but this feels wrong because when you turn your head to the left ... [More] , you are no longer looking at your monitor. If you were to have some kind of surround display, you would still not want the head tracking to do this because looking to the left would simply allow you to see the left monitor. The correct immersive effect for a head tracking device is to allow the user to view the monitor as a window into another world, allowing them to look "around the corner" of the monitor. In order to do this the the 3D application needs to use an asymmetric view frustum instead of the normal symmetric one. The source code available here is for the: Wii remote driver (the part that let's you use a Wii remote on your PC). The spacial locator (the part that figures out where in space the LED is relative to the camera). A small test application to test the use of these two things. For the curious, I did get this working in HL2 as a mod but unfortunately the HL2 engine doesn't allow a fine enough level of control over the rendering system to implement an asymmetric view frustum. Plus my 2 week Christmas vacation ended. :) This code is not maintained anymore. If you are interested in making changes send me an e-mail and I will add you to the members list. My address is my username (listed on the right) plus @gmail.com. [Less]

wiir3d

WiiR3DThe goal of the project is for the team to develop a head tracking component along with a variety of demonstrative applications. The project was inspired by the new revolutionary headtracking technology established by Johnny Lee for the Wii remote (http://www.cs.cmu.edu/~johnny/projects/wii/). ... [More] Head tracking will allow the players to physically interact with the 3D environments in a manner until now unparalleled in the console gaming domain. [Less]

rscviht

Remote system control via infrared head trackingSynopsisBy placing points of infrared light on either side of the users head and viewing it through an infrared camera it is possible to find the relative position of the users head. The Wii Remote is an inexpensive piece of hardware which contains ... [More] , among other things, an infrared camera and an image processor which transforms sources of infrared light to point data on board the controller. The Wii Remote communicates with its home console using the Bluetooth HID protocol which means that by simply pairing a remote with the computer we can receive this infrared point data directly and process it further in MATLAB for the purpose of controlling remote hardware such as a camera mounted to a stepper motor. ImplementationMany infrared goggles contain white LED's on either side of the wearers head. By simply replacing these with infrared LED's we can track the relative motion of the users head along the Tait-Bryan rotations (pitch, roll, and yaw). To receive point data from the Wii Remote a DLL has been written in C++ to act as a bridge between MATLAB and Brian Peek's WiimoteLib (http://www.brianpeek.com/blog/pages/wiimotelib.aspx). Project MembersKapur, Parul Clayton, McKenzie Whited, Sam Equipment3x Wiimote IR LED equipped Glasses Scribbler Robot with Bluetooth Webcam Stepper Motor .gadget-title { margin-bottom: 2px; } function resizeIframeHandler(height) { var elem = document.getElementById(this.f); height = Math.max(100, height); if (elem) { elem.style.height = height + 'px'; } } gadgets.rpc.register("resize_iframe", resizeIframeHandler); gadgets.rpc.register('set_title', function(title) { var elem = document.getElementById(this.f + '_title'); if (elem) { elem.innerHTML = gadgets.util.escape(title); } }); [Less]

opengaze

OpenGaze is a realtime and portable implementation of the state-of-the-art techniques in remote visible eyetracking using standard desktop webcams. It aims at providing a working solution to : Human Computer Interaction for the disabled Usability studies using eyetracking Games, 3D worlds and ... [More] augmented reality interaction Artistic installations Scientific research Sensory Marketing ... and much more ! Here are a few examples of targeted audience of this project : COGAIN User Centered Design Pure Data for artists Games devs Desktop UI designers Dasher Text Input for disabled OpenSource text input Eyetracking scrolling Marketing studies Attention related UI Google Research ;) Interactive installations designers ("paint" with your eyes !) Here's a letter from a girl named Sarah. Part of her well being and happiness, and well as many throughout the world rely on our shoulders ;) Let's do it and give the world a robust way to capture the gaze and build incredible, useful, fun, valuable applications on top of it ! Thank you. [Less]

htdp

wii-headtracking

Demo inspired by Johnny Chung Lees YouTube video of headtracking. Put the Wiimote by your TV-set while you hold the sensorbar above or under your head. The image will zoom and pan around as you move in front of the TV. Controls: Home - Back to Homebrew channel A - Show debug information D-pad plus minus - change variables

vr-wear-sl-headtracking

The software is a modification of the Second Life client on windows and OSX and uses OpenCV plus a home-made filter chain to identify facial motions and expressions. We categorized those motions as a limited set of "emotions" and when detected they are applied to your avatar's head is ... [More] Second Life. Note: third parties don't need to use the mod to see the expressions on you avatar's face All the code is in GPL : Only constraints : the webcam configuration pane must not be removed and reference to VR-WEAR must be kept as-is [Less]

WPF 3D Headtracking

The WPF 3D Headtracking library allows you to transform any WPF 3D application in an immersive experience simply by wrapping your common Viewport3D in a special Decorator element. No code needed! Compatible with the Wiimote and mouse as headtracking providers, and easy to extend.

terrainviewerandgenerator

Terrain Viewer & Terrain Generator (TWG) for Responsive WorkBench (RWB)Main goal of the program is to create a tool for Geographical Information System users. With wii remote and head tracking system, controls will be implemented and tested if a GIS application can use these controls, and bring ... [More] an inutiative approach to the field. This program can run under either Windows or Linux This program can be rendered in various Camera models as stereoscopic or monoscopic viewing This program especially is written for RWB stationed at Boğaziçi University NOTE: Source will not be available until project completes and gets accepted by the university. However demo videos and binaries will be on site asap. UPDATE : Wiki page is open for comments now! Go and check it out!Implemented :Terrain Mesh Construction LOD implementation Frustrum Culling Implementation Multitexturing implementation Wiimote IR and accelerometer controlled observer Whiteboard mode Multitouch support & Multitouch mode over TUIO Stereo camera implementation LINUX portation Under Development: Planned Improvement:Polygon marking & picking by wiimote Rumble effect according to height on terrain which cursor shows Noise effect Terrain Generator implementation Mail me for further questions Tags : Terrain Viewer , 3D Terrain , Stereoscapic Terrain , OpenGL Terrain , Wii , Nintendo , Wiimote , WiiRemote [Less]