Beta
×

Welcome to the Slashdot Beta site -- learn more here. Use the link in the footer or click here to return to the Classic version of Slashdot.

Thank you!

Before you choose to head back to the Classic look of the site, we'd appreciate it if you share your thoughts on the Beta; your feedback is what drives our ongoing development.

Beta is different and we value you taking the time to try it out. Please take a look at the changes we've made in Beta and  learn more about it. Thanks for reading, and for making the site better!

Open Source Gesture Recognition For Kinect SDK

timothy posted about 3 years ago | from the everybody-will-have-been-kung-fu-fighting dept.

Input Devices 25

Rymix writes "I have been working with a new internet-friend of mine to produce an open source gesture recording and recognition engine for Kinect SDK. It's based on the Dynamic Time Warping technique and allows developers to record their own gestures and reliably recognise them. It's currently 2D but 3D is an easy development, coming soon. We're looking for community take-up and contribution to this project — it could help a lot of people with rapid prototyping and could even be used in production solutions (within the Kinect SDK's terms of use, of course!)."

cancel ×

25 comments

Sorry! There are no comments related to the filter you selected.

CAN YOU SEE THIS GESUTURE !! (-1)

Anonymous Coward | about 3 years ago | (#36990770)

FU !!

If this gets a 'hardhack' tag... (0)

Anonymous Coward | about 3 years ago | (#36990836)

..you will all die. Nuclear-style.

Open Source and can only be used with the SDK EULA (0)

h4rr4r (612664) | about 3 years ago | (#36990842)

Open Source and can only be used with the SDK terms, seems pretty pointless. Probably would be better to work on supporting the device on an actual Open stack.

Re:Open Source and can only be used with the SDK E (0)

Anonymous Coward | about 3 years ago | (#36990886)

Yeah, how dare you release something in a manner that h4rr4r doesn't approve! This is a total affront!

*snore* (-1)

Anonymous Coward | about 3 years ago | (#36990846)

Cool story, bro. *snooooooore*

Re:*snore* (1)

Rymix (2429644) | about 3 years ago | (#36994380)

You rock. Not much, though.

Needs more work (2)

PCM2 (4486) | about 3 years ago | (#36990884)

Initial testers found only one gesture they could make at the Microsoft device that triggered any response.

What's the big deal? (1)

PCM2 (4486) | about 3 years ago | (#36990942)

In all seriousness, why all the stories about the Kinect? I don't play videogames, so that aspect doesn't interest me. Getting it to do stuff it wasn't made to do is a cool hack, and I can appreciate that. I can picture some important applications for the disabled, I guess. Is there anything more to it than that? Am I missing something?

Re:What's the big deal? (1)

Zerth (26112) | about 3 years ago | (#36991056)

A similar device to do 3d vision for robots used to(still does) cost at least in the mid thousands if not low tens of thousands of dollars.

Re:What's the big deal? (0)

Anonymous Coward | about 3 years ago | (#36991060)

porn?

Re:What's the big deal? (4, Informative)

AdmiralXyz (1378985) | about 3 years ago | (#36991124)

Every single time there's a Kinect story, someone has to ask this question. My cynical side wonders whether they'd still be doing this if the Kinect wasn't a Microsoft product, but here's [slashdot.org] a comment I posted a while back that explains why, even though it may be overrhyped as a video game peripheral, the Kinect is damned cool for robotics applications. The robotics community has, almost overnight, dropped work on many other kinds of input sensors to focus on the Kinect because it's so much more useful (see openni_kinect on ROS [ros.org] for the primary driver, although we'll see if this continues to see love now that an official SDK is out).

Re:What's the big deal? (2)

PCM2 (4486) | about 3 years ago | (#36991228)

The robotics community has, almost overnight, dropped work on many other kinds of input sensors to focus on the Kinect because it's so much more useful

First I've heard of it. The way the summaries are always worded, to the uninitiated it always sounds like the same story: Kinect hacker hacks Kinect!

Re:What's the big deal? (2)

Dr Herbert West (1357769) | about 3 years ago | (#36991328)

Mod parent up, please. I'm getting sick of the flurry of "you made something with your own two hands? color me unimpressed" type comments on Slashdot anytime there's a story about kinect hacking or other Maker type stuff. I got into this field because I liked to break/take apart/repurpose stuff as a kid, and these experiments satisfy that urge today. Not everyone comes to this site to bitch about video drivers or start OS platform flame wars. /end rant.

In response to AdmiralXyz's comment, I'm not really seeing so much work being done with the SDK that's not video game related-- openNI has been around for a while, and it's cross platform-- even runs on Linux I believe. The "weird kinect experiments" community seems to have embraced openNI as well as openKinect (a wrapper for Processing/Java), a trend that I would like to see continue.

Re:What's the big deal? (1)

Lunix Nutcase (1092239) | about 3 years ago | (#36991160)

Good point. We should have all the people currently hacking on the Kinect or using the SDK to just stop all work and abandon it all because PCM2 can't see any important applications for the hardware. With such definitive evidence on the uselessness of the Kinect, this SDK or any apps currently written or being worked on, I can't see how any could argue against these conclusions.

Re:What's the big deal? (1)

PCM2 (4486) | about 3 years ago | (#36991256)

Good point. We should have all the people currently hacking on the Kinect or using the SDK to just stop all work and abandon it all because PCM2 can't see any important applications for the hardware. With such definitive evidence on the uselessness of the Kinect, this SDK or any apps currently written or being worked on, I can't see how any could argue against these conclusions.

My God, you have read my mind! You should find some scientists, I'm sure there is important research to be done on your uncanny abilities.

Re:What's the big deal? (1)

Lunix Nutcase (1092239) | about 3 years ago | (#36991374)

So then what exactly was the point of your post?

Important News Bulletin: PCM2 has no idea for how the Kinect could be used for interesting or important applications! Film at 11.

Re:What's the big deal? (1)

PCM2 (4486) | about 3 years ago | (#36991576)

Apparently, despite having the same punctuation, the point of your post was not the same as the point of my post, which was to ask a question.

Feature Request (-1)

Anonymous Coward | about 3 years ago | (#36991262)

I'd like it to send a nasty e-mail to Microsoft any time I make this one specific gesture ..|..

Lol, you guys are funny (2)

Rymix (2429644) | about 3 years ago | (#36991820)

There are several reasons for this study: 1) It's a component of an academic study into the effects of 'natural' human-computer interaction on learning and teaching. There sure is a lot of buzz about Kinect at the moment, so studies like this will help to prove just how useful gesture controls could really be. Or not. Open mind... 2) Dynamic Time Warping is a viable but relatively under-explored method for vector-based gesture recording and recognition. It's interesting to see how well this can perform against more established methods. 3) There's not much out there for the Kinect SDK yet, so why not build something nice, like? If it proves to be popular I will refactor into an open-standards form and release for all sensor applications. 4) It's a very immature product and needs a lot of work before it's really useful - hence the open source. 5) Kinect SDK's license is currently research only, but I have it on good authority that this will change soon. I'm not quite sure what to, though. 6) Working on stuff like this is, to me, like playing with Lego. I just enjoy it. I enjoy creating something, investigating, exploring...don't like that? I'm cool with that. But don't bite me for it. 7) I just realised this numbered list could look rude or arrogant. Sorry about that. But I couldn't figure out how to get carriage returns into comments. 8) Another point of KinectDTW is that you can teach it you own gestures. Try it, and if they're unreliably recognised, try tweaking the parameters for your environment. A future development would see dynamic parameters per person/room/gesture for maximum reliability. 9) There is no 9) 10) If you like it, or even if you don't, please keep the feedback rolling in. I like to read you opinions :) And if you can, contribute. I'd really appreciate better minds than mine working on this too.

Re:Lol, you guys are funny (1)

sonamchauhan (587356) | about 3 years ago | (#36995450)

Someone mod parent post up please ... its the original story poster.

And my feedback. The Kinect is a potentially great piece of hardware but...
Being protected from a potentially eyeblinding 60 mW infrared laser, with only crackable, diffraction gratings to disperse the beam across the room is a bit too risky for me.

This video shows that accidentally bringing your eye one or two inches, even with the Kinect optics intact, can blind you.
http://www.youtube.com/watch?v=7qLDzLYPG-w [youtube.com]

Think of when you may get your face accidentally too close... like when switching something on or off in AV equipment... or worse, children starting into the projector.

Balanced discussion here: http://skeptics.stackexchange.com/questions/2625/is-the-kinect-ir-laser-safe [stackexchange.com]
(see the end of the page, where I found the YouTube link above)

Re:Lol, you guys are funny (1)

Rymix (2429644) | about 3 years ago | (#37000092)

Very interesting comment. I can't claim to know anything at all about this device's safety (or lack thereof) but I will certainly look into it. If you'll excuse the pun. Steve

Re:Lol, you guys are funny (1)

sonamchauhan (587356) | about 3 years ago | (#37039970)

Heheh - good pun. :)

Great... but... (0)

Anonymous Coward | about 3 years ago | (#36993224)

... Can I do some Minority Report level shit yet on my Linux box?

Missing Gesture Lib (1)

BSalita (1000791) | about 3 years ago | (#36996822)

This software unblocks my use of Kinect. Microsoft has not released a gesture library. Looks like this will enable it's creation.

Re:Missing Gesture Lib (1)

Rymix (2429644) | about 3 years ago | (#36998040)

Awesome! Glad to be of help. It would be great if you shared your gesture files and settings...this is all rather experimental after all :)
Check for New Comments
Slashdot Login

Need an Account?

Forgot your password?

Submission Text Formatting Tips

We support a small subset of HTML, namely these tags:

  • b
  • i
  • p
  • br
  • a
  • ol
  • ul
  • li
  • dl
  • dt
  • dd
  • em
  • strong
  • tt
  • blockquote
  • div
  • quote
  • ecode

"ecode" can be used for code snippets, for example:

<ecode>    while(1) { do_something(); } </ecode>