Found a project attempting some similar things. The creator (Tommy Paaske Hansen) gave up on the OpenCVSharp+Kinect direction in favor of some Sony PS3eye cameras:
Also the PS3Eye cameras that I’m using (and the kind people over at codeLaboratories: http://codelaboratories.com/ have spend alot of time doing drivers for), did not work well in the OpenCvSharp port… That is, I was only able to get a single camera at a time (and I really want to use two for a broader FOV), and I could not control any of the cameras sensor parameters (like gain, exposure, framerate, whitebalance etc.). In the end I ended up skipping the OpenCvSharp for Unity3D, in favor of a regular C++ OpenCv project and CLEye MultiCam SDK…
With the change to this, I managed to take control over the previously mentioned PS3Eye camera parameters, as well as grab video from 2 PS3Eye cameras simultaneously, and do color conversion on these…
Next step is the color segmentation and then BLOB analysis of the resulting binary images.
Finally I will now have to set up some communication between the C++ project and Unity3d, so far I’ve been looking into some simple TCP socket communication, and have the Unity side of that set up tested and running with a free example TCP server/client app I found online…
via Crowd gaming for kids and other playful spirits…: Project progress….