Comments on: How gestures will (probably) work http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/ Teaching Flash some new tricks Wed, 16 May 2012 15:05:19 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: gimmix http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-5321 gimmix Mon, 11 Apr 2011 17:19:33 +0000 http://bubblebird.at/tuioflash/?p=182#comment-5321 The library should work with any tracker software that is capable of converting kinect input data into tuio messages. Maybe have a look here: http://www.tuio.org/?software there seem to be a lot of kinect projects already. The only drawback may be, that you can't use the TuioManager or GestureManager properly if the tracker uses the tuio 3D or 2.5D profiles. Then you will maybe have to write your own listener for the TuioClient. The library should work with any tracker software that is capable of converting kinect input data into tuio messages. Maybe have a look here: http://www.tuio.org/?software there seem to be a lot of kinect projects already.
The only drawback may be, that you can’t use the TuioManager or GestureManager properly if the tracker uses the tuio 3D or 2.5D profiles. Then you will maybe have to write your own listener for the TuioClient.

]]> By: Mick http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-5315 Mick Mon, 11 Apr 2011 14:08:52 +0000 http://bubblebird.at/tuioflash/?p=182#comment-5315 Hi, I really appreciate your work and i have a question: Saywill it be possible to poll for the input of a Kinect Sensor via TUIO and use that data in a Flash game. I have seen it done before in a demo: http://http://www.controllerhacks.de/kinect-finger-tracking-mit-kinectcorevision/0054 Did look into this yet? Best regards, Mick Hi,

I really appreciate your work and i have a question:

Saywill it be possible to poll for the input of a Kinect Sensor via TUIO and use that data in a Flash game. I have seen it done before in a demo: http://http://www.controllerhacks.de/kinect-finger-tracking-mit-kinectcorevision/0054

Did look into this yet?

Best regards,

Mick

]]> By: gimmix http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-4303 gimmix Thu, 03 Mar 2011 09:49:58 +0000 http://bubblebird.at/tuioflash/?p=182#comment-4303 _x is the internal/private variable for x. As for the difference between x and X check out the Tuio spec. In a nutshell x is the position and X is the velocity vector along the x-axis. _x is the internal/private variable for x. As for the difference between x and X check out the Tuio spec. In a nutshell x is the position and X is the velocity vector along the x-axis.

]]> By: Pier http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-4295 Pier Thu, 03 Mar 2011 02:20:08 +0000 http://bubblebird.at/tuioflash/?p=182#comment-4295 What is the difference in the TuioContainer between x, _x and X ??? What is the difference in the TuioContainer between x, _x and X ???

]]> By: admin http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-1196 admin Sat, 14 Aug 2010 20:48:55 +0000 http://bubblebird.at/tuioflash/?p=182#comment-1196 yeah the code tag is a bit quirky :/ you also have to specify the lang="actionscript3" manually. I'll have a look at you gesture tomorrow but it looks alright on a quick glance. Maybe specifing a targetAlias is unnecessary. yeah the code tag is a bit quirky :/ you also have to specify the lang=”actionscript3″ manually.
I’ll have a look at you gesture tomorrow but it looks alright on a quick glance. Maybe specifing a targetAlias is unnecessary.

]]> By: George http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-1184 George Fri, 13 Aug 2010 13:37:04 +0000 http://bubblebird.at/tuioflash/?p=182#comment-1184 I tried to use the tag..didn`t work. How can I use syntax highlighting ? Can you highlight my code ? I tried to use the tag..didn`t work. How can I use syntax highlighting ? Can you highlight my code ?

]]> By: George http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-1183 George Fri, 13 Aug 2010 13:35:24 +0000 http://bubblebird.at/tuioflash/?p=182#comment-1183 Hi, thanks for your help! More than a month later I started a next try. I think this should work- in my small test project it does. Anything curious to you? I placed some comments. [code lang="actionscript3"] package org.tuio.gestures { import flash.display.DisplayObject; import flash.events.TransformGestureEvent; import flash.utils.getTimer; import org.tuio.TouchEvent; import org.tuio.TuioContainer; import org.tuio.TuioEvent; public class OneFingerFlickGesture extends Gesture { private var _startTime:uint=0; public static const MIN_DISTANCE_HORIZONTAL:Number=0.05; public static const MAX_DISTANCE_VERTICAL:Number=0.1; public static const THRESHOLD_ACCELERATION:Number=0.2; public function OneFingerFlickGesture(delay:uint=1000) { //register ANY target on touch_down, but never die if loosing target focus addStep(new GestureStep(TouchEvent.TOUCH_DOWN, {targetAlias:"!A",tuioContainerAlias:"A"} )); addStep(new GestureStep(TouchEvent.TOUCH_MOVE, { tuioContainerAlias:"A"} )); //die, other touch points are active addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:"!B",die:true} )); addStep(new GestureStep(TouchEvent.TOUCH_UP, { tuioContainerAlias:"!B",die:true} )); addStep(new GestureStep(TouchEvent.TOUCH_MOVE, { tuioContainerAlias:"!B",die:true} )); addStep(new GestureStep(TouchEvent.TOUCH_UP, {tuioContainerAlias:"A", maxDelay:delay,goto:2} )); addEventListener(GestureStepEvent.SATURATED,onStepSaturated); addEventListener(GestureStepEvent.DEAD,onStepDead); } private function onStepDead(e:GestureStepEvent):void{ } private function onStepSaturated(e:GestureStepEvent):void{ //save initial position for threshold actions on satisfaction if(e.step==1){ var gsg:GestureStepSequence=e.group; gsg.storeValue("aStartX",e.group.getTuioContainer("A").x); gsg.storeValue("aStartY",e.group.getTuioContainer("A").y); } } public override function dispatchGestureEvent(target:DisplayObject, gsg:GestureStepSequence):void { var accX:Number=gsg.getTuioContainer("A").X var accY:Number=gsg.getTuioContainer("A").Y var deltaY:Number=Math.abs(Number(gsg.getValue("aStartY"))-gsg.getTuioContainer("A").y); var deltaX:Number=Math.abs(Number(gsg.getValue("aStartX"))-gsg.getTuioContainer("A").x); //simple threshold if(Math.abs(accX)MAX_DISTANCE_VERTICAL || deltaX<MIN_DISTANCE_HORIZONTAL) return; trace("statisfied on target: "+gsg.getTarget("A")); gsg.getTarget("A").dispatchEvent(new TransformGestureEvent(TransformGestureEvent.GESTURE_SWIPE, true, false, null, 0, 0, 0, 0, 0,accX,accY)); } } } [/code] Regards George Hi, thanks for your help!
More than a month later I started a next try. I think this should work- in my small test project it does.
Anything curious to you? I placed some comments.

  1. package org.tuio.gestures {
  2.        
  3.         import flash.display.http://livedocs.adobe.com/flex/201/langref/%20inurl:displayobject.html“>DisplayObject;
  4.         import flash.events.TransformGestureEvent;
  5.         import flash.utils.getTimer;
  6.        
  7.         import org.tuio.TouchEvent;
  8.         import org.tuio.TuioContainer;
  9.         import org.tuio.TuioEvent;
  10.        
  11.         public class OneFingerFlickGesture extends Gesture {
  12.                 private var _startTime:http://livedocs.adobe.com/flex/201/langref/%20inurl:uint.html“>uint=0;
  13.                 public static const MIN_DISTANCE_HORIZONTAL:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=0.05;
  14.                 public static const MAX_DISTANCE_VERTICAL:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=0.1;
  15.                 public static const THRESHOLD_ACCELERATION:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=0.2;
  16.                
  17.                 public function OneFingerFlickGesture(delay:http://livedocs.adobe.com/flex/201/langref/%20inurl:uint.html“>uint=1000) {
  18.                         //register ANY target on touch_down, but never die if loosing target focus
  19.                         addStep(new GestureStep(TouchEvent.TOUCH_DOWN, {targetAlias:"!A",tuioContainerAlias:"A"} ));
  20.                         addStep(new GestureStep(TouchEvent.TOUCH_MOVE, { tuioContainerAlias:"A"} ));
  21.                        
  22.                         //die, other touch points are active
  23.                         addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:"!B",die:true} ));
  24.                         addStep(new GestureStep(TouchEvent.TOUCH_UP, { tuioContainerAlias:"!B",die:true} ));
  25.                         addStep(new GestureStep(TouchEvent.TOUCH_MOVE, { tuioContainerAlias:"!B",die:true} ));
  26.                        
  27.                         addStep(new GestureStep(TouchEvent.TOUCH_UP, {tuioContainerAlias:"A", maxDelay:delay,goto:2} ));
  28.                        
  29.                         addEventListener(GestureStepEvent.SATURATED,onStepSaturated);
  30.                         addEventListener(GestureStepEvent.DEAD,onStepDead);
  31.                 }
  32.                 private function onStepDead(e:GestureStepEvent):void{
  33.                        
  34.                 }
  35.                 private function onStepSaturated(e:GestureStepEvent):void{
  36.                         //save initial position for threshold actions on satisfaction
  37.                         if(e.step==1){
  38.                                 var gsg:GestureStepSequence=e.group;
  39.                                 gsg.storeValue("aStartX",e.group.getTuioContainer("A").x);
  40.                                 gsg.storeValue("aStartY",e.group.getTuioContainer("A").y);
  41.                         }
  42.                 }
  43.                 public override function dispatchGestureEvent(target:http://livedocs.adobe.com/flex/201/langref/%20inurl:displayobject.html“>DisplayObject, gsg:GestureStepSequence):void {
  44.                         var accX:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=gsg.getTuioContainer("A").X
  45.                         var accY:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=gsg.getTuioContainer("A").Y
  46.                         var deltaY:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=http://livedocs.adobe.com/flex/201/langref/%20inurl:math.html“>Math.abs(http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number(gsg.getValue("aStartY"))-gsg.getTuioContainer("A").y);
  47.                         var deltaX:http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number=http://livedocs.adobe.com/flex/201/langref/%20inurl:math.html“>Math.abs(http://livedocs.adobe.com/flex/201/langref/%20inurl:number.html“>Number(gsg.getValue("aStartX"))-gsg.getTuioContainer("A").x);
  48.                        
  49.                         //simple threshold
  50.                         if(http://livedocs.adobe.com/flex/201/langref/%20inurl:math.html“>Math.abs(accX)MAX_DISTANCE_VERTICAL || deltaX&lt;MIN_DISTANCE_HORIZONTAL) return;
  51.                        
  52.                         trace(&quot;statisfied on target: &quot;+gsg.getTarget(&quot;A&quot;));
  53.                         gsg.getTarget(&quot;A&quot;).dispatchEvent(new TransformGestureEvent(TransformGestureEvent.GESTURE_SWIPE, true, false, null, 0, 0, 0, 0, 0,accX,accY));
  54.                 }
  55.                
  56.         }
  57.        
  58. }

Regards
George

]]> By: gimmix http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-944 gimmix Fri, 25 Jun 2010 17:21:45 +0000 http://bubblebird.at/tuioflash/?p=182#comment-944 Hi @1: You can add an eventlistener to your gesture listening for GestureStepEvent.SATURATED and checking the step property of the event to be "1". -> Just like in the RotateGesture. @2: That's probably because of the use of the tuioContainerAlias. Remove that and it should work. You can use the "X" and "Y" properties of the TuioContainer which contain the velocity information of the point's move. I hope that helps a bit. Hi

@1: You can add an eventlistener to your gesture listening for GestureStepEvent.SATURATED and checking the step property of the event to be “1″. -> Just like in the RotateGesture.

@2: That’s probably because of the use of the tuioContainerAlias. Remove that and it should work.

You can use the “X” and “Y” properties of the TuioContainer which contain the velocity information of the point’s move.

I hope that helps a bit.

]]> By: George http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-942 George Fri, 25 Jun 2010 15:23:44 +0000 http://bubblebird.at/tuioflash/?p=182#comment-942 Hi, great framework! Especially the UDP Connection in AIR 2.0 is unique up to today. I want to create a flick gesture, but after spending hours I decided to ask my question here. Below you can see a very generic version, without any die mechanism- I only want to know, how to get the distance of tuio container A between frame n and frame n+x. Is this realizable in version 0.7 ? I can calculate the frame distance between "down" and "up" via a frameAlias for the first step, but this data is not useful for my calculation. 1. Is there a way to access/save the x,y position of a tuio container A when entering the first step ? I searched for a method like:GestureStepSequence.getTuioContainerAtFrame("A",12345) or a Event like GestureStepEvent.START to save my start values. 2. Look at the code lines where I commented out my "die" mechanism. What`s wrong with that ? The gestures is never dying. Thanks for your information. Regards, George public class FlickGesture extends Gesture { public function FlickGesture() { this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:"A", targetAlias:"A" } )); //this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:"B",die:true} )); this.addStep(new GestureStep(TouchEvent.TOUCH_MOVE, {tuioContainerAlias:"A"})); //this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:"B",die:true} )); this.addStep(new GestureStep(TouchEvent.TOUCH_UP, {tuioContainerAlias:"A",maxDelay:500})); } public override function dispatchGestureEvent(target:DisplayObject, gsg:GestureStepSequence):void { trace("FLICK " + getTimer()); trace(gsg.getTuioContainer("A").x); } } Hi,
great framework! Especially the UDP Connection in AIR 2.0 is unique up to today.

I want to create a flick gesture, but after spending hours I decided to ask my question here.

Below you can see a very generic version, without any die mechanism- I only want to know, how to get the distance of tuio container A between frame n and frame n+x. Is this realizable in version 0.7 ? I can calculate the frame distance between “down” and “up” via a frameAlias for the first step, but this data is not useful for my calculation.

1. Is there a way to access/save the x,y position of a tuio container A when entering the first step ?
I searched for a method like:GestureStepSequence.getTuioContainerAtFrame(“A”,12345)
or a Event like GestureStepEvent.START to save my start values.

2. Look at the code lines where I commented out my “die” mechanism. What`s wrong with that ? The gestures is never dying.

Thanks for your information.

Regards,
George

public class FlickGesture extends Gesture {

public function FlickGesture() {
this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:”A”, targetAlias:”A” } ));
//this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:”B”,die:true} ));
this.addStep(new GestureStep(TouchEvent.TOUCH_MOVE, {tuioContainerAlias:”A”}));
//this.addStep(new GestureStep(TouchEvent.TOUCH_DOWN, { tuioContainerAlias:”B”,die:true} ));
this.addStep(new GestureStep(TouchEvent.TOUCH_UP, {tuioContainerAlias:”A”,maxDelay:500}));
}
public override function dispatchGestureEvent(target:DisplayObject, gsg:GestureStepSequence):void {
trace(“FLICK ” + getTimer());
trace(gsg.getTuioContainer(“A”).x);

}
}

]]> By: Release 0.7 « Tuio Flash Blog http://bubblebird.at/tuioflash/2010/05/how-gestures-will-probably-work/comment-page-1/#comment-841 Release 0.7 « Tuio Flash Blog Sun, 06 Jun 2010 20:50:43 +0000 http://bubblebird.at/tuioflash/?p=182#comment-841 [...] Gestures based on native GestureEvents + a system to easily create new gestures (-> have a look at this post which explains how it works). Currently a very simple rotate and scale gesture are [...] [...] Gestures based on native GestureEvents + a system to easily create new gestures (-> have a look at this post which explains how it works). Currently a very simple rotate and scale gesture are [...]

]]>