====== VisualPad ======

Interessante que o Jacob tem [[http://www.inf.ufrgs.br/~jacobs/Projects_English_version.html|pesquisa vinculada]].

===== Plano =====

  * Implementação do modelo de cores
  * Deteção dos picos: Indicador + dedão. Conic fitting.
  * Gesto: Click.
  * Possibilidade de varias regiões de entrada.

===== How to handle the distributed architecture =====

[[http://wearables.unisa.edu.au/mpx/?q=documentation|MPX]] is a way to have multiple pointers in a X-Windows system. The usual X-Windows systems supports multiple input devices, but just one pointer.

  * What about [[http://ship.nime.ac.jp/~osawa/focusShare/031211/readme.html|FocusShare]] in Windows? Does it already the distribution we need?
> Seems to be orientated towards video etc.
  * And can we combine that with [[http://cpnmouse.sourceforge.net/|CPNmouse]] which supports multiple mice in Windows (see also the sources  [[http://link.mywwwserver.com/~jstookey/arcade/rawmouse|here]])?

(1) Seperate the existing into input part to event stream tranformation
(2) Care for local IPC connection.
(3) Write an event stream server prototype: Needs connection handling + protocol implementation.
(3) Write an event stream client prototype: Needs connection handling + protocol implementation.
(4) What protocol to use? RFB? rdesktop?

===== Artigos relevantes =====


http://www.dgp.toronto.edu/~ravin/

==== Input device ====
  * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=938920|The Hand Mouse: GMM hand-color classification and mean shifttracking (2001)]]
  * [[http://research.microsoft.com/easyliving/Documents/2000%2009%20Wu%20for%20CHI.pdf|VisualPanel: Toward A Vision-Based Mobile Input Interface For Anywhere (2000)]]
  Characteristics: One camera, panel detection by contrast (vague), dynamic programming quadrangle tracking, background difference for top detection (vague), conic fitting of tip pointer.
  * [[http://www.wearable.ethz.ch/fileadmin/pdf_files/pub/ubicomp02-fingermouse.pdf|Fingermouse: A wearable hand tracking system (2002)]]
  * [[http://www.merl.com/papers/docs/TR2003-125.pdf|DiamondTouch: A Multi-User Touch Technology (2003)]]
  * [[http://www.cs.brown.edu/~tm/papers/multifcursors-gi2006.pdf|Multi-finger Cursor Techniques (2006)]]
  Characteristics: Input is standard touchpad. Describes new cursor techniques for >1 finger.

==== Hand tracking ====
Approaches: #cameras (2D,3D), type of camera (vision,infrared,...), type of object (hand, any, marked with color, etc.), type of model(shape, skin-color, etc., if any)

  * [[http://portal.acm.org/citation.cfm?id=200241.200246|Visual tracking of high DOF articulated structures: an application to human hand tracking (1994)]]
  * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=471660|A usable real-time 3D hand tracker (1994)]]
  * [[http://scholar.google.com.br/url?sa=U&q=http://www.uk.research.att.com/pub/docs/ORL/tr.95.1.ps.Z|Real-time hand tracking and gesture recognition using smart snakes (1995)]]
  * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=346260|DigitEyes: vision-based hand tracking for human-computerinteraction (1999)]]
  * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=840675|Fast tracking of hands and fingertips in infrared images for augmented desk interface (2000)]]
  * [[http://portal.acm.org/citation.cfm?id=971478.971512|Hand tracking for human-computer interaction with Graylevel VisualGlove: turning back to the simple way (2001)]]
  * [[http://portal.acm.org/citation.cfm?id=618944&dl=GUIDE&coll=GUIDE&CFID=15151515&CFTOKEN=6184618d|Real-Time Fingertip Tracking and Gesture Recognition (2002)]]
  * [[http://www.csl.sony.co.jp/person/rekimoto/papers/chi02.pdf|SmartSkin - An Infrastructure for Freehand Manipulation on Interactive Surfaces (2002)]]
  * [[http://citeseer.ist.psu.edu/rd/62769828%2C565909%2C1%2C0.25%2CDownload/http://citeseer.ist.psu.edu/cache/papers/cs/27343/http:zSzzSzwww.vision.ethz.chzSzpublzSzstarner-perceptive-mva03.pdf/starner03perceptive.pdf|The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D (2003)]]
  Characteristics: Multiple cameras, infrared, 3D-reconstruction.
  * [[http://www.cs.toronto.edu/~smalik/downloads/2503_project_report.pdf|Real-time Hand Tracking and Finger Tracking for Interaction]]
  Characteristics: Background subtraction, skin color detection (bayesian approach) 
  * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1301611|Real time hand tracking by combining particle filtering and mean shift (2004)]]
  * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1384956|Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration (2004)]]
  Characteristics: One camera. Pyramid-based KLT extract ~100 features (sharp bi-gradients), then flock model (birds) tracks their motion; color for features is learned.
  * [[http://www.dgp.toronto.edu/papers/smalik_ICMI2004.pdf|Visual Touchpad: A Two-handed Gestural Input Device (2004)]]
  Characteristics: Two cameras. Based on VisualPanel.
  * [[http://cs-people.bu.edu/athitsos/publications/wacv2005.pdf|Automatic 2D Hand Tracking in Video Sequences (2005)]]
  Characteristics: Tracks hands (finds bounding box of two hands in videos).
  * [[http://portal.acm.org/citation.cfm?id=1095034.1095042|Interacting with large displays from a distance with vision-tracked multi-finger gestural input (2005)]]
  Characteristics: Two-handed, two cameras, black input area (with id tag), gestures, based on Visual Touchpad.

Well, there is no [[http://scholar.google.com.br/scholar?as_q=&num=10&btnG=Pesquisar+no+Google+Acad%C3%AAmico&as_epq=hand+tracking&as_oq=&as_eq=&as_occt=any&as_sauthors=&as_publication=&as_ylo=2005&as_yhi=2010&hl=pt-BR&lr=|lack of publications]] in this field...