Esta página mostra as diferenças entre as duas revisões da página.
| Ambos os lados da revisão anterior Revisão anterior Próxima revisão | Revisão anterior | ||
|
visualpad:homepage [2006/07/11 09:23] marcus |
visualpad:homepage [2010/01/18 15:45] (Actual) |
||
|---|---|---|---|
| Linha 1: | Linha 1: | ||
| ====== VisualPad ====== | ====== VisualPad ====== | ||
| - | Interessante que o Jacob tem {{http://www.inf.ufrgs.br/~jacobs/Projects_English_version.html|pesquisa vinculada}}. | + | Interessante que o Jacob tem [[http://www.inf.ufrgs.br/~jacobs/Projects_English_version.html|pesquisa vinculada]]. |
| + | |||
| + | ===== Plano ===== | ||
| + | |||
| + | * Implementação do modelo de cores | ||
| + | * Deteção dos picos: Indicador + dedão. Conic fitting. | ||
| + | * Gesto: Click. | ||
| + | * Possibilidade de varias regiões de entrada. | ||
| ===== How to handle the distributed architecture ===== | ===== How to handle the distributed architecture ===== | ||
| Linha 7: | Linha 14: | ||
| [[http://wearables.unisa.edu.au/mpx/?q=documentation|MPX]] is a way to have multiple pointers in a X-Windows system. The usual X-Windows systems supports multiple input devices, but just one pointer. | [[http://wearables.unisa.edu.au/mpx/?q=documentation|MPX]] is a way to have multiple pointers in a X-Windows system. The usual X-Windows systems supports multiple input devices, but just one pointer. | ||
| - | What about [[http://ship.nime.ac.jp/~osawa/focusShare/031211/readme.html|FocusShare]] in Windows? Does it already the distribution we need? And can we combine that with [[http://cpnmouse.sourceforge.net/|CPNmouse]] which supports multiple mice in Windows (see also the sources [[http://link.mywwwserver.com/~jstookey/arcade/rawmouse|here]])? | + | * What about [[http://ship.nime.ac.jp/~osawa/focusShare/031211/readme.html|FocusShare]] in Windows? Does it already the distribution we need? |
| + | > Seems to be orientated towards video etc. | ||
| + | * And can we combine that with [[http://cpnmouse.sourceforge.net/|CPNmouse]] which supports multiple mice in Windows (see also the sources [[http://link.mywwwserver.com/~jstookey/arcade/rawmouse|here]])? | ||
| + | |||
| + | (1) Seperate the existing into input part to event stream tranformation | ||
| + | (2) Care for local IPC connection. | ||
| + | (3) Write an event stream server prototype: Needs connection handling + protocol implementation. | ||
| + | (3) Write an event stream client prototype: Needs connection handling + protocol implementation. | ||
| + | (4) What protocol to use? RFB? rdesktop? | ||
| ===== Artigos relevantes ===== | ===== Artigos relevantes ===== | ||
| + | |||
| + | |||
| + | http://www.dgp.toronto.edu/~ravin/ | ||
| ==== Input device ==== | ==== Input device ==== | ||
| * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=938920|The Hand Mouse: GMM hand-color classification and mean shifttracking (2001)]] | * [[http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=938920|The Hand Mouse: GMM hand-color classification and mean shifttracking (2001)]] | ||
| * [[http://research.microsoft.com/easyliving/Documents/2000%2009%20Wu%20for%20CHI.pdf|VisualPanel: Toward A Vision-Based Mobile Input Interface For Anywhere (2000)]] | * [[http://research.microsoft.com/easyliving/Documents/2000%2009%20Wu%20for%20CHI.pdf|VisualPanel: Toward A Vision-Based Mobile Input Interface For Anywhere (2000)]] | ||
| - | Characteristics: Dynamic programming quadrangle tracking, conic fitting of tip pointer. | + | Characteristics: One camera, panel detection by contrast (vague), dynamic programming quadrangle tracking, background difference for top detection (vague), conic fitting of tip pointer. |
| * [[http://www.wearable.ethz.ch/fileadmin/pdf_files/pub/ubicomp02-fingermouse.pdf|Fingermouse: A wearable hand tracking system (2002)]] | * [[http://www.wearable.ethz.ch/fileadmin/pdf_files/pub/ubicomp02-fingermouse.pdf|Fingermouse: A wearable hand tracking system (2002)]] | ||
| * [[http://www.merl.com/papers/docs/TR2003-125.pdf|DiamondTouch: A Multi-User Touch Technology (2003)]] | * [[http://www.merl.com/papers/docs/TR2003-125.pdf|DiamondTouch: A Multi-User Touch Technology (2003)]] | ||
| * [[http://www.cs.brown.edu/~tm/papers/multifcursors-gi2006.pdf|Multi-finger Cursor Techniques (2006)]] | * [[http://www.cs.brown.edu/~tm/papers/multifcursors-gi2006.pdf|Multi-finger Cursor Techniques (2006)]] | ||
| + | Characteristics: Input is standard touchpad. Describes new cursor techniques for >1 finger. | ||
| ==== Hand tracking ==== | ==== Hand tracking ==== | ||
| - | Approaches: >1 cameras (3D), with markers (colors etc.), infrared | + | Approaches: #cameras (2D,3D), type of camera (vision,infrared,...), type of object (hand, any, marked with color, etc.), type of model(shape, skin-color, etc., if any) |
| * [[http://portal.acm.org/citation.cfm?id=200241.200246|Visual tracking of high DOF articulated structures: an application to human hand tracking (1994)]] | * [[http://portal.acm.org/citation.cfm?id=200241.200246|Visual tracking of high DOF articulated structures: an application to human hand tracking (1994)]] | ||
| Linha 31: | Linha 50: | ||
| * [[http://www.csl.sony.co.jp/person/rekimoto/papers/chi02.pdf|SmartSkin - An Infrastructure for Freehand Manipulation on Interactive Surfaces (2002)]] | * [[http://www.csl.sony.co.jp/person/rekimoto/papers/chi02.pdf|SmartSkin - An Infrastructure for Freehand Manipulation on Interactive Surfaces (2002)]] | ||
| * [[http://citeseer.ist.psu.edu/rd/62769828%2C565909%2C1%2C0.25%2CDownload/http://citeseer.ist.psu.edu/cache/papers/cs/27343/http:zSzzSzwww.vision.ethz.chzSzpublzSzstarner-perceptive-mva03.pdf/starner03perceptive.pdf|The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D (2003)]] | * [[http://citeseer.ist.psu.edu/rd/62769828%2C565909%2C1%2C0.25%2CDownload/http://citeseer.ist.psu.edu/cache/papers/cs/27343/http:zSzzSzwww.vision.ethz.chzSzpublzSzstarner-perceptive-mva03.pdf/starner03perceptive.pdf|The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D (2003)]] | ||
| + | Characteristics: Multiple cameras, infrared, 3D-reconstruction. | ||
| * [[http://www.cs.toronto.edu/~smalik/downloads/2503_project_report.pdf|Real-time Hand Tracking and Finger Tracking for Interaction]] | * [[http://www.cs.toronto.edu/~smalik/downloads/2503_project_report.pdf|Real-time Hand Tracking and Finger Tracking for Interaction]] | ||
| + | Characteristics: Background subtraction, skin color detection (bayesian approach) | ||
| * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1301611|Real time hand tracking by combining particle filtering and mean shift (2004)]] | * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1301611|Real time hand tracking by combining particle filtering and mean shift (2004)]] | ||
| * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1384956|Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration (2004)]] | * [[http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=1384956|Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration (2004)]] | ||
| + | Characteristics: One camera. Pyramid-based KLT extract ~100 features (sharp bi-gradients), then flock model (birds) tracks their motion; color for features is learned. | ||
| * [[http://www.dgp.toronto.edu/papers/smalik_ICMI2004.pdf|Visual Touchpad: A Two-handed Gestural Input Device (2004)]] | * [[http://www.dgp.toronto.edu/papers/smalik_ICMI2004.pdf|Visual Touchpad: A Two-handed Gestural Input Device (2004)]] | ||
| Characteristics: Two cameras. Based on VisualPanel. | Characteristics: Two cameras. Based on VisualPanel. | ||