Multi(Touch) Gesture Research Lecture: Journal Club – spring 2010 Florian Weil University of Art Linz – Master: Interface Culture
Transcript
1. Multi(Touch) Gesture Research Lecture: Journal Club spring
2010 Florian Weil University of Art Linz Master: Interface
Culture
2. Questions Which differences exist in gesture interaction on
different screen sizes? How is the research community for gesture
interaction organized? Which conferences exist? Who are the key
researcher and other important researcher?
3. Different screenformats - Small Small Screens Smart
Phones
4. Different screenformats - Medium Netbooks Tablet PCs
5. Different screenformats - Large MultiTouch Displays TableTop
Displays
6. Different screenformats extra large Touch Walls
7. Researcher & People Explored Keynote and Opening
Speakers Reviewer Lists Papers Could not find key roles Good
balance of academic (University) and economic driven research
(Microsoft etc.)
8. Conferences & Community Computer Human Interaction (CHI)
Interactive Tapletop and Surfaces (ITS) Tangible, Embedded, and
Embodied Interaction (TEI) Gesture Workshop (GW)
9. Computer Human Interaction (CHI) Big and general conference
about Human and Computer Interaction Special Session about surfaces
and tabletop Interaction with gesture interaction Organizer Georgia
Institute of Technology Brigham Young University Microsoft Research
/ University of Washington Place Mainly USA and Canada, sometimes
Europe Atlanta, Boston, Florence, San Jose, Montreal...
10. Tangible, Embedded, andEmbodied Interaction (TEI) Medium
big conference on Tangible, Embedded, and Embodied Interaction.
Very good for gesture research for tangible devices. Sponsors:
Nokia, Microsoft Research, Philips, Fraunhofer, ACM, SIGCHI Place:
Europe and North America Portugal, USA, UK, Germany, ...
11. Interactive Tapletop and Surfaces Medium and pretty young
conference (started 2006) with focus on interaction design in
connection with surfaces and tabletop systems, like reactable Very
good for research in (multiTouch) gesture interaction Organizer:
Sriram Subramanian, University of Bristol, UK Antonio Krger (DFKI
GmbH) And other... Place: Very often in Europe Saarbrcken, Banff,
Amsterdam, Newport
12. Gesture Workshop Small conference / workshop with focus on
gesture interaction in general Mostly focus on free form and
auditive gestures Organizer University Bielefeld, Adetti,
University of South Brittany, Place Only in Europe Bielefeld,
Lisbon, Ile de Berder, Genova, London, ...
13. Researched PapersAnne Roudaut, Eric Lecolinet and Yves
Guiard, MicroRolls: expanding touch-screen input vocabulary
bydistinguishing rolls vs. slides of the thumb, Proceedings of CHI
2009, Boston, MA, USA, 2009, pp. 927-936..Tom Moscovich and John F.
Hughes, Indirect mappings of multi-touch input using one and two
hands,Proceedings of CHI 2008, Florence, Italy, 2008, pp.
1275-1284.Chi Tai Dang, Martin Straub, Elisabeth Andr, Hand
distinction for multi-touch tabletop interaction,Proceedings of ITS
2009, Banff, Alberta, Canada, 2009, pp. 101-108.Mathias Frisch,
Jens Heydekorn, Raimund Dachselt, Investigating multi-touch and pen
gestures fordiagram editing on interactive surfaces, Proceedings of
ITS 2009, Banff, Alberta, Canada, 2009, pp. 149-156Alexander
Schick, Florian van de Camp, Joris Ijsselmuiden and Rainer
Stiefelhagen, Extending touch:towards interaction with large-scale
surfaces, Proceedings of ITS 2009, Banff, Alberta, Canada, 2009,
pp.117-124.
14. Small Screen Gesture with Thumb
http://www.youtube.com/watch?v=bfH0-OqgbLw Context: during
movement, one hand interaction Categories: Drag, Swipe, Rubbing,
MicroRolls Testings (10 people, Aged 23-28) MicroRoll 2x faster
than contex menu UI MicroRoll same as fast as easy Toolbar, faster
than difficult toolbar MicroRoll Gesture itself: Robust and easy to
learn Good perfomance (influenced by the position of the gesture)
Good combination with TapTap, TapRoll, RollMark gestures
15. Medium screen: uni or bimanual gesture Context: TableTop
systems and Medium Screens Motivation: investigate perfomance and
the right task for uni and bimanual gestures Approach: Testing the
commands align, positioning, rotation, scaling of digital objects.
Result: Unimanual interaction for visual rotation, transporting,
rotating, and stretching Bimanual interaction for control of two
individual (control) points (example tasks: window manipulation,
image croping etc.) Perfomance differences are small, so the
designer can safely interchange between the two methods
16. TableTop Screen: Hand Distinction Context: TableTop systems
and Large Screens Motivation: Distinguish one-hand and two-hand
gestures improves gesture systems more stable and accurated gesture
recognition avoiding of conflicts in multi-user systems Approach:
use the anatomy information of the user hand and combine them with
touch point and finger orientation data. Result: Average: 96%
successfully hand recognition Thumb need a more detail observation
Heuristic formular works fine, but constant values needs
improvements
17. TableTop Screen: Hand Distinction Source: Chi Tai Dang,
Martin Straub, Elisabeth Andr, Hand distinction for multi-touch
tabletop interaction, Proceedings of ITS 2009, Banff, Alberta,
Canada, 2009, pp. 101-108.
18. Large Screen Gesture via Pointing
http://www.youtube.com/watch?v=cV60gwiM5HM Context: Big static
screen, some objects are not reachable Categories: Pointing and
Touch gestures Seamlessly direct object manipulation with pointing
and touch User test results: User think it is a very useful
extension Very intuitiv and easy learning interaction Objects are
easier to reach and less exhausting compared to touch-only systems
User did not really use these two interactions for the same
task