ISMAR 06 --- Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality --- Oct. 22 - 25, 2006 in Santa Barbara, CA


Conference Program (preliminary)

Oct 22 2006
8:00am - 6:00pm Registration
9:00am - 6:00pm Workshop (full day):
Industrial Augmented Reality

9:00am - 6:00pm Affiliated Workshop (full day):
Mixed Reality Technology for Film Making

9:00am - 1:00pm Tutorial 1 (half day):
Computer Vision for Augmented Reality

12:30pm - 2:00pm Lunch Session
Student Research Colloquium

2:30pm - 6:30pm Tutorial 2 (half day):
Head-worn Displays (HWD) Fundamentals and Applications

More information:  Tutorial and Workshop Booklet
6:30pm - 8:30pm Workshop/Tutorial/Colloquium Reception
Oct 23 2006
08:00am Registration opens
08:40am Opening
09:00am Keynote 1 by Ramesh Raksar
10:00am Coffee break
  Session: Applications of AR
10:20am Interactive Laser Projection for Programming Industrial Robots by Michael Zäh, Wolfgang Vogl
10:40am Photometric Inconsistency on a Mixed-Reality Face by Masayuki Takemura, Itaru Kitahara, Yuichi Ohta
11:10am Texture Overlay for Virtual Clothing Based on PCA of Silhouettes by Jun Ehara, Hideo Saito
11:30am Lunch break
  Session: Tracking
12:30pm Automatic Online Walls Detection for Immediate Use in AR Tasks by Gilles Simon
12:50pm Predicting and Estimating the Accuracy of Optical Tracking Systems by Martin Bauer, Michael Schlegel, Daniel Pustka, Nassir Navab, Gudrun Klinker
 1:20pm Hybrid tracking algorithms for planar and non-planar structures subject to illumination changes by Muriel Pressigout, Éric Marchand
 1:40pm Online camera pose estimation in partially known and dynamic scenes by Harald Wuest, Gabriele Bleser, Didier Stricker
 2:10pm Coffee break
  Session: AR User Interfaces
 2:30pm Implementation of God-like Interaction Techniques For Supporting Collaboration Between Indoor and Outdoor Users by Aaron Stafford, Wayne Piekarski, Bruce Thomas
 3:00pm A 2D-3D Integrated Interface for Mobile Robot Control Using Omnidirectional Images and 3D Geometric Models by Kensaku Saitoh, Takashi Machida, Kiyoshi Kiyokawa, Haruo Takemura
 3:20pm The Universal Media Book: Tracking and Augmenting Moving Surfaces with Projected Information by Shilpi Gupta, Christopher Jaynes
Oct 24 2006
08:30am Registration opens
  Session: Mobile Tracking
09:00am Performance Analysis of an Outdoor Augmented Reality Tracking System that Relies Upon a Few Mobile Beacons by Ronald Azuma, Howard Neely III, Mike Daily, Jon Leonard
09:20am A mobile markerless AR system for maintenance and repair by Juri Platonov, Hauke Heibel, Peter Meier, Bert Grollmann
09:40am Going out: Robust, Model-based Tracking for Outdoor Augmented Reality by Gerhard Reitmayr, Tom Drummond
10:10am LightSense: Enabling Spatially Aware Handheld Interaction Devices by Alex Olwal
10:30am Coffee break
  Session: Mobile User Interfaces
10:50am Ubiquitous Animated Agents for Augmented Reality by Istvan Barakonyi, Dieter Schmalstieg
11:20am Visualizing and Navigating Complex Situated Hypermedia in Augmented and Virtual Reality by Sinem Güven, Steven Feiner
11:40am Using Aerial Photographs for Improved Mobile AR Annotation by Jason Wither, Stephen DiVerdi, Tobias Hollerer
12:00pm Lunch break
  Session: Evaluations
 1:00pm Quantification of Visual Capabilities using Augmented Reality Displays by Mark Livingston
 1:30pm Effective Control of a Car Driver? Attention for Visual and Acoustic Guidance towards the Direction of Imminent Dangers by Marcus Toennis, Gudrun Klinker
 2:00pm User Evaluations on Form Factors of Tangible Magic Lenses by Ji-Young Oh, Hong Hua
 2:30pm Evaluation of Three Input Techniques for Selection and Annotation of Physical Objects Through an Augmented Reality View by Bruce Thomas
 2:50pm Coffee Break
 3:10pm Poster/demo teaser
 4:00pm Poster/demo session 1
 6:00pm Break
Oct 25 2006
08:30am Registration opens
09:00am Keynote 2 by Tom Furness
10:00am Coffee break
  Session: Calibration and registration
10:20am An All-In-One Solution to Geometric and Radiometric Calibration by Julien Pilet, Andreas Geiger, Pascal Lagger, Vincent Lepetit, Pascal Fua
10:50am A Registration Evaluation System Using an Industrial Robot by Kiyohide Satoh, Kazuki Takemoto, Shinji Uchiyama, Hiroyuki Yamamoto
11:20am Spatial Relationship Patterns: Elements of Reusable Tracking and Calibration Systems by Daniel Pustka, Martin Bauer, Manuel Huber, Gudrun Klinker
11:50am Lunch break
  Session: Multimodal AR
 1:00pm Move the couch where: Developing an Augmented Reality Multimodal Interface by Sylvia Irawati, Mark Billinghurst , Andreas Duenser , Scott Green , Heedong Ko
 1:20pm High-fidelity visuo-haptic interaction with virtual objects in multi-modal AR systems by Gerald Bianchi, Christoph Jung, Benjamin Knoerlein, Gabor Szekely, Matthias Harders
 1:50pm An Event Architecture for Distributed Interactive Multisensory Rendering by Timothy Edmunds, Dinesh K. Pai
 2:20pm Coffee break
 2:30pm Poster/demo session 2
  Session: Visualization
 3:30pm Enhanced Visual Realism by Incorporating Camera Image Effects by Jan Fischer, Dirk Bartz
 3:50pm Interactive Context-Driven Visualization Tools for Augmented Reality by Erick Mendez, Denis Kalkofen, Dieter Schmalstieg
 4:20pm Augmented Reality Based on Estimation of Defocusing and Motion Blurring from Captured Images by Bunyo Okumura, Masayuki Kanbara, Naokazu Yokoya
 4:50pm Closing

Keynote I

The Poor Man's Palace: Special Effects in the Real World

Ramesh Raskar
Mitsubishi Electric Research Labs (MERL), Cambridge, MA, USA


Ramesh Raskar joined MERL as a Research Scientist in 2000 after his doctoral research at U. of North Carolina at Chapel Hill, where he developed a framework for projector based displays. His work spans a range of topics in computer vision, graphics and HCI including projective geometry, non-photorealistic rendering and intelligent user interfaces. Current projects include composite RFID (RFIG), multi-flash non-photorealistic camera for depth edge detection, locale-aware mobile projectors, high dynamic range video, image fusion for context enhancement and quadric transfer methods for multi-projector curved screen displays.

Dr. Raskar received the TR100 Award, Technology Review's 100 Top Young Innovators Under 35 worldwide, 2004, Global Indus Technovator Award 2003, instituted at MIT to recognize the top 20 Indian technology innovators on the globe, Mitsubishi Electric Valuable Invention Award 2004, 2006 and Mitsubishi Electric Information Technology R&D Award 2003. He is a member of the ACM and IEEE.

ISMAR Workshop (full day)

Industrial Augmented Reality

Augmented Reality has matured from pure research to actual industrial applications. There are still many research questions to solve, and solutions are discussed every year at the ISMAR conference series. However, making systems really work requires usually some more effort, knowledge, and ideas than can be discussed by academia alone. The goal of this workshop is to bring together people from industry, research labs, and academia who share the goal of employing augmented reality technologies in real industrial settings aimed at producing a commercial benefit.

The workshop is a continuation of the very successful one-day event at ISMAR'05. It is intended to provide a platform to jointly discuss the "devils in the detail" and to identify ways to make the leap from research-based demonstrators to fully integrated systems.

Gudrun Klinker (TU Munich), coordinator
Stefan Noelle (Volkswagen)
Toshikazu Ohshima (Ritsumeikan University, formerly Canon)
Marcus Toennis (TU Munich)

Details and schedule

Affiliated Workshop (full day)

Mixed Reality Technology for Film Making

Information on this workshop can be found on

ISMAR Tutorial 1 (half day)

Computer Vision for Augmented Reality

Camera based tracking for augmented reality is nowadays frequently done using AR-Toolkit. The tracking of AR-Toolkit is based on markers placed in the scene. There are situations where it is not possible to place markers in the scene to track the camera motion one example is TV-broadcasting applications. In recent years the techniques in computer vision have been extended towards markerless high quality camera tracking with interactive frame rates. These techniques can be used for camera pose estimation for augmented reality.

The tutorial will review the algorithms and techniques implemented in AR-Toolkit as the state of the art tool for camera tracking in augmented reality. Afterwards these techniques will be extended towards markerless camera pose estimation in real-time. For this the state of the art techniques in computer vision will be explained in detail. The introduced methods include algorithms for detection and tracking of salient image features in the video, the robust estimation of the camera pose from the motion of the salient features. In the final part of the tutorial we will discuss the techniques used to improve the performance of the algorithms to achieve real-time. Throughout the tutorial we will show applications of each of the algorithms to enhance the understanding. These examples are used to build a markerless augmented reality system.

Jan-Michael Frahm (UNC-Chapel Hill), coordinator and instructor
Other(s) TBD

ISMAR Tutorial 2 (half day)

Head-worn Displays (HWD) Fundamentals and Applications

Trying to develop new applications with HWDs without an associated plan for the development of technology optimized for that application and set of tasks is like trying to swim in a pool with no water.

To enable breakthroughs in the use of HWDs targeted at multiple applications, this tutorial will briefly review the principles of optical imaging for HWDs. We will then explain various perception issues in HWDs which, if understood, can help guide the optimal design and use of the technology across various applications and tasks. We will then detail eyepiece based versus projection optics, including retinal scanning displays which can be thought of as a scanning projection system. Video see-through technology will then be introduced together with some key system aspects related to calibration and applications. Wide field of view optics will then be addressed together with state of the art displays and applications will be reviewed. Finally, we will discuss how free-form optics has already played a key role in HWD design and will help launch the next generation eyeglass displays for "grand public" use as well.

Jannick Rolland (University of Central Florida), coordinator and instructor
Andrei State (University of North Carolina at Chapei Hill), instructor
Ozan Cakmakci (University of Central Florida, and Intern at Canon Japan), instructor
Robert Patterson (Washington State University), instructor


Chris Warrington, Gerhard Roth, Eric Dubois Markerless Augmented Reality for Cubic Panorama Sequences
Taehee Lee, Tobias Höllerer Viewpoint Stabilization for Live Collaborative Video Augmentations
Wayne Piekarski Robust Gloves For 3D Interaction In Mobile Outdoor AR Environments
Youngjin Hong, Sanggoog Lee, Yongbeom Lee, Sangryong Kim Mobile Pointing & Input System Using Active Marker
Wafaa ABOU MOUSSA, Jean-Pierre JESSEL, Emmanuel DUBOIS Notational-based Prototyping of Mixed Interactions
Susanna Nilsson, Björn Johansson User Experience and Acceptance of a Mixed Reality System in a Naturalistic Setting � A Case Study
Ann-Sofie Gunnarsson, Malinda Rauhala, Anders Henrysson, Anders Ynnerman Visualization of Sensor Data Using Mobile Phone Augmented Reality
Sanni Siltanen Texture Generation over the Marker Area
Raphael Grasset, Julian Looser, Mark Billinghurst Transitional Interface: Concept , Issues and Framework
Jeremiah Neubert, Tom Drummond Using Backlight Intensity for Device Identification
Yoichi Motokawa, Hideo Saito Support System for Guitar Playing using Augmented Reality Display
Ryosuke Ichikari, Keisuke Kawano, Asako Kimura, Fumihisa Shibata, Hideyuki Tamura Mixed Reality Pre-visualization and Camera-Work Authoring in Filmmaking
Sinem Güven, Steven Feiner, Ohan Oda Mobile Augmented Reality Interaction Techniques for Authoring Situated Media On-Site
Stefan Nölle, Gudrun Klinker Augmented Reality as a Comparison Tool in Automotive Industry
Seok-Won Lee, Dong-Chul Kim, Do-Yoon Kim, Tack-Don Han Tag Detection Algorithm for Improving a Instability Problem of an Augmented Reality


Manfred Bogen, Jürgen Wind, Angele Giuliano   ARiSE: Augmented Reality in School Environments
Markus Kähäri, David J. Murphy MARA - Sensor Based Augmented Reality System for Mobile Imaging
Gerhard Reitmayr, Tom W. Drummond Going out: Robust Tracking for Outdoor Augmented Reality
Harald Wuest, Gabriele Bleser, Mario Becker, Didier Stricker Online camera pose estimation in partially known and dynamic scenes
Martin Bauer, Michael Schlegel, Daniel Pustka, Nassir Navab, Gudrun Klinker Predicting and Estimating Accuracy of Optical Tracking Systems
Yuko Uematsu, Hideo Saito AR Baseball Presentation System Based on Registration with Multiple Markers
Julien Pilet, Andreas Geiger, Pascal Lagger, Vincent Lepetit and Pascal Fua An All-In-One Solution to Geometric and Photometric Calibration
Mark Fiala, Brad Hetherington, Luke Burkett ARTag Array Applications
Sean M. White and Steven Feiner Augmented Reality User Interfaces to an Electronic Field Guide
Umi Kawamoto, Takeshi Kurata, Nobuchika Sakata, Takashi Okuma, Hideaki Kuzuoka Tangible TableTop (TTT) Interface Based on Position/Orientation
Yoichi Motokawa, Hideo Saito Support System for Guitar Playing using Augmented Reality Display
Erick Mendez, Daniel Wagner, Dieter Schmalstieg Vidente: A glance at AR on the UMPC and Smartphone Platform
Jan Fischer, Dirk Bartz The Augmented Painting
Bernhard Reitinger, Christopher Zach, Konrad Karner, Dieter Schmalstieg Automated Model Acquisition using 3D Reconstruction for Urban Planning
Eric Foxlin & Leonid Naimark A Smarter Smart Camera
Wayne Piekarski, Ross Smith, Ben Avery, and Bruce Thomas Tinmith Backpack 2006 and Outdoor Augmented Reality Applications
Masataka Imura, Yoshihiro Yasumuro, Yoshitsugu Manabe, Kunihiro Chihara Fountain Designer: Control Virtual Water as You Like
Jason Wither, Steve Diverdi, Tobias Höllerer Using Aerial Photographs for Improved Mobile AR Annotation
Taehee Lee, Tobias Höllerer Viewpoint Stabilization for Live Collaborative Video Augmentations
Chris Warrington, Gerhard Roth, Eric Dubois Walkthroughs of Cubic Panorama Sequences with Virtual Augmentations
Alexandre Gillet, Arthur Olson Tangible Augmented Interfaces for Structural Molecular Biology