Robert Carter Zeleznik

Director of Research

Work Experience

1996-present Director of Research, Brown University Computer Graphics Group

2005-2009 Director of Research, Microsoft Center for Research on Pen-Centric Computing at Brown University

2005 Expert Witness, Sony Corp. 1989-1996 Research Scientist, Brown University Computer Graphics Group

1999-2001 Design Consultant, E-Quill Corp

1998 Design Consultant, SpaceTec IMC: 3D Motion Control API

1996 Consultant, Sun Microsystems: Ultrapack 3.0 application development

Education

Sc. B. in Computer Science (with Honors), Brown University, 1988.

Systems architect

• StarPadSDK : A framework supporting pen-based and gestural applications. 2007-2009.
• MathPaper : An application for interactively recognizing handwritten mathematical expressions and visualizing symbolic and numerical computations. 2006-2009.
• FluidInking : A framework for designing gesture-based interactions. 2005-2007.
• ReMarkable Texts : A collaborative environment for storing, annotating, and sharing documents. 2002-2004.
• SOFT : Software Framework for Teleimmersion. A framework supporting teleimmersive 3D applications sponsored by Advanced Network & Services' National Tele-immersion Initiative. 1998-
• UGA : Unified Graphics Architecture. A framework for creating 3D graphics animations and applications used by the Brown University Graphics Group 1993-1996.
• FLESH : an interpreted prototype-delegation programming language for creating interactive 3D graphics applications. Used by the Brown University Graphics Group 1993-1996.
• Trim-Lite : a suite of C++ graphics libraries for creating interactive 3D graphics applications. Used by the Brown University Graphics 1995-1997.
• SKETCH : a gesture based 3D modeler 1996-1997.
• Jot : a distributed, gesture-based modeling framework for exploring mechanical and architectural modeling interfaces. 1997-1999.
• GLUE: a distributed 3D graphics application framework 2000-2002.
• ReMarkable Texts: collaborative, pen-based digital notebook. 2002-2004.

Published Papers

• "Code Bubbles: Rethinking the User Interface Paradigm of Integrated Development Environments." (with A. Bragdon, S. Reiss, S. Karumuri, W. Cheung, J. Kaplan, C. Coleman, F. Adeputra, and J. LaViola Jr.) In Proceedings of the 32nd International Conference on Software Engineering. May, 2010
• Dept. of Computer Science
  "Code Bubbles: A Working Set-based Interface for Code Understanding and Maintenance." (with A. Bragdon, S. Reiss, S. Karumuri, W. Cheung, J. Kaplan, C. Coleman, F. Adeputra, and J. LaViola Jr.) In Proceedings of CHI (2010).
• "GestureBar: Improving the Approachability of Gesture-Based Interfaces." (with A. Bragdon, B. WIlliamson, T. Miller, and J. LaViola). In Proceedings of CHI 2009.
• "Lineogrammer: Creating Diagrams by Drawing". (with A Bragdon, C Liu, A Forsberg) In Proceedings of UIST 2008. Monterey, CA, October 2008.
• "MathPaper: Mathematical Sketching with Fluid Interaction Support for Online Computation". (with T Miller, C Li, J Laviola) In Proceedings of Smart Graphics '08. Rennes, France, August 2008. (Best Paper)
• "Online Recognition of Handwritten Mathematical Expressions with Support for Matrices". (with C Li, T Miller and J LaViola) To appear in the Proceedings of ICPR 2008, December 2008.
• "AlgoSketch: Algorithm Sketching and Interactive Computation" (with C Li, T Miller, R Zeleznik, and J LaViola) In Proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling 2008, 175-182, June 2008.
• "An Empirical Study in Pen-Centric User Interfaces: Diagramming" (with A Forsberg, A Bragdon, J LaViola, S Raghupathy) In Proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling 2008, Annecy, France, pp.135-142, June 2008.
• "Dynamic Dragging for Input of 3D Trajectories" (with D. Keefe, D. Laidlaw). In Proceedings of IEEE Symposium on 3D User Interfaces, 2008.
• "Evaluation of Techniques for Visualizing Mathematical Expression Recognition Results" (with J LaViola, A Leal, T Miller, and R Zeleznik) In Proceedings of Graphics Interface 2008, pp. 131-138, May 2008.
• "Drawing On Air: Input Techniques for Controlled 3D Line Illustration." (with D. Keefe, and D. Laidlaw). IEEE Transactions of Visualization and Computer Graphics. September/October, 2007.
• "A Practical Approach to Writer-Dependent Symbol Recognition Using a Writer-Independent Recognizer" (with J Laviola) In IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(11):1917-1926, November 2007
• "Designing UI Techniques for Handwritten Mathematics" (with T Miller, C Li) In Eurographics Workshop on Sketch-Based Interfaces and Modeling. August 2007.
• "Fluid Inking: Augmenting the Medium of Free-Form Inking with Gestures" (with T Miller) In Proceedings of Graphics Interface, July 2006.
• "Characterizing the effect of level of immersion on a 3d marking task" (with J Schulze, A Forsberg, D Laidlaw) In Proceedings of HCI International, July 2005.
• "Particle flurries: Synoptic 3D pulsatile flow visualization." (with J Sobel, A Forsberg, D Laidlaw, D Keefe, I Pivkin, G Karniadakis, P Richardson, and S Swartz) In IEEE Computer Graphics and Applications, March/April 2004.
• "MathPad^2: A system for the creation and exploration of mathematical sketches" (with J. Laviola) In Proceedings of SIGGRAPH'04, August 2004.
• "Pop Through Button Devices for VE Navigation and Interaction" (with J. Laviola, D. Keefe, and D. Acevedo) In Proceedings of VR 2002, May 2002.
• "Pop through Mouse Button Interactions" (with T. Miller and A. Forsberg) In Proceedings of UIST '01, ACM SIGGRAPH November, 2001. pp. 195-196.
• "Hands-Free Multi-Scale Navigation in Virtual Environments" (with J. LaViola, D. Keefe, D. Acevedo) In Proceedings of 2001 Symposium on Interactive 3D Graphics, (April 2001).
• "Scene-Graph-As-Bus: Collaboration between Heterogeneous Stand-alone 3D Graphical Applications" (with L. Holden, M. Capps, H. Abrams, and T. Miller) In Proceedings of Eurographics 2000, (August 2000).
• "Harold: A World Made of Drawings" (with J. Cohen and J. Hughes) In Proceedings of NPAR, (June 2000).
• "Flex and Pinch: A Case Study of Whole Hand Input Design for Virtual Environment Interaction", (with J. LaViola) In Proceedings of the Second IASTED International Conference on Computer Graphics and Imaging, October 1999.
• "An Interface for Sketching 3D Curves" (with J. Cohen and L. Markosian and J. Hughes) In Proceedings of 1999 Symposium on Interactive 3D Graphics, (April 1999).
• "The Design of 3D Haptic Widgets" (with T. Miller) In Proceedings of 1999 Symposium on Interactive 3D Graphics, (April 1999).
• "UniCam - 2D Gestural Camera Controls for 3D Environments" (with A. Forsberg) In Proceedings of 1999 Symposium on Interactive 3D Graphics, (April 1999).
• "Sketch-N-Make: Automated Machining of CAD Sketches" (with M. Bloomenthal, R. Fish, L. Holden, A. Forsberg, R. Riesenfeld, M. Cutts, S. Drake, H. Fuchs, and E. Cohen) In Proceedings of the 1998 ASME 8th Computers In Engineering Conference, (1998).
• "The Music Notepad" (with A. Forsberg and M. Dieterich) In Proceedings of UIST '98, ACM SIGGRAPH November, 1998. (November 1998).
• "Collaborative Conceptual Modeling Using the SKETCH Framework", (with J. LaViola, L. Holden, A. Forsberg, D. Bhuphaibool, D) In Proceedings of the First IASTED International Conference on Computer Graphics and Imaging, 154-158, (June 1998).
• "Sketching in 3D" Computer Graphics 32(4):45-49, November 1998.
• "An Insidious Haptic Invasion" (with T. Miller) In Proceedings of UIST '98, ACM SIGGRAPH November, 1998. (May 1998).
• "ErgoDesk: A Framework for Two and Three Dimensional Interaction at the ActiveDesk." (with A. Forsberg and J. LaViola) To appear in Proceedingsof the Second International Immersive Projection Technology Workshop, (May 1998).
• "Image Plane Interaction Techniques in 3D Immersive Environments" (with J. Pierce, A. Forsberg, M. Conway, S. Hong, and M. Mine) In Proceedings of 1997 Symposium on Interactive 3D Graphics, (Apr. 1997).
• "Seamless Interaction in Virtual Reality" (with A. Forsberg and J. LaViola) IEEE Computer Graphics and Applications, 17(6):6-9, November/December 1997.
• "Two-pointer input for 3D interaction" (with A. Forsberg and P. Strauss) In Proceedings of 1997 Symposium on Interactive 3D Graphics (Apr. 1997).
• "Sketch: An Interface for Sketching 3D Scenes" (with K. Herndon and J. Hughes), to be published in Proceedings of SIGGRAPH'96 (Aug. 1996). (PostScript)
• "The Lego Interface Toolkit" (with M. Ayers), In Proceedings of UIST '96, ACM SIGGRAPH November, 1996.
• "Aperture-Based Selection for Immersive Virtual Environments" (with K. Herndon and A. Forsberg), In Proceedings of UIST '96, ACM SIGGRAPH November, 1996.
• "Interactive Real-Time Motion Blur" (with M. Wloka) In Proceedings of CGI'94: Insight Through Computer Graphics, 1995.
• "Interactive Real-Time Motion Blur" (with M. Wloka) the Visual Computer, Springer Verlag, 1996.
• "An Architecture for an Extensible 3D Interface Toolkit, (with M. Stevens) In Proceedings of UIST '94, ACM SIGGRAPH, November, 1994.
• "An Interactive Toolkit for Constructing 3D Interfaces" (with K. Herndon, D. Robbins, N. Huang, T. Meyer, N. Parker and J. Hughes), in Proceedings of SIGGRAPH'93 (July 1993).
• "Interactive Shadows" (with K. Herndon, D. Robbins, D. Conner, S. Snibbe, and A. van Dam), in Proceedings of UIST'92 (Nov. 1992).
• "Three Dimensional Widgets" (with D. Conner, S. Snibbe, D. Robbins, K. Herndon and A. van Dam), in Proceedings of the 1992 Symposium on Interactive 3D Graphics (Apr. 1992).
• "An Object-Oriented Framework for the Integration of Interactive Animation Techniques" (with D. Brookshire Conner, Matthias W. Wloka, Daniel G. Aliaga, Nate Huang, Phillip M. Hubbard, Brian Knep, Henry Kaufman, John F. Hughes, and Andries van Dam), in SIGGRAPH 1991 Conference Proceedings, Las Vegas NV,1991.

Technical Reports

• "Look-That-There: Exploring Gaze in Virtual Reality Interactions", (with J. Schulze, and A. Forsberg), March 2005, number CS-05-04.
• "Fluid Inking: Using Punctuation to ALlow Modeless Combination of Marking and Gesturing", (with T. Miller, L. Holden, and J. Laviola), July 2004, number CS-04-11.
• "Practically Frameless Rendering," (with M. Wloka and T. Miller) March 1995, number CS-95-06.
• "Cone Trees in the UGA Graphics System: Suggestions for a More Robust Visualization Tool," (with O. Tversky and S. Snibbe) October 1992, number CS-92-46.
• "UGA: A Unified Graphics Architecture" (with P. Hubbard, M. Wloka) February 1991, CS-91-30.
• "An Object-Oriented Framework for the Integration of Interactive Animation Techniques," (with D. Brookshire Conner, and Andries van Dam) February 1991, CS-91-10.

Service to the Profession

Program Committee Member for UIST'99.

Reviewer for SIGGRAPH paper submissions, 1992-2005.

Reviewer for UIST paper submissions, 1995-2005.

Reviewer for CHI, 1997,2000-2205.

Reviewer for Symposium on Interactive 3D Graphics paper submissions, 1995-2005.

Reviewer for Multimedia '97, 1997.

Course Instruction and Invited Talks

Invited Talk, "Beyond Multimedia: Interactivity in Interfaces", ImageTech '97, Atlanta (April 1997).

Invited Talk, "Demo: The Sketch System", ACM'97, San Jose (March 1997).

Invited Talk, "The Sketch System", MIT, Boston (January 1997).

Invited Talk, "SKETCH: An Interface for 3D Sketching", Alias/Wavefront, Toronto (June 1996).

Invited Talk, "SKETCH: An Interface for 3D Sketching", Softimage, Montreal (June 1996).

Invited Talk, "SKETCH: An Interface for 3D Sketching", Microsoft, Seattle (April 1996).

Lecturer, "Large Scale Graphics Systems" Siggraph Course #32 (August 1994).

Invited Talk, "The UGA Graphics System", Microsoft, Seattle (May 1994).

Invited Talk, "The BAGS Graphics System", IBM, Austin (April 1990).