ACM Computing Surveys 31(4), December 1999, http://www.acm.org/surveys/Formatting.html. Copyright © 1999 by the Association for Computing Machinery, Inc. See the permissions statement below.

Spatial Hypertext: An Alternative to Navigational and Semantic Links

Frank M. Shipman, III
Texas A&M University   Web: http://www.tamu.edu/
Department of Computer Science
College Station, TX 77843-3112
Email: shipman@cs.tamu.edu
Web: http://www.csdl.tamu.edu/~shipman/

Catherine C. Marshall

FX Palo Alto Laboratory   Web: http://www.fxpal.xerox.com/
3400 Hillview Road, Building 4
Palo Alto, CA 94304
Email: marshall@pal.xerox.com
Web: http://www.csdl.tamu.edu/~marshall/

1 Introduction: The Emergence of Spatial Hypertext

Hypertext began as a vision of interconnected reference materials [Bush 1945] and literature [Robertson 1998]. These early visions were joined by working systems that supported link-based navigation among documents as well as branching points within (hyper)documents [Engelbart 1984]. As the use of hypertext systems became more widespread, researchers realized that readers could become confused or lost as they navigated large networks [Conklin 1987a]. Systems such as NoteCards [Halasz 1987] addressed this problem by displaying maps of the hypertext's network structure. The success of NoteCards's "browser cards" and other hypertext maps gave rise to systems in which the user's main interaction with the hypertext was through a network map rather than a document viewer. For example, systems such as gIBIS [Conklin 1988] and Aquanet [Marshall 1991] presented a visual network containing typed links and nodes where the types are visually distinguished within the map; the network could be edited and manipulated through this presentation.

The move from document-centered hypertext systems to map-based hypertext systems had some unforeseen but far-reaching implications: relationships between nodes could be expressed in more than one way. Maps showed interconnectedness explicitly, usually in the form of a directed graph. But also node proximity came into play; relationships among different nodes or documents could be indicated simply on the basis of their relative location. The use of these map-based hypertext systems to author new information spaces uncovered an interesting phenomenon. Users avoided the explicit linking mechanisms in favor of the more implicit expression of relationships through spatial proximity and visual attributes [Marshall 1992]. Further analysis showed that the use of these spatial and visual cues to imply relationships applied not only to map-based hypertext systems, but also to traditional hypertext systems and in the physical arrangement of paper and notecards [Marshall 1993].

New interface requirements arose from these observations of practice. Specifically, there was a need to support the expression of the implicit and transient relationships that develop between nodes [Marshall 1995]. With that requirement came the concomitant need to support manipulation, the movement of nodes and structures of nodes within the information space. Spatial hypertext systems like VIKI [Marshall 1994] emerged to support this new method of interacting with information. Commonly used visual attributes like color, shape, and border width can be readily changed to enable "information triage", the rapid interpretation and assimilation of new information [Marshall 1997a].

To better support the manipulation of transient perceptual structures, VIKI includes a spatial parser that recognizes patterns such as vertical and horizontal lists, stacks, and composites. Recognized structures provide easy access to the different levels of perceptual structure within a complicated information space and support the transition of these implicit structures into explicit hypertext [Shipman 1995].

2 Benefits of Spatial Hypertext

Given this historical perspective on spatial hypertext and a range of experiences with its use, what can we infer about the types of activities for which it will be useful? The most basic question is why is a spatial interface useful at all (compared to document-centered interfaces). Our experience indicates four major benefits: (1) it takes advantage of people's considerable visual recognition and intelligence; (2) it facilitates constructive ambiguity; (3) it supports emerging problem-solving strategies; and (4) it reduces overhead in communicating with others.

A spatial interface allows users to take advantage of their visual memory and pattern recognition. Remembering where one saw a document in a visual workspace is a process of recognizing the area in which a document was located at a progressively finer-grained level rather than having to remember the navigational path one took to get to the document. Visual recognition also enables the expression of relation variations -- people recognize visual patterns as being of the same or similar type even when they are not identical; this introduces a way to compose and share imperfect composites.

Another benefit of spatial hypertext is its facility for constructive ambiguity. Where a link in a document-centered hypertext either exists or does not in a particular presentation of the material, placement of a node close but not quite with others can imply some indecision or potential for a relation between the nodes. Allowing people to express ambiguity more easily enables them to perform tasks such as analysis or design where interpretations form as they work with the materials.

It is not only the case that the interpretation of individual documents changes over time in a spatial hypertext, but the visual language representing the interpretation changes as well. A study of users performing short-term interpretation tasks showed that visual languages emerge as users' understanding of the task and their method of approaching the task co-evolved [Marshall 1997a]. The use of a visual attribute to represent some abstract information about node content changed over time; for example, color might start off indicating the usefulness of a document but later be used to encode domain-specific characteristics of the content. Such changes indicate that users adapt their solution strategies as they gain more insight into their task. Aquanet and other systems with predefined types and relations make the overhead for making such changes in mid-task overwhelming and very unlikely to occur.

Many tasks require information to be shared among a group of collaborators. Hypertext's application to information sharing has been investigated by many systems including the Virtual Notebook System [Shipman 1989] and Sepia [Streitz 1992]. The initial study of spatial layouts of information implied a correlation between the number of people sharing an information space and the degree of visual structure apparent in the arrangement. When it was necessary for more people to understand the information space, they created a higher degree of perceptual structure and followed it more strictly. As with sharing information in a navigational hypertext or file system, users must agree on a basic framework in order to effectively communicate. In contrast with a navigational hypertext or file system, effective use of ambiguous and implicit relationships means the spatial hypertext does not require on users to agree on particular relationships or agree on their interpretation.

3 Impact of Spatial Hypertext

Hypertext research has evolved into a number of interrelated sub-areas of specialization. Spatial hypertext has contributed to a number of these lines of hypertext research: playing into the discussion of hypertext literary theory; framing the discussion of visualization and interaction techniques for hypertext information; challenging the open-hypermedia research community with a different model of hypertext; and motivating work on Web workspaces.

Theoretical discussions of hypertext have long explored the role of the reader. Spatial hypertext becomes intertwined with these discussions when theorists begin to take a closer look at how readers may interact with texts, taking a step beyond the reader-as-writer foundation. As an important example, Rosenberg has introduced the notion of the reader as gatherer [Rosenberg 1996]. In his vision of interaction, document-centered hypertexts invite "or" style traversal: a reader can choose to go to this document or that; by contrast, spatial hypertexts invite "and" interactions in which the reader can simultaneously apprehend many different nodes [Rosenberg 1997]. The representational malleability of spatial hypertext is also considered important; early critiques of the rhetoric of hypertext call for a need to reform the established structural rigidity of hypertext and move to a more exploratory one [Moulthrop 1991]. In fact, one element of Greco's call for a political praxis of hypertext involves the use of hypertext to explore interpretive frameworks and theories reflects the most basic goals of spatial hypertext [Greco 1996]. Kolb, a philosopher, further discusses the role of flexible representations of interpretation [Kolb 1997]. The properties of ambiguity and emergence are appealing to those who are interested in reframing existing texts.

Visualizations of hypertext networks have evolved since the original hypertext maps that inspired spatial hypertext. There are now visualizations involving algorithms that cluster nodes or infer a hierarchy to generate visual representations that are simpler and easier to use than the map of the entire link network [Durand 1998]. Additionally, visualizations have explored the use of three-dimensional representations for hypertext -- including the placement of text into virtual renditions of physical worlds or text-based spatial environments [Dieberger 1995]. Within VIKI, the constant shortage of screen real estate and the practice of performing multiple tasks simultaneously led to the development of a multi-focus fisheye view [Shipman 1999].

The goal of open-hypermedia research is to create a protocol that allows links to exist across different hypertext systems and information stored in one system to be displayed and manipulated in another. For systems that are based on a node and link model of hypertext the primary concerns involve versioning, permissions, and composites. Spatial hypertext, because of the lack of links or other explicit relationships between nodes, challenges the open-hypermedia research protocols to consider information structuring at a more abstract level [Nürnberg 1999]. Relationships implied in a spatial layout may need to be converted to a link in a document-centered hypertext system while links in such a system need to be converted into a generated layout in a spatial system. Additionally, the ambiguity of links and spatial composites in a spatial hypertext are difficult to express in a node-and-link based system.

The growth of the Web has led to a growing number of systems that provide "Web workspaces" in which users can collect, organize, and otherwise work with information. VIKI itself includes a number of interconnections with the Web including the ability to author presentations containing Web-based information [Shipman 1997]. Additionally, systems like Web Squirrel [Bernstein 1996], D-LITE [Cousins 1997], Web Forager [Card 1996] and Data Mountain [Robertson 1998] provide workspaces for analysis and interpretation similar to that of VIKI.

4 Future of Spatial Hypertext

Spatial hypertext emerged from the graphical presentation of traditional hypertexts as maps. The problems of understanding the context of the information currently being read and remembering how one got to a particular location are ever more a problem with the growth of the Web as a central public information resource. The benefits of a spatial representations and interfaces ensure continued research into spatial hypertext and Web workspaces. The current legal dispute about the bundling of Internet browsers and operating systems aside, the vision of the computer as a information appliance will push new operating system interfaces to combine current OS desktop features with those of spatial hypertext.

Acknowledgments

This work was supported in part by grant 97-34167 of the National Science Foundation.

References

[Bernstein 1996] Mark Bernstein. Web Squirrel. Watertown, MA, Eastgate Systems, 1996.

[Bush 1945] Vannevar Bush. "As We May Think" in The Atlantic Monthly, 176(1),101-108, [Online: http://www.isg.sfu.ca/~duchier/misc/vbush/], July 1945.

[Card 1996] Stuart K. Card, George G. Robertson, and William York. "The WebBook and the Web Forager: An Information Workspace for the World-Wide Web" in Proceedings of ACM SIGCHI '96, Vancouver, Canada, 111‚117, April 1996.

[Conklin 1987a] Jeff Conklin. "Hypertext: An Introduction and Survey" in IEEE Computer, 20(9), 17-41, September 1987.

[Conklin 1988] Jeff Conklin and Michael L. Begeman. "gIBIS: A Hypertext Tool for Exploratory Policy Discussion" in Proceedings of ACM CSCW '88, 140-152, 1988.

[Cousins 1997] Steven B. Cousins, Andreas Paepcke, Terry Winograd, Eric A. Bier, and Ken Pier. "The Digital Library Integrated Task Environment (DLITE)" in Proceedings of ACM Digital Libraries '97, 142-151, 1997.

[Dieberger 1995] Andreas Dieberger and Jay David Bolter. "On the Design of Hyper 'Spaces'" in Communications of the ACM (CACM), 38(8), 98, August 1995.

[Durand 1998] David G. Durand and Paul Kahn. "MAPA: A System for Inducing and Visualizing Hierarchy in Websites" in Proceedings of ACM Hypertext '98, Pittsburgh, PA, 66-78, June 1998.

[Engelbart 1984] Douglas C. Engelbart. "Authorship Provisions in Augment" in Proceedings of the 28th IEEE International Conference, San Francisco, CA, 465-472, February 1984.

[Greco 1996] Diane Greco. "Hypertext with Consequences: Recovering a Politics of Hypertext" in Proceedings of ACM Hypertext '96, Washington DC, 85-92, March 1996.

[Halasz 1987] Frank G. Halasz, Thomas P. Moran and Randall H. Trigg. "NoteCards in a Nutshell" in Proceedings of the ACM CHI+GI '87, Toronto, Canada, 345-365, April 1987.

[Kolb 1997] David Kolb. "Scholarly Hypertext: Self-Represented Complexity" in Proceedings of ACM Hypertext '97, Southamption, UK, 29-37, September 1997.

[Marshall 1991] Catherine C. Marshall, Frank G. Halasz, Russell A. Rogers, and William C.Janssen. "Aquanet: A Hypertext Tool to Hold Your Knowledge in Place" in Proceedings of ACM Hypertext `91, San Antonio, TX, 261-275, December 1991.

[Marshall 1992] Catherine C. Marshall, and R. A. Rogers. "Two Years before the Mist: Experiences with Aquanet" in Proceedings of the ACM Conference on Hypertext (ECHT '92), Milano, Italy, 53-62, December 1992.

[Marshall 1993] Catherine C. Marshall and Frank M. Shipman "Searching for the Missing Link: Discovering Implicit Structure in Spatial Hypertext" in Proceedings of ACM Hypertext `93 Conference. ACM Press, New York, NY, 217-230, 1993.

[Marshall 1994] Catherine C. Marshall, Frank Shipman, and James H. Coombs. "VIKI: Spatial Hypertext Supporting Emergent Structure" in Proceedings of the ACM European Conference on Hypermedia Technology (ECHT '94), Edinburgh, Scotland, 13-23, September 1994.

[Marshall 1995] Catherine C. Marshall, and Frank M. Shipman. "Spatial Hypertext: Designing for Change" in Communications of the ACM (CACM), 38(8), 88-97, August 1995.

[Marshall 1997a] Catherine C. Marshall, and Frank M. Shipman. "Effects of Hypertext Technology on the Practice of Information Triage" in Proceedings of ACM Hypertext `97, Southampton, UK, 167-176, September 1997.

[Moulthrop 1991] Stuart Moulthrop. "Beyond the Electronic Book: A Critique of Hypertext Rhetoric" in Proceedings of ACM Hypertext '91, San Antonio, TX, 291-298, December 1991.

[Nürnberg 1999] Peter J. Nürnberg and Helen Ashman. "What was the Question? Reconciling Open Hypermedia and World Wide Web Research" in Proceedings of ACM Hypertext '99, Darmstadt, Germany, 83-90, February 1999.

[Nelson 1984] Theodor Helm Nelson. Literary Machines, (Edition 87.1, also 6th Edition). The Distributers, South Bend, Indiana, 1984.

[Robertson 1998] George G. Robertson, Mary Czerwinski, Kevin Larson, Daniel Robbins, David Thiel, and Maarten van Dantzich. "Data Mountain: Using Spatial Memory for Document Management" in Proceedings of ACM UIST `98, San Francisco, CA, 153-162, November 1998.

[Rosenberg 1996] Jim Rosenberg. "The Structure of Hypertext Activity" in Proceedings of ACM Hypertext '96, Washington DC, 22-29, March 1996.

[Rosenberg 1997] Jim Rosenberg. "The Interactive Diagram Sentence: Hypertext as a Medium of Thought" in Visible Language, 30(2), 103-116, 1997.

[Shipman 1989] Frank M. Shipman, R. Jesse Chaney, G. Anthony Gorry. "Distributed Hypertext for Collaborative Research: The Virtual Notebook System" in Proceedings of ACM Hypertext '89, Pittsburg, PA, 129-135, November 1989.

[Shipman 1995] Frank M. Shipman, Catherine C. Marshall, and Thomas P. Moran. "Finding and Using Implicit Structure in Human-Organized Spatial Layouts of Information" in Proceedings of ACM SIGCHI '95, Denver, CO, 346-353, May1995.

[Shipman 1997] Frank M. Shipman, Richard K. Furuta, and Catherine C. Marshall. "Generating Web-Based Presentations in Spatial Hypertext" in Proceedings of ACM Intelligent User Interfaces `97 Conference, 71-78, 1997.

[Shipman 1999] Frank M. Shipman, Catherine C. Marshall, and Mark LeMere. "Beyond Location: Hypertext Workspaces and Non-Linear Views" in Proceedings of ACM Hypertext '99, Darmstadt, Germany, 121-130, February 1999.

[Streitz 1992] Norbert A. Streitz, Jörg M. Haake, Jörg Hannemann, Andreas Lemke, Wolfgang Schuler, Helge Schütt and Manfred Thüring. "SEPIA: A Cooperative Hypermedia Authoring Environment" in Proceedings of the ACM Conference on Hypertext (ECHT '92), Milano, Italy, 11-22, December 1992.


Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or permissions@acm.org.