Diane H. Sonnenwald

Information behavior in dynamic group work contexts: interwoven situational awareness, dense social networks and contested collaboration in command and control

Abstract In many dynamic work situations, no single individual can acquire the varied and often rapidly expanding information needed for success. Individuals must work together to collect, analyze, synthesize and disseminate information throughout the work process. Perhaps one of the most dynamic work contexts is command and control in the military at the battalion level which directs 300 to 1000 soldiers on the battlefield. This paper reports on a study that explores human information behavior in command and control (C2). Data was gathered from simulated battle exercises, interviews with experienced C2 personnel and documentation on C2. During data analysis, three important themes that highlight the why, what, how and consequences of information behavior in C2 emerged. The first is the concept of interwoven situational awareness consisting of individual, intragroup and intergroup shared understanding of the situation. Interwoven situational awareness appears to facilitate response to dynamic, constraint-bound situations. The second theme describes the need for dense social networks or frequent communication between participants about the work context and situation, the work process and domain-specific information. The third theme is called ‘contested collaboration’, a phenomenon where team members maintain an outward stance of cooperation but work to further their own interests, at times sabotaging the collaborative effort. These results provide insights to the complex nature of human information behavior in dynamic and complex work contexts and lead to recommendations for training and further research.

Communication roles that support collaboration during the design process

Abstract It is widely acknowledged that design (and development) teams increasingly include participants from different domains who must explore and integrate their specialized knowledge in order to create innovative and competitive artefacts and reduce design and development costs. Thus communication, including integration of specialized knowledge and negotiation of differences among domain specialists, has emerged as a fundamental component of the design process. This paper presents 13 communication roles that emerged during four multidisciplinary design situations in the USA and Europe. These roles supported knowledge exploration and integration, collaboration, and task and project completion by filtering and providing information and negotiating differences across organizational, task, discipline and personal boundaries. Implications for design methods, tools and education are discussed.

User Perspectives on Relevance Criteria: A Comparison among Relevant, Partially Relevant, and Not-Relevant Judgments.

This study investigates the use of criteria to assess relevant, partially relevant, and not-relevant documents. Study participants identified passages within 20 document representations that they used to make relevance judgments; judged each document representation as a whole to be relevant, partially relevant, or not relevant to their information need; and explained their decisions in an interview. Analysis revealed 29 criteria, discussed positively and negatively, that were used by the participants when selecting passages that contributed or detracted from a documents relevance. These criteria can be grouped into six categories: abstract (e.g., citability, informativeness), author (e.g., novelty, discipline, affiliation, perceived status), content (e.g., accuracy/validity, background, novelty, contrast, depth/scope, domain, citations, links, relevant to other interests, rarity, subject matter, thought catalyst), full text (e.g., audience, novelty, type, possible content, utility), journal/publisher (e.g., novelty, main focus, perceived quality), and personal (e.g., competition, time requirements). Results further indicate that multiple criteria are used when making relevant, partially relevant, and not-relevant judgments, and that most criteria can have either a positive or negative contribution to the relevance of a document. The criteria most frequently mentioned by study participants were content, followed by criteria characterizing the full text document. These findings may have implications for relevance feedback in information retrieval systems, suggesting that systems accept and utilize multiple positive and negative relevance criteria from users. Systems designers may want to focus on supporting content criteria followed by full text criteria as these may provide the greatest cost benefit.

Designing to support situation awareness across distances: an example from a scientific collaboratory

When collaborating, individuals rely on situation awareness (the gathering, incorporation and utilization of environmental information) to help them combine their unique knowledge and skills and achieve their goals. When collaborating across distances, situation awareness is mediated by technology. There are few guidelines to help system analysts design systems or applications that support the creation and maintenance of situation awareness for teams or groups. We propose a framework to guide design decisions to enhance computer-mediated situation awareness during scientific research collaboration. The foundation for this framework is previous research in situation awareness and virtual reality, combined with our analysis of interviews with and observations of collaborating scientists. The framework suggests that situation awareness is comprised of contextual, task and process, and socio-emotional information. Research in virtual reality systems suggests control, sensory, distraction and realism attributes of technology contribute to a sense of presence [Presence 7 (1998) 225]. We suggest that consideration of these attributes with respect to contextual, task and process, and socio-emotional information provides insights to guide design decisions. We used the framework when designing a scientific collaboratory system. Results from a controlled experimental evaluation of the collaboratory system help illustrate the frameworks utility.

Citation ranking versus peer evaluation of senior faculty research performance: a case study of Kurdish scholarship

The purpose of this study is to analyze the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Other studies typically derive their peer evaluation data directly from referees, often in the form of ranking. This study uses two additional sources of peer evaluation data: citation content analysis and book review content analysis. Two main questions are investigated: (a) To what degree does citation ranking correlate with data from citation content analysis, book reviews, and peer ranking? (b) Is citation ranking a valid evaluative indicator of research performance of senior faculty members? Citation data, book reviews, and peer ranking were compiled and examined for faculty members specializing in Kurdish studies. Analysis shows that normalized citation ranking and citation content analysis data yield identical ranking results. Analysis also shows that normalized citation ranking and citation content analysis, book reviews, and peer ranking perform similarly (i.e., are highly correlated) for high-ranked and low-ranked senior scholars. Additional evaluation methods and measures that take into account the context and content of research appear to be needed to effectively evaluate senior scholars whose performance ranks relatively in the middle. Citation content analysis data did appear to give some specific and important insights into the quality of research of these middle performers, however, further analysis and research is needed to validate this finding. This study shows that citation ranking can provide a valid indicator for comparative evaluation of senior faculty research performance.

Contested collaboration: a descriptive model of intergroup communication in information system design

Abstract Many information system design situations today include users, designers, and developers who, with their own unique group and individual perspectives, need to interact so that they can come to a working understanding of how the information system being developed will coexist with and ideally support patterns of work activities, social groups, and personal beliefs. In these situations, design is fundamentally an interactive process that requires communication among users, designers, and developers. However, communication among these groups is often difficult although of paramount importance to design outcomes. Through a qualitative analysis of a house, expert system, and telecommunications network architecture and management system design situations, a descriptive model of design that characterizes communication among users, designers, and developers as they create an artifact was developed. The model describes design phases, roles, themes, and intergroup communication networks as they evolve throughout the design process and characterizes design as a process of “contested collaboration”. It is a first step towards a predictive design model that suggests strategies which may help participants interact more effectively and ultimately improve the quality of design outcomes and the design process.

Scientific collaboratories in higher education: Exploring learning style preferences and perceptions of technology

Scientific collaboratories hold the promise of providing students access to specialized scientific instruments, data and experts, enabling learning opportunities perhaps otherwise not available. However, evaluation of scientific collaboratories in higher education has lagged behind their development. We conducted a repeated-measures study that provided data regarding social interaction learning styles and perceptions of a scientific collaboratory system from 40 university science students working face-to-face and remotely. Students with a strong competitive learning style preference or who worked with a student with a strong competitive learning style reported a slightly more positive perception of the relative advantage, compatibility and complexity of the collaboratory system. Students with a strong individualistic learning style preference or who worked with a student with a strong individualistic learning style reported a more negative perception of the observability of the system. No relationships were found between students’ cooperative learning style preference and their perceptions of the system after using it face-to-face or remotely.

Remote 3D medical consultation

Two-dimensional (2D) video-based telemedical consultation has been explored widely in the past 15-20 years. Two issues that seem to arise in most relevant case studies are the difficulty associated with obtaining the desired 2D camera views, and poor depth perception To address these problems we are exploring the use of a small array of cameras to reconstruct a real-time, on-line 3D computer model of the real environment and events. We call this 3D medical consultation (3DMC). The idea is to give remote users what amounts to an infinite set of stereoscopic viewpoints, simultaneously addressing the visibility and depth perception problems associated with 2D video. Here we describe our current prototype system, some of the methods we use, and some early experimental results

Expectations for a scientific collaboratory: a case study

In the past decade, a number of scientific collaboratories have emerged, yet adoption of scientific collaboratories remains limited. Meeting expectations is one factor that influences adoption of innovations, including scientific collaboratories. This paper investigates expectations scientists have with respect to scientific collaboratories. Interviews were conducted with 17 scientists who work in a variety of settings and have a range of experience conducting and managing scientific research. Results indicate that scientists expect a collaboratory to: support their strategic plans; facilitate management of the scientific process; have a positive or neutral impact on scientific outcomes; provide advantages and disadvantages for scientific task execution; and provide personal conveniences when collaborating across distances. These results both confirm existing knowledge and raise new issues for the design and evaluation of collaboratories.

Exploring new ways of working using virtual research environments in library and information science

Purpose – The purpose of this paper is to present current and ongoing research investigating new ways of working across geographic distances and time within library and information science (LIS). Design/methodology/approach – A total of four studies were conducted focusing on: the design of a virtual research environment (VRE) to facilitate the sharing of data collection instruments among students, researchers and professionals; new ways professionals and researchers can collaborate; collaborative decision making in the context of purchasing a library management system; and collaboration among LIS professionals. Findings – Early results show that VREs within LIS can build on previous VRE research which focused on other domains. However, there are several unique characteristics of LIS that place requirements on VREs and which are not yet implemented within VREs and that offer unique opportunities for VREs to enhance LIS research, education and practice. Originality/value – This paper reports on ongoing research and preliminary findings of unique studies investigating how VREs could enhance LIS research and professional practice, and how LIS research and practice can inspire the next generation of VREs.