Alain Pinsonneault

Survey research methodology in management information systems: an assessment

Survey research is believed to be well understood and applied by management information systems (MIS) scholars. It has been applied for several years and it has precise procedures which, when followed closely, yield valid and easily interpretable data. Our assessment of the use of survey research in the MIS field between 1980 and 1990 indicates that this perception is at odds with reality. Our analysis indicates that survey methodology is often misapplied and is plagued by five important weaknesses: (1) single-method designs where multiple methods are needed, (2) unsystematic and often inadequate sampling procedures, (3) low response rates, (4) weak linkages between units of analysis and respondents, and (5) overreliance on cross-sectional surveys where longitudinal surveys are really needed. Our assessment also shows that the quality of survey research varies considerably among studies of different purposes: explanatory studies are of good quality overall, exploratory and descriptive studies are of moderate to poor quality. This article presents a general framework for classifying and examining survey research and uses this framework to analyze the usage of survey research conducted in the past decade in the MIS field. In an effort to improve the quality of survey research, this article makes specific recommenoations that directly address the major problems highlighted in the review.

Competing perspectives on the link between strategic information technology alignment and organizational agility: insights from a mediation model

Strategic information technology alignment remains a top priority for business and IT executives. Yet with a recent rise in environmental volatility, firms are asking how to be more agile in identifying and responding to market-based threats and opportunities. Whether alignment helps or hurts agility is an unresolved issue. This paper presents a variety of arguments from the literature that alternately predict a positive or negative relationship between alignment and agility. This relationship is then tested using a model in which agility mediates the link between alignment and firm performance under varying conditions of IT infrastructure flexibility and environmental volatility. Using data from a matched survey of IT and business executives in 241 firms, we uncover a positive and significant link between alignment and agility and between agility and firm performance. We also show that the effect of alignment on performance is fully mediated by agility, that environmental volatility positively moderates the link between agility and firm performance, and that agility has a greater impact on firm performance in more volatile markets. While IT infrastructure flexibility does not moderate the link between alignment and agility, except in a volatile environment, we reveal that IT infrastructure flexibility has a positive and significant main effect on agility. In fact, the effect of IT infrastructure flexibility on agility is as strong as the effect of alignment on agility. This research extends and integrates the literature on strategic IT alignment and organizational agility at a time when both alignment and agility are recognized as critical and concurrent organizational goals.

A Model of Organizational Integration, Implementation Effort, and Performance

The notion of integration is central to the understanding of organizations in general as well as of contemporary phenomena such as e-commerce, virtual organizations, virtual teams, and enterprise resource planning (ERP) implementation. Yet, the concept of integration is ill-defined in the literature, and the impact of achieving high levels of integration is not well understood. The present paper addresses these issues. Drawing on the literature of several fields, this paper proposes the concept oforganizational integration (OI), which is defined as the extent to which distinct and interdependent organizational components constitute a unified whole. Six types of OI are identified: two intraorganizational OI (internal-operational, internal-functional) and four interorganizational OI (external-operational-forward, external-operational-backward, external-operational-lateral, and external-functional). This paper then presents a model and develops 14 propositions to predict (1) the effort needed to implement different types of OI, (2) the impact different types of OI will have on organizational performance, and (3) how six factors (interdependence, barriers to OI, mechanisms for achieving OI, environmental turbulence, complexity reduction mechanisms, and organizational configurations) influence the relationship between OI types, implementation effort, and organizational performance. The OI framework and model are then used to develop 14 propositions for ERP implementation research and to explain the findings of recent research on integration.

On the assessment of the strategic value of information technologies: conceptual and analytical approaches

This study compares two conceptual (resource-centered and contingency-based) and two analytical (linear and nonlinear) approaches that can be used to assess the strategic value of information technology. Two hypotheses related to these approaches are developed and tested based on matched survey data collected from the CEOs and CIOs of 110 firms. The results indicate that the resource-centered and contingency-based approaches provide complementary understanding of the strategic value of IT. On the one hand, the contingency-based approach is better at explaining the impact of cost-related IT applications on firm performance. Alignment between business strategy and information systems strategy on cost reduction was found to have a significant negative association with firm expense. On the other hand, the resource-centered perspective has a stronger predictive ability of IT impact on firm revenue and profitability. Our results indicate that investments in growth-oriented applications were directly and positively related to firm revenue. An ANOVA test indicates that the nonlinear approaches provide additional insights that help to better understand the relationship between alignment and performance. The response surface method (RSM) shows that high-end strategic alignment (i.e., fit occurring when business strategy and IT strategy are both high) leads to superior performance compared to low-end strategic alignment (i.e., fit occurring when business strategy and IT strategy are both low). We discuss the implications of this study for research and practice and conclude with suggestions for future research directions.

The other side of acceptance: studying the direct and indirect effects of emotions on information technology use

Much ado has been made regarding user acceptance of new information technologies. However, research has been primarily based on cognitive models and little attention has been given to emotions. This paper argues that emotions are important drivers of behaviors and examines how emotions experienced early in the implementation of new IT applications relate to IT use. We develop a framework that classifies emotions into four distinct types: challenge, achievement, loss, and deterrence emotions. The direct and indirect rela tionships between four emotions (excitement, happiness, anger, and anxiety) and IT use were studied through a survey of 249 bank account managers. Our results indicate that excitement was positively related to IT use through task adaptation. Happiness was directly positively related to IT use and, surprisingly, was negatively associated with task adaptation, which is a facilitator of IT use. Anger was not related to IT use directly, but it was positively related to seeking social support, which in turn was positively related to IT use. Finally, anxiety was negatively related to IT use, both directly and indirectly through psychological distancing. Anxiety was also indirectly positively related to IT use through seeking social support, which countered the original negative effect of anxiety. Post hoc ANOVAs were conducted to compare IT usage of different groups of users experiencing similar emotions but relying on different adaptation behaviors. The paper shows that emotions felt by users early in the implementation of a new IT have important effects on IT use. As such, the paper provides a complementary perspective to understanding acceptance and antecedents of IT use. By showing the importance and complexity of the relationships between emotions and IT use, the paper calls for more research on the topic

The impact of technological support on groups: An assessment of the empirical research

Abstract In this paper we analyze the empirical findings on the impacts of technological support on group. We define and differentiate two broad technological support systems for group processes: Group Decision Support Systems (GDSS), and Group Communication Support Systems (GCSS). We then present a framework and method for analyzing the impacts of such information systems on groups. We develop the framework from the literature of organization behavior and group psychology and apply it to literature of MIS. We then review the empirical research and findings concerned with the impacts of GDSS and GCSS on groups, and we compare and contrast these findings. Finally, we conclude by discussing the implications of our analysis on the focus of attention and design of future research. Five Major implications stem from our analysis: (1) there is lack of research on some important “formal” factors of groups, (2) there is a paucity of research on the impacts of GDSS and GCSS on the informal dimension of groups, (3) there is a need to move away from laboratory settings to field study in organization settings, with “real” manager, (4) more research is needed on stages of group development and on how they affect the impacts of GDSS and GCSS on groups, and (5) more research is needed to understand how the structure imposed by the technological supports affect group processes.

Electronic Brainstorming: the Illusion of Productivity

Electronic brainstorming (EBS) has been proposed as a superior approach to both nominal brainstorming (working alone) and face-to-face brainstorming (verbal). However, existing empirical evidence regarding EBSs superiority over nominal brainstorming is weak. Through a comprehensive examination of the process gains and process losses inherent to different brainstorming approaches, this paper explains past results. The paper also suggests that the process gain versus process loss advantages of EBS technologies may not be large enough to enable EBS groups to outperform nominal groups. In an effort to find alternate ways of using EBS more productively, three conditions thought to increase EBSs process gains and decrease its process losses (thus improving its productivity) are identified. A laboratory experiment designed to compare the productivity of ad hoc and established groups using four brainstorming technologies (nominal, EBS-anonymous, EBS-nonanonymous, verbal), generating ideas on socially sensitive and less sensitive topics, in the presence and absence of contextual cues, is then described. The results of the experiment showed that overall, groups using nominal brainstorming significantly outperformed groups using the other three brainstorming approaches. Further, even under conditions thought to be favorable to EBS, nominal brainstorming groups were at least as productive as EBS groups. The paper explains these results by suggesting that the process gains of EBS may not be as large as expected and that the presence of four additional process losses inherent to EBS technologies impair its productivity. It is also argued that the prevailing popularity of group brainstorming (verbal or electronic) in organizations may be explained by the perceived productivity of those approaches. These perceptions, which are at odds with reality, create the illusion of productivity. A similar misperception may also cause an illusion of EBS productivity in the research community, especially when perceptual measures of group performance are used.

Challenges in Conducting Empirical Work Using Structuration Theory: Learning from IT Research

Giddens’s structuration theory is increasingly used as an alternative approach to studying numerous organizational phenomena. However, the applicability of Giddens’s concepts is not without difficulties because of two main challenges. First, structuration theory is complex, involving concepts and general propositions that operate at a high level of abstraction. Second, structuration theory is not easily coupled to any specific research method or methodological approach, and it is difficult to apply empirically. Arguing that structuration theory is a valuable framework for a rich understanding of management, organization and related subjects of inquiry, this paper aims to improve the application of structuration theory in empirical work by drawing on the experience in information technology (IT) research. It identifies patterns of use of Giddens’s theory in publications in the domain of IT, and then describes how IT researchers have attempted to address its major empirical challenges. The paper presents a repertoire of research strategies that might guide students of organization in dealing with three elements that are central to structuration theory: duality of structure, time/space and actors’ knowledgeability.

The effects of electronic meetings on group processes and outcomes: An assessment of the empirical research

Abstract In this paper we analyze the empirical research on the impacts of electronic meetings on group processes and outcomes. We define and differentiate two broad types of electronic meeting systems: Group Decision Support Systems (GDSS) and Group Communication Support Systems (GCSS). We then present a framework and method for analyzing the impacts of such information systems on groups that we develop from the literature of organization behavior and group psychology. We review the empirical research and findings concerned with the impacts of GDSS and GCSS on groups, and we compare and contrast these findings. Finally, we conclude by discussing the implications of our analysis on the focus of attention and the design of future research. Our review of the empirical research suggests that GDSS and GCSS have similar impacts on some aspects of group processes and outcomes, but opposite impacts on other aspects. GDSS and GCSS both increase the depth of analysis of groups, increase participation, decrease domination by a few members, and increase decision quality. On the other hand, GDSS increase consensus reaching, decrease decision time, increase confidence in the decision by the group members, increase the satisfaction of group members with the process, and increase the satisfaction of the group members with the decision. GCSS decrease cooperation, increase the time to reach a decision, and decrease the confidence in decisions.

Information technology and the nature of managerial work: from the productivity paradox to the Icarus paradox?

Modern organizations are investing heavily in information technology (IT) with the objective of increasing overall profitability and the productivity of their knowledge workers. Yet, it is often claimed that the actual benefits of IT are disappointing at best, and that IT spending has failed to yield significant productivity gains -- hence the productivity paradox. Evidence is fragmented and somewhat mitigated. This paper argues that the current state of empirical research results from a failure to understand the interplay between IT and managerial work. It addresses this issue by analyzing patterns of association between IT usage and the nature of managerial work in different organizational contexts. Fifty-nine semi- structured interviews were conducted with middle line managers in three large companies: a Bank, a Telecommunications company, and a Utility. In addition, daily activities and IT usage were logged. The data indicate that the relationship between the level of IT usage and the nature of managerial work was stronger in the two organizations that were reorienting their strategies (Bank, Telecommunications) than in the one pursuing its existing strategy (Utility). It was also found that the pattern of the relationship between IT usage and the nature of managerial work depended on the kind of strategic reorientation implemented by the firm. For instance, in the Bank, the level of IT usage was associated with the amount of time spent by managers on information-related activities (e.g., reading reports, gathering information) and on disturbance handling activities (e.g., resolving conflicts, managing crises). In the Telecommunications company, IT usage was associated with more time spent on information-related activities and less on negotiation-related activities (e.g., discussions with colleagues on resource sharing, discussions with subordinates on performance standards). This finding suggests that heavy IT users paid greater attention to and spent more time on the roles they performed best with the technology (information-related activities), and may in fact have been embarking on an over-specialization trajectory.