Ana Ortiz de Guinea

Measure for Measure: A two study multi-trait multi-method investigation of construct validity in IS research

Given the importance and criticality of instrument validation in IS research, the main objective of this study is to provide a systematic assessment of IS construct validity via multi-trait multi-method (MTMM) matrix. To do so, the paper uses structurally different methods - neurophysiological and self-reported instruments - to measure three important and commonly used IS constructs: engagement, arousal and cognitive load in two different experimental settings. The experiments involved seventeen (17) and twenty-four (24) participants respectively and consisted in using different IS to execute a set of both instrumental and hedonic tasks. The results generally support MTMM matrix expectations and shed light on the complexity of detecting the nature of mono-method bias. Specifically, the results show that primitive perceptual IS constructs such as arousal seem to be less affected by mono-method bias, whereas more complex perceptual constructs such as engagement or cognitive load have higher within method correlations. There are two complementary explanations for the within method correlations: (a) a combination between complexity of trait and method and (b) method effects that are congeneric.

Improving performance in medical practices through the extended use of electronic medical record systems: a survey of Canadian family physicians

BackgroundNumerous calls have been made for greater assimilation of information technology in healthcare organizations in general, and in primary care settings in particular. Considering the levels of IT investment and adoption in primary care medical practices, a deeper understanding is needed of the factors leading to greater performance outcomes from EMR systems in primary care. To address this issue, we developed and tested a research model centered on the concept of Extended EMR Use.MethodsAn online survey was conducted of 331 family physicians in Canadian private medical practices to empirically test seven research hypotheses using a component-based structural equation modeling approach.ResultsFive hypotheses were partially or fully supported by our data. Family physicians in our sample used 67% of the clinical and 41% of the communicational functionalities available in their EMR systems, compared to 90% of the administrative features. As expected, extended use was associated with significant improvements in perceived performance benefits. Interestingly, the benefits derived from system use were mainly tied to the clinical support provided by an EMR system. The extent to which physicians were using their EMR systems was influenced by two system design characteristics: functional coverage and ease of use. The more functionalities that are available in an EMR system and the easier they are to use, the greater the potential for exploration, assimilation and appropriation by family physicians.ConclusionsOur study has contributed to the extant literature by proposing a new concept: Extended EMR Use. In terms of its practical implications, our study reveals that family physicians must use as many of the capabilities supported by their EMR system as possible, especially those which support clinical tasks, if they are to maximize its performance benefits. To ensure extended use of their software, vendors must develop EMR systems that satisfy two important design characteristics: functional coverage and system ease of use.

Are we talking about the task or the computer? An examination of the associated domains of task-specific and computer self-efficacies

Much research has investigated computer self-efficacy. Despite these efforts, the relation between efficacy beliefs concerning the task being performed on the computer and beliefs dealing with the computer application remains overlooked. In this study, we apply associationism to show how task-specific self-efficacy beliefs (TSE) positively influence computer-specific self-efficacy (CSE) judgments. We also show that this relation might be more complex than first thought: the degree of match between the novelty of the task and the novelty the application moderates this relation. That is, when both the task and the application are novel (or not), the influence of TSE on CSE is greater than when one is novel and the other is not. Furthermore, we show that CSE positively influences perceptions of usefulness, and as such, CSE represents one of the building blocks of the formation of beliefs about computer applications. Finally, several implications for practice and future research are discussed.

Neurophysiological Correlates of Information Systems Commonly Used Self-Reported Measures: A Multitrait Multimethod Study

Given the importance and criticality of instrument validation in IS research, the objective of this study is to provide a systematic assessment of IS construct validity via a multitrait multimethod (MTMM). In doing so, this paper uses structurally different methods -- neurophysiological and self-reported scales - to measure three commonly used IS constructs: engagement, arousal and cognitive load. The studys results generally support MTMM expectations and shed light on the complexity of detecting the nature of mono-method bias. More specifically, the studys results show that primitive perceptual IS constructs such as arousal are unlikely to suffer from mono-method bias, whereas more complex perceptual constructs such as engagement or cognitive load have higher within method correlations. There are two alternative explanations for the within method correlations: a) a method bias, or b) a combination between trait and method.

The Level Paradox of E-Collaboration: Dangers and Solutions

Although e-collaboration phenomena are multilevel in nature, research to date has been conducted from an exclusively single-level focus. This has lead to the level paradox. The dangers of the level paradox are discussed, including the potential that apparent cumulative knowledge may actually be spurious. Solutions to the level paradox are proposed in the form of future opportunities of research from several mixed-level approaches, and the benefits and barriers to mixed-level research are discussed. The article ends with a discussion on the necessity of finding a balance between single-level and mixed-level research, as well as on the necessity of single-level studies explicitly specifying the levels of theory, measurement, and data in their research.

Combining variance and process in information systems research: Hybrid approaches

For the most part, research in Information Systems has been conducted following either a process or a variance approach. Some argue that the two approaches should be kept separate because they have different underlying assumptions. Others disagree. Through problematization, we review the distinctions between process and variance approaches and examine such distinctions to show that these approaches sometimes overlap and can be combined. We then present a new set of assumptions for hybrid approaches and specifically distinguish between three types of combinations or hybrids, parallel, weakly blended, and strongly blended. We then introduce a toolbox for modeling hybrid approaches in a coherent way followed by an example on how to use the toolbox. We end the article by providing reasons for considering hybrid approaches, possible areas of research, and a set of guidelines for authors and review teams. Some have argued that process and variance approaches should be kept separate.We present a new set of assumptions for combination or hybrid approaches.We distinguish between two types of hybrids, parallel and blended.We provide a toolbox for modeling hybrids in a coherent way.We provide reasons for hybrids, possible areas of research, and guidelines.

Ceiling effect in EMR system assimilation: a multiple case study in primary care family practices

BackgroundThere has been indisputable growth in adoption of electronic medical record (EMR) systems in the recent years. However, physicians’ progress in using these systems has stagnated when measured with maturity scales. While this so-called ceiling effect has been observed and its consequences described in previous studies, there is a paucity of research on the elements that could explain such an outcome. We first suggest that in the context of EMR systems we are in presence of a “tiered ceiling effect” and then we show why such phenomenon occurs.MethodsWe conducted in-depth case studies in three primary care medical practices in Canada where physicians had been using EMR systems for 3 years or more. A total of 37 semi-structured interviews were conducted with key informants: family physicians (about half of the interviews), nurses, secretaries, and administrative managers. Additional information was obtained through notes taken during observations of users interacting with their EMR systems and consultation of relevant documents at each site. We used abductive reasoning to infer explanations of the observed phenomenon by going back and forth between the case data and conceptual insights.ResultsOur analysis shows that a ceiling effect has taken place in the three clinics. We identified a set of conditions preventing the users from overcoming the ceiling. In adopting an EMR system, all three clinics essentially sought improved operational efficiency. This had an influence on the criteria used to assess the systems available on the market and eventually led to the adoption of a system that met the specified criteria without being optimal. Later, training sessions focussed on basic functionalities that minimally disturbed physicians’ habits while helping their medical practices become more efficient. Satisfied with the outcome of their system use, physicians were likely to ignore more advanced EMR system functionalities. This was because their knowledge about EMR systems came almost exclusively from a single source of information: their EMR system vendors. This knowledge took the form of interpretations of what the innovation was (know-what), with little consideration of the rationales for innovation adoption (know-why) or hands-on strategies for adopting, implementing and assimilating the innovation in the organization (know-how).ConclusionsThis paper provides a holistic view of the technological innovation process in primary care and contends that limited learning, satisficing behaviours and organizational inertia are important factors leading to the ceiling effect frequently experienced in the EMR system assimilation phase.

Four common multicommunicating misconceptions

Multicommunicating (MC) represents a form of multitasking in which employees such as IS analysts and managers engage in multiple conversations at the same time (e.g., by sending texts while on a telephone call). MC can occur either during group meetings or during one-on-one conversations: the present paper focuses on the latter, termed dyadic MC. MC is increasingly prevalent in the workplace and is often useful in today’s business world, for example by making it possible to respond in a timely manner to urgent communications. Nonetheless, the efficacy of MC behaviors can also be questioned as they have been found to negatively affect performance and workplace relationships, as well as causing stress. During our investigations of this phenomenon, we often heard IS practitioners say ‘So what? I do this all the time, it’s no problem!’ which suggests that certain misconceptions regarding MC behaviors may be prevalent. Arising from research findings in multiple disciplines, we examine four such practitioner beliefs regarding MC behaviors: MC makes employees more accessible, it enhances productivity, it is required in most jobs, and rudeness is not an issue when MC. Further, we suggest recommendations to IS employees and managers so that they can better manage MC.

Using a Cognitive Analysis Grid to Inform Information Systems Design

Following our first conceptualization of a cognitive analysis grid (CA grid) for IS research in 2014, the CA grid was improved and tested in a proof of concept manner. The theory and application of this method are briefly explained, along with lessons learned from a first experiment. The next steps in the validation of this method include applying it to a wider group of naive participants. This will allow to draw statistical parallels between the cognitive demand of the interface and the performance of the users based on their cognitive profile. Ultimately, this technique should be useful both in NeuroIS research and user experience (UX) tests to guide hypotheses and explain user’s performance.

Applying Evolutionary Psychology to the Study of Post-adoption Information Technology Use: Reinforcement, Extension, or Revolution?

How and why people use information technology (IT) after initial adoption is a growing area of research in the information systems (IS) field. For the most part, IS scholars have approached this area of study with conceptual tools well honed in the study of initial IT adoption and acceptance – specially, with theories of reasoned action that emphasize the conscious formation of beliefs, attitudes, and intentions to engage in IT use behavior. At the same time, continuing IT use researchers have recognized the importance of non-reflective action – specifically, habitual behavior – in the explanation of post-adoption IT use. In this chapter, we inquire about the relevance and implications of evolutionary psychology , a theoretical paradigm recently introduced to the IS community, for the study of continuing IT use. We compare the core concepts and basic assumptions of both areas of study and we explore three ways in which IS scholars could use evolutionary insights: (1) to reinforce and justify current research approaches, (2) to extend current theory and methods in important new ways, such as by linking objective technical characteristics to cognitive belief formation, or (3) to revolutionize current approaches, for instance, by respecifying the role of emotion in behavior and by redefining the concept of habit.