Kenneth G. Brown

Self-Assessment of Knowledge: A Cognitive Learning or Affective Measure?

We conducted a meta-analysis to clarify the construct validity of self-assessments of knowledge in education and workplace training. Self-assessment’s strongest correlations were with motivation and satisfaction, two affective evaluation outcomes. The relationship between self-assessment and cognitive learning was moderate. Even under conditions that optimized the self-assessment–cognitive learning relationship (e.g., when learners practiced self-assessing and received feedback on their self-assessments), the relationship was still weaker than the self-assessment–motivation relationship. We also examined how researchers interpreted self-assessed knowledge, and discovered that nearly a third of evaluation studies interpreted self-assessed knowledge data as evidence of cognitive learning. Based on these findings, we offer recommendations for evaluation practice that involve a more limited role for self-assessment. ........................................................................................................................................................................

Reaping the benefits of task conflict in teams: the critical role of team psychological safety climate.

Past research suggests that task conflict may improve team performance under certain conditions; however, we know little about these specific conditions. On the basis of prior theory and research on conflict in teams, we argue that a climate of psychological safety is one specific context under which task conflict will improve team performance. Using evidence from 117 project teams, the present research found that psychological safety climate moderates the relationship between task conflict and performance. Specifically, task conflict and team performance were positively associated under conditions of high psychological safety. The results support the conclusion that psychological safety facilitates the performance benefits of task conflict in teams. Theoretical implications and suggestions for future research are discussed.

Applying self-determination theory to organizational research.

In this chapter we argue that self-determination theory (SDT; Deci & Ryan, 2000) provides a useful conceptual tool for organizational researchers, one that complements traditional work motivation theories. First, we review SDT, showing that it has gone far beyond the “intrinsic versus extrinsic motivation” dichotomy with which it began. Then we show how the theory might be applied to better understand a variety of organizational phenomena, including the positive effects of transformational leadership, the nature of “true” goal-commitment, the determinants of employees’ training motivation, and the positive impact of certain human resource practices. We note that SDT may yield significant new understanding of work motivation, and suggest opportunities to refine the theory for research on work-related phenomena.

2. Developing adaptability: A theory for the design of integrated-embedded training systems

The ALS is a theoretically driven approach to the design of integrated-embedded training systems that is highly flexible and offers ease of implementation. It operates by exerting leverage on foci of the self-regulation system, which recent research has demonstrated to be central to learning and performance for difficult, complex, and dynamic tasks. The training strategy incorporated in the ALS constructs instructional interventions by combining specific training components that affect different aspects of the SRS. By designing synergistic combinations, instructional interventions can be tailored to the developmental progress of trainees and can enhance learning, performance, and adaptability.Our research will target those training components that offer the greatest practical and theoretical potential for improving complex skill acquisition, and the enhancement of adaptive capabilities. By building on existing principles of training design (e.g. mastery goals, sequencing), and examining promising new ideas (e.g. information, interpretation) that are likely to be key capabilities of the next generation of advanced technology systems, the research is expected to yield new principles of training design uniquely suited for the design of integrated-embedded training systems.

Frame-of-Reference Training Effectiveness: Effects of Goal Orientation and Self-Efficacy on Affective, Cognitive, Skill-Based, and Transfer Outcomes

Empirical evidence supporting frame-of-reference (FOR) training as an effective intervention for calibrating raters is convincing. Yet very little is known about who does better or worse in FOR training. We conducted a field study of how motivational factors influence affective, cognitive, and behavioral learning outcomes, as well as near transfer indexed by achieving professional certification. Relying on goal orientation theory, we hypothesized effects for 3 goal orientations: learning, prove performance, and avoid performance. Results were generally supportive across learning outcomes and transfer. Findings further supported a hypothesized interaction between learning self-efficacy and avoid performance goal orientation, such that higher levels of learning self-efficacy mitigated the negative effects of higher performance avoid tendencies.

Specific Aptitude Theory Revisited: Is there Incremental Validity for Training Performance?

There has been controversy over the years about whether specific mental abilities increment validity for predicting performance above and beyond the validity for general mental ability (GMA). Despite its appeal, specific aptitude theory has received only sporadic empirical support. Using more exact statistical and measurement methods and a larger data set than previous studies, this study provides further evidence that specific aptitude theory is not tenable with regard to training performance. Across 10 jobs, differential weighting of specific aptitudes and specific aptitude tests were found not to improve the prediction of training performance over the validity of GMA. Implications of this finding for training research and practice are discussed.

Unfreezing change as three steps: Rethinking Kurt Lewin’s legacy for change management

Kurt Lewin’s ‘changing as three steps’ (unfreezing → changing → refreezing) is regarded by many as the classic or fundamental approach to managing change. Lewin has been criticized by scholars for over-simplifying the change process and has been defended by others against such charges. However, what has remained unquestioned is the model’s foundational significance. It is sometimes traced (if it is traced at all) to the first article ever published in Human Relations. Based on a comparison of what Lewin wrote about changing as three steps with how this is presented in later works, we argue that he never developed such a model and it took form after his death. We investigate how and why ‘changing as three steps’ came to be understood as the foundation of the fledgling subfield of change management and to influence change theory and practice to this day, and how questioning this supposed foundation can encourage innovation.

Who Believes Us? Understanding Managers’ Agreement With Human Resource Research Findings

Because research-supported human resource (HR) practices appear to positively affect organizational outcomes, it is important to understand the factors that impact managers’ agreement with HR research findings. The authors drew from two theoretical perspectives to develop and test a model of factors related to managers’ agreement with research findings about effective HR practices. Using structural equation modeling, the authors found that job level and managers’ perceptions of their organizations’ business strategies directly influence managers’ agreement with HR research findings. In addition, managers who read academic journals are more likely to agree with research findings. Implications for reducing the belief gap between academics and managers are discussed.

What Do We Teach in Organizational Behavior? An Analysis of MBA Syllabi

This study examines the syllabi of 241 required organizational behavior (OB) related classes in full-time U.S. MBA programs. Syllabi were coded for information about course title, topics, readings, cases, teaching methods, and learning assessment methods. Results revealed that the most frequent topics listed across courses are leadership and groups or teams. There was considerable diversity in assigned books, readings, and cases, with only a small number of books (2), readings (15), or cases (5) assigned in 10 or more courses within our sample. Assessment of student learning was conducted via (in order of importance for final student grades) testing, individual writing, class participation, group writing, group presentation, and individual presentation. Private, ranked MBA programs were more likely to offer more than one OB-related course, usually management plus leadership, or OB plus leadership. Implications of these findings for OB teaching are discussed, along with suggestions for future research.

Daring to Be Different Unconferences, New Conferences, and Reimagined Conferences

In management education, 2013 is the Year of the Daring; a year for those daring to be different. “Daring to Be Different” is the bold theme of this year’s Organizational Behavior Teaching Conference (OBTC) taking place in Asheville, North Carolina, in June. Compared with other conferences, OBTC has always had a different edge to it, but this year they are turning up the amp to 11 and creating an innovative and supportive space for management educators to explore new ideas (http://obtc.org/content/2013). The Academy of Management is similarly daring to be different this year with the launch of a new conference focused on management teaching. Called the “Teaching and Learning Conference at the Academy of Management,” or more catchily, the TLC@AOM, the one-day conference is situated on the Sunday between the professional development workshops and the scholarly program. The press release says that the “2013 TLC@AOM will (1) focus on practice to improve teaching and learning, addressing the needs of both novice and veteran members, and (2) represent all disciplines in AOM Divisions and interest groups with interdisciplinary topics and sessions.” In addition to these two daring innovations, 2013 saw the first “unconference” in management education. The Research in Management Learning and Education (RMLE) Unconference was held on February 1, 2013 at Bond