Vidar Gynnild

Quality Assurance Reconsidered: A Case Study

Abstract This article examines an external evaluation of the quality assurance system at the Norwegian University of Science and Technology (NTNU) conducted by The Norwegian Agency for Quality Assurance in Higher Education (NOKUT). The external audit report along with internal reports provided by the seven faculties of the university served as the major data sources for the study. The quality assurance system, which was approved by NOKUT, serves as an example of how the university falls short in producing data to systematically improve student learning. Systematic follow‐ups to verify the effects of the quality assurance system could have sparked discussions, not only about the structure of the quality system but also what quality learning means and how it can be promoted.

Identifying and promoting self‐regulated learning in higher education: roles and responsibilities of student tutors

This article reports on a case study of learning and academic achievement in engineering education. Two sets of oral exams were used as a source of information in relation to students’ learning and needs in the learning situation. Through ensuing interviews, patterns of learning strategies were discerned. Academically successful students utilised self‐monitoring skills, such as self‐evaluation and comprehension monitoring, while these skills were used only to a minor extent by those less successful. Promoting self‐regulated learning could be one way to improve student learning. The research literature, however, suggests that merely teaching self‐monitoring skills does not necessarily make a difference. This study therefore focuses on roles of tutors in identifying and promoting self‐regulated learning.

Teaching as Coaching: A Case Study of Awareness and Learning in Engineering Education.

This paper presents a number of case studies in Oceanography, an optional module in the third/fourth year of a Master of Science programme at Norwegian University of Science and Technology. The main objective was to gain more thorough insights into student learning by examining two sets of individual oral examinations. In addition, all students were interviewed about their intentions and behaviours when studying. These interviews, as well as being a useful source of information on learning, turned out to serve as coaching sessions as well. In their interviews, students revealed different learning approaches. The major focus of this study is directed towards the less successful students, who appeared to have problems in focusing on crucial learning issues. The authors suggest a gestalt theoretical model to embody support that might remedy the situation. Its main application has so far been within psychotherapy, but the authors argue that the principles can easily be applied in learning with potentially great benefit.

Assessing practical laboratory skills in undergraduate molecular biology courses

This study explored a new strategy of assessing laboratory skills in a molecular biology course to improve: student effort in preparation for and participation in laboratory work; valid evaluation of learning outcomes; and students’ employment prospects through provision of evidence of their skills. Previously, assessment was based on written laboratory reports and examinations, not on the demonstration of practical skills per se. This action research project involved altering the assessment design so that a greater proportion of the marks was allocated to active participation and learning in the laboratory, partially replacing a single examination with direct observation of student participation and learning over a prolonged period of weekly laboratory sessions. We ascertained staff and students’ perceptions of the new assessment processes by means of a Likert scale questionnaire, student focus group and individual staff interviews. Overall, students and staff evaluated the new assessment structure positively, citing fairness, authenticity and reward for effort. Results also revealed the need for specific training of staff in this form of assessment and indicated staff–student ratios made assessment burdensome. Four out of five students reported that an increased awareness of the importance of practical laboratory skills stimulated them to greater efforts to achieve.

Motivation for Achievement and Attitudes toward Mathematics Instruction in a Required Calculus Course at the Norwegian University of Science and Technology

This study from the Norwegian University of Science and Technology (NTNU) examines students’ learning goals and attitudes toward mathematics in a first-year calculus course in undergraduate engineering education. Achievement motivation research using the Achievement Goal Questionnaire (AGQ) is advanced from current literature with two additions: (1) a course specific context using introductory college calculus students, and (2) participation of Norwegian students. Preand posttest measures of attitudes indicate that students do change learning goals over time, unfortunately opposite to the instructors’ aspirations. A significant increase in “Mastery Avoidance” and “Work Avoidance” was accompanied with a drop in “Mastery Approach” and “Performance Approach”. Variables such as value, motivation and enjoyment decreased along with a significant drop in self-confidence.

External examiners in new roles: a case study at the Norwegian University of Science and Technology

Norway has a long tradition of using external examiners during examinations and grading. However, a recently passed higher education reform requires a different use for external examiners. The Quality Reform of Higher Education calls for more learning‐oriented assessment methods, allowing more feedback for students during the course of their studies. Examples of such methods are modular examinations, projects, and portfolios. As part of the reform, external examiners are also expected to contribute to improving assessment systems. This article describes an assessment project carried out at the Department of Marine Technology at the Norwegian University of Science and Technology in the spring of 2002. In the study the external examiner did not have the adequate experience to evaluate assessment methods, or contribute actively in discussions about the subjects assignments, teaching schedule and methods. Cooperation between the subject teacher and the examiner on criteria for, and assessment of, specific papers was most useful.

Introducing innovative approaches to learning in fluid mechanics : a case study

The purpose of the current article is to examine the impact of laboratory demonstrations and computer visualizations on learning in a third-year fluid mechanics course at Norwegian University of Science and Technology (NTNU). As a first step, on entering the course, students were exposed to a laboratory demonstration focusing on the nature of waves. Students were subsequently taught the theory of wave mechanics in a regular class along with exercises. Finally, the computer algebra system Maple was used to simulate physical properties of the waves using the mathematical equations. The illustrations throughout the paper are examples of some of the pedagogical devices that students were exposed to during the project. The students enjoyed the demonstrations, but there are some indications that the interventions did not help to improve learning of phenomena.

Student appeals of grades: a comparative study of university policies and practices

Handling appeals against grades is time consuming and requires allocation of resources away from the pursuit of activities such as instruction, research, and supervision of postgraduate students. This study examines grievance policies, frequencies, and outcomes of appeals at the University of California (UCB) and the University of Oslo (UIO). We find that while the number of formal grievances at the Norwegian institution is high and rising, that at UCB is extremely low and stable by comparison. Most grievance cases at UIO do not result in a change of grade; however, when grade changes do occur, they are most often in favour of the complainant. Compared with UIO, UCB had surprisingly few filed formal grievances. Grade disputes at UCB are most often resolved at an informal level and only rarely proceed to a formal case. We argue in favour of the application of informal methodologies to reduce the number of formal cases that arise. Such processes allow the core of the matter to be discerned before any formal appeal is initiated and provide excellent opportunities for the stakeholders to learn from the process.

Revisiting Approaches to Learning in Science and Engineering: A Case Study.

Several studies have applied the dichotomy of deep and surface approaches to learning in a range of disciplinary contexts. Existing questionnaires have largely assumed the existence of these constructs; however, in a recent study Case and Marshall (2004) described two additional context-specific approaches to learning in engineering. The current study examines approaches to learning in a similar, but not identical educational context. Academically successful students adopted either a conceptual deep approach or a procedural deep approach, whereas their less academically successful peers resorted to a procedural surface approach. This study confirms constructs identified by Case and Marshall (2004); however, a much larger student sample would be necessary to generalise current findings. Issues of diversity in the student population are outlined and measures suggested that might help increase the prevalence of deep approaches to learning.

Assessing vocal performances using analytical assessment: a case study

This study investigated ways to improve the appraisal of vocal performances within a national academy of music. Since a criterion-based assessment framework had already been adopted, the conceptual foundation of an assessment rubric was used as a guide in an action research project. The group of teachers involved wanted to explore thinking underpinning their individual judgements in order to make explicit the criteria and standards against which assessment and grading were made. The purpose was to reduce uncertainty and increase transparency to make assessment more predictable, reliable and fair. It was also hoped that the rubric would help to avoid disagreements since criteria were communicated openly. However, disagreements took place over the level of detail in criteria and what would be a sensible way of making use of explicit criteria. The study concludes that while the rubric carries a great potential in aligning judgements, it cannot fully replace a professional holistic appraisal.