Kuo Hung Tseng

A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students

This study explored the consistency and difference of teacher-, student self- and peer-assessment in the context of Web-based portfolio assessment. Participants were 72 senior high school students enrolled in a computer application course. Through the assessment system, the students performed portfolio creation, inspection, self- and peer-assessment; three teachers reviewed portfolios and evaluated learning performances. There were significant differences in the results of the three assessment methods, among which teacher-raters adopted the most rigorous scoring standards, while peer-raters tended to use the most lax standards. The results of self- and teacher-assessment were discovered to be consistent; however, consistency was not discovered between self- and peer-assessment as well as peer- and teacher-assessment. In analyzing their consistency with the end-of-course examination, teacher- and self-assessment demonstrated high consistency, whereas peer-assessment showed a low level of consistency.

Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course

This study examined the reliability and validity of Web-based portfolio peer assessment. Participants were 72 second-grade students from a senior high school taking a computer course. The results indicated that: 1) there was a lack of consistency across various student raters on a portfolio, or inter-rater reliability; 2) two-thirds of the raters demonstrated inconsistency assessing different portfolios, i.e. inner-rater reliability; 3) peer-assessment scores were not consistent with teacher-assessment scores (criterion-related validity); 4) significant differences were found between peer-assessment scores and end-of-course examination scores, implying that Web-based portfolio peer assessment failed to reflect learning achievements (criterion-related validity). In short, Web-based portfolio peer assessment was not a reliable and valid method.

Use and Performances of Web-Based Portfolio Assessment.

This research explored the influence of a Web-based portfolio assessment systemonstudents’performances.Themethodologicalprocedureadoptedwas to have the experimental group use the system, with the control group using conventional assessment.The study subjects were junior high school students of two computer classes.The experimental results revealed that the use of the systemhassignificantpositiveinfluenceonstudents’performances.According to estimated effect size, the most significant indicators were reflection, selfassessment, continuous improvement, goal setting, problem solving, data gathering, work and peer interaction. However, peer-assessment performance was not enhanced significantly.Therefore, one recommendation was to reduce peer-assessmentandinsteadofferspecificillustrationstothestudentsaswellas the opportunity to drill.

Using a Web-Based Portfolio Assessment System to Elevate Project-Based Learning Performances.

This study examines the effect of a Web-based portfolio assessment system on the performances of students undertaking project-based learning (PBL). The research targets were 60 students from two grade-8 classes taking senior high school computer courses. The experimental group comprised 30 students, who used the system to perform PBL and assessment in one class. The control group comprised of 30 students who employed conventional assessment for PBL of another class. Experimental results indicate that the system has no significant effect on student achievement, but had a statistically positive effect on self-perceived learning performances. In addition, teacher-assessment and self-assessment of project achievements produced different results.

Is single or dual channel with different English proficiencies better for English listening comprehension, cognitive load and attitude in ubiquitous learning environment?

The purpose of the present study was to examine the effects of English proficiency (low vs. high) and material presentation mode (single channel vs. dual channel) on English listening comprehension, cognitive load and learning attitude in a ubiquitous learning environment. An experimental learning activity was implemented using PDA as a learning tool to facilitate learning. A quasi-experimental design was employed with university students participating in the experiment. The results revealed that (a) high English proficiency learners had significantly better English listening comprehension and lower intrinsic and extraneous load than low English proficiency learners; (b) both high and low English proficiency learners learning with dual channel had significantly better English listening comprehension and held more positive attitude toward the ubiquitous learning environment than learners learning with single channel; (c) for learners learning with single channel, low English proficiency learners had significantly higher extraneous load than high English proficiency learners; and (d) for low English proficiency learners, learners who learned with dual channel possessed significantly lower extraneous load than learners who learned with single channel. The suggestions for educators and instructional designers were also discussed in the present study.

Constructing and evaluating online goal-setting mechanisms in web-based portfolio assessment system for facilitating self-regulated learning

The purpose of the present study was to construct goal-setting mechanisms in a web-based portfolio assessment system (WBPAS), based on the self-regulated learning (SRL) process proposed by Zimmerman, and to examine effects of these mechanisms on SRL. The participants were two classes of 11th graders taking the website design class in a vocational high school. The participants were assigned randomly to either an experimental group (n = 40) learning with a WBPAS or a control group (n = 41) learning with a paper-based portfolio. The study results revealed the following: a) the quality of goal-setting mechanisms may facilitate SRL. b) Students setting learning goals with the WBPAS demonstrated significantly better SRL than students setting learning goals with the paper-based portfolio.

Using e-portfolios to elevate knowledge amassment among university students

The study aimed to explore the effect of e-portfolios on knowledge amassment. Participants were juniors majoring in multimedia design and taking the course Analysis on Digital Game Industry at a university. They were randomly selected and assigned to an experimental group with 43 students?or to a control group with 45 students. Students in the experimental group created their personal e-portfolios by using blogs, whereas students in the control group did not. The experiment lasted nine weeks, and took 3?h per week. The study results showed that the experimental group had significantly higher knowledge amassment after using e-portfolios than before. The experimental group had significantly better knowledge amassment than the control group did. This indicated that the effects of blog-based portfolios on knowledge amassment was significantly positive. Participants were juniors majoring in multimedia design and taking the course Digital Game.Experimental group had significantly higher knowledge amassment after using e-portfolios.Experimental group had significantly better knowledge amassment than the control group did.Effects of blog-based portfolios on knowledge amassment was significantly positive.

Does using e-portfolios for reflective writing enhance high school students’ self-regulated learning?

The study aims to examine whether reflective writing using e-portfolios enhances high school students’ self-regulated learning. Participants included two classes of eighth-graders majoring in Information Processing and taking a course called ‘Website Design’ at a vocational high school in Taiwan. There were 41 students, with 18 males and 23 females. The experiment lasted 10 weeks, and students used e-portfolios to reflect on their learning. The results showed that students after using e-portfolios to reflect on their learning had significantly better self-regulated learning than before. This indicates that using e-portfolios for reflection enhanced self-regulated learning. It also shows that high-reflection students had significantly better self-regulated learning than moderate-reflection and low-reflection students, which implies that reflective performance had a significantly positive effect on self-regulated learning.

The influence of perceived convenience and curiosity on continuance intention in mobile English learning for high school students using PDAs

Mobile learning aims to utilise communication devices such as mobile devices and wireless connection in combination with e-learning systems, allowing learners to experience convenient, instant and suitable learning at unrestricted time and place. Participants were 125 Taiwanese senior high school students, whose continuance intention was examined after learning English via PDAs (personal digital assistants). The study, using the one-group post-test design, adopted the Technology Acceptance Model and incorporated factors such as curiosity and perceived convenience. The results indicated that (1) curiosity had a positive effect on continuance intention; (2) perceived convenience had a positive effect on perceived usefulness and continuance intention.