Dorothée Behr

Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys

This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web survey in which respondents were asked to give reasons for selecting a response category for a closed question. The web study was conducted in Germany, with respondents drawn from online panels (n = 1,023). The usefulness of the proposed approach is shown by revealing validity problems with a gender ideology item.

Cognitive Probes in Web Surveys: On the Effect of Different Text Box Size and Probing Exposure on Response Quality

In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe (Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response task. On the other hand, we use a smaller text box which fits the response task. The other probes in the survey that use the standard text box are mainly category-selection probes that ask for a reasoning for the chosen answer value. Due to randomized rotation of questions, respondents receive different numbers of category-selection probes prior to the immigrant probe, resulting in different degrees of exposure to category-selection probing prior to the immigrant probe. For the immigrant probe, we find that respondents who receive the standard text box and who have had a high exposure to category-selection probing are more likely to provide mismatching answers: The mismatch consists of not answering the specific immigrant probe but rather providing a reasoning answer as typically expected for a category-selection probe. Thus, previous experience with probing in the questionnaire can override the actual probe wording. This problem can be minimized by considering possible carryover effects of prior probes and using an appropriate survey design strategy.

Comparing Cognitive Interviewing and Online Probing: Do They Find Similar Results?.

This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific national pride. While probing answers in CI show indications for a higher response quality, OP can compensate through a larger sample size. Therefore, both methods have complementary strengths with regard to error detection and themes.

Translating Answers to Open-ended Survey Questions in Cross-cultural Research A Case Study on the Interplay between Translation, Coding, and Analysis

Open-ended probing questions in cross-cultural surveys help uncover equivalence problems in cross-cultural survey research. For languages that a project team does not understand, probe answers need to be translated into a common project language. This article presents a case study on translating open-ended, that is, narrative answers. It describes how the translation can be approached to obtain high-quality translations and how translation, coding of answers, and analysis of codes are all deeply interwoven. While the translation of narrative answers is a small field of application, the article’s content is also relevant for those who are increasingly setting up cross-cultural cognitive interviewing or for qualitative researchers in general who pay increased attention to the translation of qualitative research data.

Assessing the use of back translation: the shortcomings of back translation as a quality testing method

Abstract Back translation – the ‘re-translation’ of a translated questionnaire back into the original language and the subsequent comparison of the original version and the back translation – is a controversial assessment method for questionnaire translations. Recently, cross-cultural survey methodologists have followed the call for more empirical research on this method. This article adds to the small body of research by drawing on the back translation documentation from the 2012 European Quality of Life Survey (EQLS). First, results from the official EQLS back translation step are contrasted with results when additional persons perform the same comparison step between back translation and original. We note inconsistency in the detection of presumed flaws. Second, the back translation outcome is contrasted with additional native speaker checks of the actual translation. While back translation can uncover problems, it causes quite a number of false alarms, and even more importantly, many problems remain hidden.

Translating questionnaires for cross-national surveys: A description of a genre and its particularities based on the ISO 17100 categorization of translator competences

This is an exploratory inquiry into signed language interpreters’ perceptions of interpreter e-professionalism on social media, specifically Facebook. Given the global pervasiveness of Facebook, this study presents an international perspective, and reports on findings of focus groups held with a total of 12 professional signed language interpreters from the United States of America, the United Kingdom, and Denmark, all of whom are also Facebook users. The findings reveal that Facebook is seen to blur the traditional boundaries between personal and professional realms – an overlap which is perceived to be compounded by the nature of the small community in which signed language interpreters typically work –necessitating boundary management strategies in order to maintain perceptions of professionalism on the site. Facebook is considered a valuable professional resource to leverage for networking, professional development, problem solving and assignment preparation, but it is also perceived as a potential professional liability for both individual interpreters and the profession at large. Maintaining client confidentiality was found to be the most pressing challenge Facebook brings to the profession. Educational measures to raise awareness about e-professionalism were generally viewed favourably.The study probes into translation students’ perception of the value of online peer feedback in improving translation skills. Students enrolled in a translation degree in Australia translated a 250-word text on two separate occasions. On each occasion, the students were given another fellow student’s translation of the same text to mark and provide anonymous peer feedback. The original translations from all the students, together with any peer feedback, were uploaded onto an online forum. The students were encouraged to download their own translation to review the peer feedback in it. They were also encouraged to download and peruse other students’ peer reviewed translations for comparison. Upon completion of the project, the students were surveyed about their perceptions and appreciation of their engagement in the process in the following three capacities: (i) as a feedback provider, (ii) as a feedback recipient, and (iii) as a peruser of other students’ work and the peer feedback therein. Results suggest that translation students appreciate online peer feedback as a valuable activity that facilitates improvement. The students found receiving peer feedback on their own translation especially rewarding, as it offered alternative approaches and perspectives on tackling linguistic/translation issues. In comparing the three capacities, students perceived reviewing feedback on their own work and perusing other students’ work as more beneficial than engaging in giving feedback to others.Title: Tarjamat al-khadamaat al-’aammah ( Community Interpreting and Translation) Author: Dr. Mustapha Taibi (University of Western Sydney) Year of publication: 2011 Publisher: Dar Assalam , Rabat (Morocco) ISBN: 978-9954-22-088-7 191 pagesAccent is known to cause comprehension difficulty, but empirical interpreting studies on its specific impact have been sporadic. According to Mazzetti (1999), an accent is composed of deviated phonemics and prosody, both discussed extensively in the TESL discipline. The current study seeks to examine, in the interpreting setting, the applicability of Anderson-Hsieh, Johnson and Koehlers (1992) finding that deviated prosody hinders comprehension more than problematic phonemics and syllable structure do. Thirty-seven graduate-level interpreting majors, assigned randomly to four groups, rendered four versions of a text read by the same speaker and then filled out a questionnaire while playing back their own renditions. Renditions were later rated for accuracy by two freelance interpreters, whereas the questionnaires analysed qualitatively. Results of analyses indicated that 1) both phonemics and prosody deteriorated comprehension, but prosody had a greater impact; 2) deviated North American English post-vowel /r/, intonation and rhythm were comprehension problem triggers. The finding may be of use to interpreting trainers, trainees and professionals by contributing to their knowledge of accent.The title Conference of the Tongues at first sight raises questions as to the particularities of its pertinence to translation studies, i.e. the range of possible subject matters subsumed, and is somewhat loosely explained in the preface by a short and factual hint to its historical origins (in sixteenth-century Spain in a paratext to a translation of Aesop). There is no further elaboration on the motivation for the choice of this title however.The market for translation services provided by individuals is currently characterized by significant uncertainty because buyers lack clear ways to identify qualified providers from amongst the total pool of translators. Certification and educational diplomas both serve to reduce the resulting information asymmetry, but both suffer from potential drawbacks: translator training programs are currently oversupplying the market with graduates who may lack the specific skills needed in the market and no certification program enjoys universal recognition. In addition, the two may be seen as competing means of establishing qualification. The resulting situation, in which potential clients are uncertain about which signal to trust, is known as a signal jam . In order to overcome this jam and provide more consistent signaling, translator-training programs and professional associations offering certification need to collaborate more closely to harmonize their requirements and deliver continuing professional development (CPD) that help align the outcomes from training and certification.Interpreting is rather like scuba diving. With just a bit of protective equipment, we interpreters plunge for a short time into an often alien world, where a mistake can be very serious, not only for ourselves but for the other divers who are depending on us to understand their surroundings. And as all who dive, we interpreters find this daily foray into a new environment fascinating, exhilarating, but also at times, challenging. One of the high-risk dive sites into which we venture often is the sea of healthcare, where the strange whale-song of medical dialogue, the often incomprehensible behavior of local denizens such as doctors, and the tricky currents of the healthcare system itself require special knowledge and skill to navigate successfully. Did you ever wish for a dive manual for unique world of healthcare? Well, here’s a good one, from linguist, RN and interpreter trainer, Dr. Ineke Crezee of New Zealand.Among all the difficulties inherent in interpreting, numbers stand out as a common and complex problem trigger. This experimental study contributes to research on the causes of errors in the passive simultaneous interpretation (SI) of numbers. Two groups of Italian Master’s degree students (one for English and one for German) were asked to interpret simultaneously a number-dense speech from their respective B language into their mother tongue, Italian. Note-taking was allowed during the test and both the study participants and their lecturers completed a questionnaire afterwards. Data analysis was conducted with statistical and qualitative methods, combining the cognitivist and contextualist approach. The objective was to ascertain whether one main variable may be held responsible for the high error rate related to interpreting numbers and the difficulty perceived by students in the task. The analysis quantifies the relative impact of different causes of difficulties on participants’ delivery of numbers. It stresses the crucial role of the subjective variable represented by interpreters’ skills. Didactic implications and directions for future research are discussed in the conclusion.