Survey Methodology #2003-17 - The American Community Survey (Acs) En Espanol: Using Cognitive Interviews To Test The Functional Equivalency Of Questionnaire Translations - U.s. Bureau Of The Census Page 23

ADVERTISEMENT

DISCUSSION
Results from this study reveal functional equivalence is key to accurate data collection in a
bilingual or multilingual setting. As measurement instruments, questionnaire translations require
pre-testing to ensure they yield valid and reliable data. Qualitative pre-testing can show which
questions present respondents with trouble interpreting the intent of the question, correctly
understanding key survey concepts, misinterpreting key terms, and challenges matching the
respondent’s answer onto pre-coded response categories. Results from qualitative pre-testing
may be effectively used to find wording in the target language that is functionally equivalent to
the source language. The systematic approach used throughout this research shows an effective
way to improve the quality of data obtained in foreign languages as well as data obtained from
respondents with limited English proficiency is to apply known pre-testing methodologies, such
as cognitive interviews, to questionnaire translations before they are fielded.
In terms of linguistic challenges, it is likely the types of challenges discussed herein might not be
evident to the translator, and may become evident only after testing. This may be due to the fact
a question itself may be an appropriate translation, yet may not be acceptable as a construct
measure. For this reason, questionnaire translations must be assessed both as translations and
measurement instruments. It may not always be possible to have a translator who is trained in
survey methods, or a survey methodologist who is bilingual, but the two types of assessments are
needed. Regardless of the techniques that are used to translate questionnaires, pre-testing is
essential to identifying and remedying linguistic and design challenges that could result in
response error.
17

ADVERTISEMENT

00 votes

Related Articles

Related forms

Related Categories

Parent category: Legal