Survey Methodology #2003-17 - The American Community Survey (Acs) En Espanol: Using Cognitive Interviews To Test The Functional Equivalency Of Questionnaire Translations - U.s. Bureau Of The Census Page 51
ADVERTISEMENT
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52P40D
Did you receive any Social Security or Railroad Retirement benefits during the past 12 months?
¿Recibió usted algunos pagos por beneficio del seguro social o del retiro ferroviario por los
últimos 12 meses?
This question elicits a rapid response from respondents. However, only a few of them
interpreted “Social Security” as intended. Others reported not knowing what seguro social
meant. Because most people answer this question rapidly and because most people have an
(incorrect) interpretation of the term seguro social, questions such as these will not show high
rates of “don’t know,” refuse, or missing. Thus, the mathematical checks appear to be healthy on
the surface.
Cognitive testing confirmed that respondents either do not know what the term seguro social is,
or they are interpreting the term in a manner that is not consistent with the intent of the question.
These types of questions require special attention from bilingual personnel who are familiar with
linguistic and cultural nuances in order to identify terms that are used in other cultures, and that
certain terms may be interpreted in those different contexts.
Most respondents interpreted the term seguro social as public assistance in general or as health-
related benefits. This is understandable, since some Spanish-speaking countries use this term to
refer to their national welfare or public health care systems. For example, some respondents
reported being familiar with the Mexican “Instituto Mexicano del Seguro Social,” also knows as
“el Seguro” or “IMSS.” This “Seguro” is one of two major national health care systems that
operate a chain of hospitals and health-related services for workers whose employer pays a fee to
the IMSS. The “Seguro” offers health services (medical, dental, rehab and social services) at no
cost to workers and their dependents. Retired workers who were covered by the IMSS may keep
their coverage; and although this may be a retirement benefit, “el Seguro” does not always pay a
pension.
Although this question is grammatically correct, it is not collecting adequate data, since only a
few respondents interpreted the term in the desired context. It is clear that this question requires
testing alternative wording to alleviate this problem. One option is to keep the English name
“Social Security,” which may help respondents realize that the question asks about benefits in
the United States. Another option is to add a short explanation about what Social Security
payments include. This will steer respondents away from interpreting the concept in general
welfare or healthcare terms. A third alternative may be to test using a combination of both
suggestions. A comparative approach will help determine which wording is best understood as
intended.
Quantitative Summary:
Social Security
Correct meaning
17%
Don’t know
17%
Incorrect meaning
66%
(public assistance 33%; healthcare-related 33%)
I - 24
ADVERTISEMENT
0 votes
Related Articles
Related forms
Survey Methodology #2006-02 - Use Of Dependent Interviewing Procedures To Improve Data Quality In The Measurement Of Change - U.s. Census Bureau
Legal
Survey Methodology #2012-02 - New Relationship And Marital Questions: A Reflection Of Changes To The Social And Legal Recognition Of Same-sex Couples In The U.s. - U.s. Census Bureau
Legal
Related Categories
Parent category: Legal