Publication Type: Conference Paper/Unpublished Manuscript
Review Method: Peer Reviewed
Abstract: Social Scientists have long used a variety of unobtrusive methods in an attempt to measure implicit racial bias and avoid the reactivity of self-report methods. In written vignettes, test subjects are given identical descriptions in which the race of the person in the scenario is manipulated by a description in an effort to assess whether outcomes vary by the race of the person in the vignette. The researcher is then faced with the dilemma of how to make race salient enough to be noticed yet subtle enough so as to not call undue attention to the fact that race is what is being examined, in order to avoid social desirability effects.
To overcome this methodological problem, researchers have used images so that test subjects can concentrate on the task they are being asked to assess, while visually identifying the race of the person in the vignette. This method, however, is vulnerable to attractiveness bias/halo effects, and leaves open to question whether it is actually the race or the appearance of the person in the scenario that is being judged. When preferences are shown toward those who are more physically attractive research results may be called into serious question. What is needed is a method in which the appearance of the person(s) in the vignette can somehow be equalized.
For this session, I review the literature on attractiveness bias and halo effects and outline the potential shortcomings of most image-based vignettes and scenarios. I then demonstrate an emerging technology in which computer software is used to generate images that can be manipulated to appear either African American or Caucasian using identical facial features for each, thereby reducing or eliminating attractiveness bias and halo effects.

Publication Type: Conference Paper/Unpublished Manuscript
Abstract: Results from a recent web survey of young women that examines perceptions of discrimination in science classrooms are used to show the value of the vignette method for researchers using new technologies. The vignette findings suggest that a majority of young African American women see race and gender barriers in the science classroom. Although African American women see race as a more formidable barrier than gender, they are more likely than white women to see gender barriers as well. Results reveal advantages of the vignette method for gaining detail and control in the context of the social survey. It is argued that the combination of web survey technology and vignette methodology has considerable potential for providing substantive insights in social science research.

Supporting Publications:
Supporting Document

Publication Type: Paper/Poster Proposal
Abstract: There is evidence that Consumer Assessment of Health Plans (CAHPS) ratings vary by racial/ethnic group. It is not known whether this variation is attributable to differences in: expectations for the health care system; health care experiences; or the ways that respondents use offered response options. To learn more about the causes of these subgroup variations, we fielded a survey designed to test an approach to enhancing the cross-cultural comparability of CAHPS instruments that follows a model proposed by Gary King, Christopher Murray, et al. (2004)*.

The technique involves the use of "anchoring" vignettes that present hypothetical examples of health care at various levels of efficacy. Respondents are asked to assess the care presented in the hypothetical scenarios. They are also asked to use the same response choices presented for the vignette assessments to self-assess the domain of care described in the vignettes. The responses to the vignette items can be used to identify differential item functioning (DIF) at the sub group level. The innovators of this method offer both parametric and nonparmetric approaches to analysis.

We conducted a mail survey of parallel samples of Latino, African American, and non-Hispanic white Medicaid members. Sampled members each received a Canadian-style dual-language (English/Spanish) instrument that included core CAHPS items and the anchoring vignettes. Standard mail survey protocols were followed. A total of 368 questionnaires were completed, with more than 100 returns from each subgroup (RR=26% (RR1, AAPOR 2004)).

Analysis of the data collected will allow the identification and quantification of differences in the ways that different cultural groups use CAHPS response scales. In addition, we will have the tools to calibrate self-assessments to adjust for interpersonal differences in the use of the response scales.




*Enhancing the Validity and Cross-cultural Comparability of Measurement in Survey Research

Publication Type: Conference Paper/Unpublished Manuscript
Abstract: This study reveals—through the use of an experimental vignette study—the structure of voting behavior and the salience of race, class, and gender identities, and the complexities that emerge when the Voting Rights Act (VRA) is applied to rectify Latina/o underrepresentation. This is a study of Santa Paula, CA a city that was recently (1999-2002) part of a major debate about whether the VRA should be invoked to replace at-large voting with single-member districts for City Council elections on the argument that at-large voting fails to allow for adequate representation of Latino/a voters.
Although there is evidence of race voting, class is a good predictor of the strength of race voting. The higher a white voter’s class status, the less likely they are to vote for a Latino/a candidate. Whereas, Latino/as become increasingly likely to vote for a Latino/a candidate as their class status increases. If we expect Latino/as to follow the trend present in this data then ironically, as the Latino/a population becomes assimilated and climbs up the class ladder, its propensity to vote ethnically will also increase. Furthermore, gender and class cleavages are significant within the Latino electorate. This finding is significant in undermining the analogy of the Latino/a electorate as a monolithic sleeping giant.

Publication Type: Conference Paper/Unpublished Manuscript
Abstract: The factorial research design uses brief or “thumbnail” vignettes to examine various
dimensions that influence the social judgements of a respondent. Some recent studies that use a
factorial design provide a respondent with a vignette that includes contextual information. These
additional details may contribute to response validity. However, most studies that utilize detailed
vignettes are unable to provide more than a one vignettes to each respondent. This research
seeks to determine the reliability of a factorial research design that uses brief vignettes to
examine police officer judgement. If brief and detailed vignettes elicit similar responses, a
researcher can provide a respondent with several brief vignettes, thus increasing the sample size.