The Washington PostDemocracy Dies in Darkness

Pearson conducts experiment on thousands of college students without their knowledge

Pearson, the largest education company in the world, conducted a “social-psychological” experiment on thousands of college students in the United States — without asking for permission — by adding language into some of its software programs and then tracking how much the messages affected problem-solving.

The experiment and results were discussed by Pearson researchers, who unveiled a paper on the matter at this month’s 2018 convention of the American Educational Research Association in New York.

Student privacy advocates have long been concerned with education publishing companies using students as “guinea pigs.” Companies, including Pearson, have inserted draft questions into annual tests for possible future use. Students and their families do not know when and which questions are part of the company’s own research on question effectiveness.

Education Week reported on the paper, titled “Embedding Research-Inspired Innovations in EdTech: An RCT of Social-Psychological Interventions, at Scale.” Nearly 9,300 students at 165 college and universities were part of the experiment during spring 2017 when they used MyLab Programming, a Pearson software product employed in conjunction with a computer programming textbook. The publication said:

Without seeking prior consent from participating institutions or individuals, the company embedded “growth-mindset” and other psychological messaging into some versions of one of its commercial learning software programs. The company then randomly assigned different colleges to use different versions of that software, tracking whether students who received the messages attempted and completed more problems than their counterparts at other institutions.
The results included some modest signs that some such messaging can increase students’ persistence when they start a problem, then run into difficulty. That’s likely to bolster growth-mindset proponents, who say it’s important to encourage students to view intelligence as something that can change with practice and hard work.

Asked about the experiment, Pearson provided this statement:

In an effort to improve student success in higher education courseware, Pearson added in messages of encouragement after a student selected an incorrect answer in a digital quiz about programming. These included statements such as “The most successful programmers spend hours practicing their skills behind the scenes.” This change was phased in to allow the effect to be measured compared to no messaging following an incorrect answer.
Recent media coverage has mischaracterized a relatively minor product update by extracting technical language from the research that, when taken out of context, and paired with words like “experiment,” conveys a malicious intent.
As with any changes to a product, we evaluate the introduction of changes to determine if they require additional ethical or legal review or consultation. In this case, the introduction of feedback messages about how to improve student success, was determined to be a part of normal educational practice, as defined by the U.S. Department of Health and Human Services regulations.

Pearson has had financial troubles in recent years as standardized testing in the United States has changed. In 2016, it reported a multibillion dollar loss, the biggest in its history, and the 2017 annual report noted it had slashed its dividend to stockholders that year, saying: “We are still in the midst of a transformation and the environment in our largest business, U.S. higher education courseware, remains challenging.”