Can Theory-Informed Message Framing Drive Honest and Motivated Performance with Better Assessment Experiences in a Remote Assessment?

Remote unproctored assessments increasingly use messaging interventions to reduce cheating, but existing approaches lack theoretical grounding, focus narrowly on cheating suppression while overlooking performance and experience, and treat cheating as binary rather than continuous. This study examines whether messages based on 15 psychological concepts from self-determination, cognitive dissonance, social norms, and self-efficacy theories can reduce cheating while preserving performance and experience. Through an expert workshop (N=5), we developed 45 theory-informed messages and tested them with online participants (N=1232) who completed an incentivized anagram task. Participants were classified as non-cheaters (0% items cheated), partial-cheaters (1-99% cheated), or full-cheaters (100% cheated). Results show that concept-based messages reduced full-cheating occurrence by 42% (33% to 19%), increased non-cheating by 19% (53% to 63%), with no negative effects on performance or experience across integrity groups. Surprisingly, messages grounded in different theoretical concepts produced virtually identical effects. Analyses of self-rated psychological mechanisms revealed that messages influenced multiple mechanisms simultaneously rather than their intended targets, though these mechanisms predicted behavior, performance, and experience. These findings show that causal pathways are more complex than current theories predict. Practically, integrity interventions using supportive motivation rather than rule enforcement can reduce cheating without impairing performance or experience.

💡 Research Summary

The paper addresses a pressing problem in remote, unproctored assessments: how to curb cheating without sacrificing test performance or the examinee’s experience. Existing message‑based interventions have been largely ad‑hoc, focused narrowly on deterrence, and treat cheating as a binary outcome. To overcome these limitations, the authors adopt a theory‑driven approach, drawing on four well‑established psychological frameworks—Self‑Determination Theory (SDT), Cognitive Dissonance Theory, Social Norms Theory, and Self‑Efficacy Theory. From these frameworks they extract fifteen distinct concepts (e.g., autonomy, competence, relatedness, self‑concept consistency, dissonance reduction, mastery experience, descriptive norms, injunctive norms, etc.).

Through an expert workshop involving five scholars, each concept is translated into three concrete, positively framed messages, yielding a total of forty‑five “motivational” messages. Importantly, the messages are designed to support autonomy, competence, and relatedness rather than to threaten or monitor, and they avoid explicit references to cheating.

A large‑scale between‑subjects experiment (N = 1,232) randomly assigns participants to receive one of the 45 messages or a no‑message control while they complete a timed, reward‑based anagram task. Cheating is operationalized as the proportion of items for which participants request external help, allowing classification into non‑cheaters (0 % cheated), partial‑cheaters (1‑99 % cheated), and full‑cheaters (100 % cheated). Performance is measured by the number of correct anagrams and completion speed; experience is captured via self‑report scales of stress, satisfaction, and engagement.

Key findings: (1) Across all message conditions, the incidence of full‑cheating drops from 33 % to 19 %—a 42 % reduction—while the proportion of non‑cheaters rises from 53 % to 63 % (+19 %). (2) No detrimental effects on performance or experience are observed for any integrity group; partial‑cheaters do not suffer slower completion or lower scores. (3) Contrary to expectations, the effect size does not differ meaningfully across the four theoretical families; messages grounded in SDT, dissonance, norms, or self‑efficacy produce virtually identical outcomes.

Post‑experiment questionnaires reveal that participants perceive multiple psychological mechanisms being activated by a single message, not just the intended one. For example, an autonomy‑focused message also boosts perceived competence and relatedness. Mediation analyses using structural equation modeling show that these overlapping mechanisms jointly predict reductions in cheating, maintenance of performance, and enhanced experience. This suggests that real‑world behavior change is driven by a complex, interactive network of motives rather than a single linear pathway posited by any one theory.

The authors argue that “supportive motivation” messages—those that affirm autonomy, competence, and social connection—constitute a low‑cost, privacy‑preserving alternative to invasive remote proctoring. By framing the assessment as an opportunity for personal growth rather than a monitored test, institutions can simultaneously protect integrity and preserve (or even improve) learner outcomes.

The study also contributes methodologically: it treats cheating as a continuous spectrum, acknowledges distinct cheater profiles, and demonstrates that a single, theory‑informed message set can be effective across these profiles. The findings call for future research to explore multi‑mechanism models of behavior change and to develop tailored messages for specific cheater sub‑groups.

In sum, the paper provides robust empirical evidence that theory‑informed, positively framed messages can dramatically reduce cheating in remote assessments without harming performance or user experience, and that the underlying causal pathways are more intricate than previously assumed. This work bridges a gap between behavioral theory and practical assessment design, offering a scalable, ethically sound tool for educators and institutions worldwide.