If i have a between subjects design with more than 2 treatment conditions i should use a test

  1. Experimental Design
  2. Within-Subjects Design

By Julia Simkus, published Feb 15, 2022


A within-subjects design, or a within-groups design, is one way that researchers can assign test participants to different treatment groups. In a within-subjects design, each participant experiences every condition of the independent variable.

Researchers test the same participants repeatedly across all treatments to assess for differences between the variables. Within-subjects designs do not have a control group as all participants are tested both before and after they are exposed to treatment.

This study design is coined “within-subjects” because conditions are compared within the same group of participants. A between-subjects design, on the other hand, is the opposite of a within-subjects design where the differences in conditions occur between the groups of subjects.

Using a within-subjects design

Within-subjects studies are typically used for longitudinal studies as researchers can assess changes within the same group of subjects over an extended period of time.

For example, assume a psychiatrist is looking for new medication to treat patients with Obsessive-Compulsive Disorder (OCD). She has four potential options of medications to help the patients with their OCD.

In order to determine which medication is going to be the most beneficial for her patients, she measures each child's performance four times, once after being on each of four drug doses for a week. Each subject’s performance is thus measured at each of the four levels of the factor, or dose.

Advantages

Does not require large subject pool

Within-subjects designs require smaller sample sizes as each participant provides repeated measures for each treatment condition. This also reduces the cost and resources necessary to conduct these studies.

A between subjects study, on the other hand, would require at least twice as many participants as a within-subject design. This also means twice the cost and resources.

No variation in individual differences

Since the same individuals participate in all conditions, there will be no effects from variations in individual differences between conditions.

Because individual variation is removed, this study design has little room for error, and researchers can easily detect any differences that exist among treatments.

Limitations

Time

Data collection can take a long time since each participant is given multiple treatments. In addition, it can be challenging to control the effects of time on the outcomes of the study. Between-subjects studies tend to have shorter sessions than within-subject ones.

Carryover effects

In within-subject designs, participants are exposed to several levels of the same independent variable. This prior exposure to a treatment condition could alter the outcomes of later treatment conditions.

For example, exposure to a reaction time test could make participants’ reactions times faster in a subsequent treatment due to familiarity with the study. Randomization and counterbalancing can help reduce these carryover effects.

Examples

  • Course of Cognitive Decline in Hematopoietic Stem Cell Transplantation: A Within-subjects Design (Friedman et al., 2009).
  • Beliefs, attitudes, and intentions toward nuclear energy before and after Chernobyl in a longitudinal within-subjects design (Verplanken, 1989).
  • A comparison of paper and online tests using a within-subjects design and propensity score matching study (Lottridge, Nicewander, & Mitzel, 2011).
  • A test of exercise analgesia using signal detection theory and a within-subjects design (Fuller and Robinson, 1993).
  • Reported jealousy differs as a function of menstrual cycle stage and contraceptive pill use: A within-subjects investigation (Cobey et al., 2012).
  • Behavioral effects of haloperidol in young autistic children: An objective analysis using a within-subjects reversal design (Cohen et al., 1980).
  • Tipping and service quality: A within-subjects analysis (Lynn and Sturman, 2010).

Frequently asked questions about within-subjects design

1. What's the difference between a Between-subjects versus within-subjects design?

Between-subjects and within-subjects designs are two different methods for researchers to assign test participants to different treatments.

In a between-subjects design, researchers will assign each subject to only one treatment condition; whereas in a within-subjects design, researchers will test the same participants repeatedly across all conditions.

Between-subjects and within-subjects designs can be used in place of each other, or in conjunction with each other.

Each of these types of experimental design has its own advantages and disadvantages, and it is usually up to the researchers to determine which method will be more beneficial for their study.

2. Can you use a between-subjects and within-subjects design in the same study?

Yes. Between-subjects and within-subjects designs can be combined in a single study when you have two or more independent variables (a factorial design).

Factorial designs are a type of experiment where multiple independent variables are tested. Each level of one independent variable (a factor) is combined with each level of every other independent variable to produce different conditions.

Each combination becomes a condition in the experiment. In a factorial experiment, the researcher has to decide for each independent variable whether to use a between-subjects design or a within-subjects design.

In a mixed factorial design, researchers will manipulate one independent variable between subjects and another within subjects.

About the Author

Julia Simkus is an undergraduate student at Princeton University, majoring in Psychology. She plans to pursue a PhD in Clinical Psychology upon graduation from Princeton in 2023. Julia has co-authored two journal articles, one titled “Substance Use Disorders and Behavioral Addictions During the COVID-19 Pandemic and COVID-19-Related Restrictions," which was published in Frontiers in Psychiatry in April 2021 and the other titled “Food Addiction: Latest Insights on the Clinical Implications," to be published in Handbook of Substance Misuse and Addictions: From Biology to Public Health in early 2022.

How to reference this article:

How to reference this article:

Simkus, J. (2022, Feb 15). Within-Subjects Design: Examples, Pros & Cons. Simply Psychology. www.simplypsychology.org/within-subjects-design.html

Sources

Allen, M. (2017). The sage encyclopedia of communication research methods (Vols. 1-4). Thousand Oaks, CA: SAGE Publications, Inc doi: 10.4135/9781483381411

Baeyens, F., Díaz, E., & Ruiz, G. (2005). Resistance to extinction of human evaluative conditioning using a between‐subjects design. Cognition & Emotion, 19(2), 245-268.

Birnbaum, M. H. (1999). How to show that 9> 221: Collect judgments in a between-subjects design. Psychological Methods, 4(3), 243.

Carey, A. A., Lester, T. G., & Valencia, R. M. (2016). The Effects of a Fatal Vision Goggles Intervention on Middle School Aged Children's Attitudes toward Drinking and Driving and Texting and Driving as Related to Impulsivity: A Between Subjects Design (Doctoral dissertation, Brenau University).

Chang, H. I., & Kang, W. C. (2018). The Impact of the 2018 North Korea-United States Summit on South Koreans’ Altruism Toward and Trust in North Korean Refugees: Between-Subjects Design Around the Summit. Available at SSRN 3270334.

Egele, V. S., Kiefer, L. H., & Stark, R. (2021). Faking self-reports of health behavior: a comparison between a within-and a between-subjects design. Health psychology and behavioral medicine, 9(1), 895-916.

Ehrlichman, H., Brown Kuhl, S., Zhu, J., & WRRENBURG, S. (1997). Startle reflex modulation by pleasant and unpleasant odors in a between‐subjects design. Psychophysiology, 34(6), 726-729.

Jhangiani, R. S., Chiang, I.-C. A., Cuttler, C., & Leighton, D. C. (2019, August 1). Experimental Design. Research Methods in Psychology. Retrieved from https://kpu.pressbooks.pub/psychmethods4e/

Home | About Us | Privacy Policy | Advertise | Contact Us

Simply Psychology's content is for informational and educational purposes only. Our website is not intended to be a substitute for professional medical advice, diagnosis, or treatment.

© Simply Scholar Ltd - All rights reserved

What test do you use for a between

“Between-subjects” tests are also known as “independent samples” tests, such as the independent samples t-test. “Independent samples” means that subsamples don't overlap: each observation belongs to only 1 subsample.

Which type of design uses two multiple groups for each condition?

Independent Measures: Independent measures design, also known as between-groups, is an experimental design where different participants are used in each condition of the independent variable. This means that each condition of the experiment includes a different group of participants.

When participants in an experiment all receive multiple different experimental conditions it is called a within

A within-subjects design is also called a dependent groups or repeated measures design because researchers compare related measures from the same participants between different conditions. All longitudinal studies use within-subjects designs to assess changes within the same individuals over time.

Can an experiment have multiple treatments?

In terms of independent and dependent variable designations, multiple treatment interference occurs when participants were meant to be assigned to one level of the independent variable (e.g., a certain group with a researcher assigned condition) but were functionally at a different level of the variable (e.g., they ...