KEVOS
ArticlesServicesCase studiesAboutContact
ArticlesServicesCase studiesAboutContact
← ArticlesControlling Bias: Randomisation and BlindingProject Delivery · Research ProjectsLesson 196/216← PrevNext →
GuidePublished 16 Aug 202610 min readBy KEVOS Editorialselection biasrandomisationblindingrandom assignment
On this page

Ask about this page

KEVOS AIControlling Bias: Randomisation and Blinding

KEVOS knowledge first · trusted web sources when needed

KEVOS/Project Delivery/Research Projects/Week 8 Set Reading
Project DeliveryResearch ProjectsAdvancedQuantitative Research

Controlling Bias: Randomisation and Blinding

Random selection, random assignment and blinding are three different controls on three different biases. From the week's set reading — a published article in another discipline — comes the clearest account of each in the whole supplied dataset.

Reading time11 minutes
LevelAdvanced
Topic streamQuantitative Research
Source materialWeek 8 Set Reading
Updated2026-08-16

In brief

  • Three controls, three different jobs. Random selection protects who is in your study. Random assignment protects which group they land in. Blinding protects what they and you know about it.
  • A statistic is biased if its expected value across many samples is not the population value — a definition worth having, because it makes bias a property of the method rather than of one result.
  • The article names a compliance figure that journal editors in its field find acceptable. That number belongs to that field and is not a project research threshold.
  • Randomisation must balance the groups on variables that could modify the treatment effect — most importantly the pre-test value of the outcome itself.
  • Almost none of this survives into project research intact, because you rarely control assignment. Knowing which control you have lost tells you which claim you cannot make.

Where this comes from

From the source

The set reading, not the teaching material

This page draws on the published article on quantitative research design that the week sets as required reading, from a sport and exercise science journal.

The teaching material reproduces this part of the article verbatim in its own study notes without comment, so the content is inside the subject — but the words, the examples and every figure are the article's, and its discipline is not project management. Where a number appears below, it is marked with whose it is.

The teaching material's own treatment of bias is one slide on non-response, covered at non-response and sampling bias.

What bias actually is

From the source

The article's definition, quoted

"A statistic is biased if the value of the statistic tends to be wrong (or more precisely, if the expected value--the average value from many samples drawn using the same sampling method--is not the same as the population value.)"

That parenthesis is the most useful sentence about bias anywhere in the supplied dataset, and it is worth slowing down on. Bias is not a property of your result. It is a property of your method — of what would happen on average if you ran the same procedure many times.

Practice note

Why the distinction matters to you

It means you cannot inspect a single result and tell whether it is biased. A biased method can produce a result that happens to be right, and an unbiased method can produce a result that happens to be wrong.

So the defence against bias is entirely at design time, in the procedure. Once you have your data, the only honest move left is to describe the procedure accurately enough that a reader can judge the bias for themselves — which is what a methods chapter is for.

Control one — random selection, against selection bias

Selection bias arises when your sample is not representative of the population you want to talk about. The article's remedy is a random selection procedure, or a stratified random one where you need proportional representation of subgroups.

Source example — illustrative only

The article's own example of a bias source, and its figure

"A typical source of bias in population studies is age or socioeconomic status: people with extreme values for these variables tend not to take part in the studies. Thus a high compliance (the proportion of people contacted who end up as subjects) is important in avoiding bias."

The article then states that journal editors are usually happy with compliance rates of at least a stated percentage.

That figure is this article's report of editorial practice in sport and exercise science, around the year it was written. It is not a project research standard, not a threshold anyone must meet, and not a benchmark to judge your own response rate against. The library records it as the article's own and does not carry it forward as a rule. The supplied teaching material contains a different and unattributable return-rate figure, treated at questionnaires and response rates; the two are not comparable and neither is a benchmark.

Caution

The mechanism is what transfers, not the number

The transferable insight is the causal chain: people with extreme values on some variable decline to take part, so your sample is systematically missing them, so your estimate is systematically wrong.

In project research the extreme values are usually the interesting ones. The people who did not respond to your survey about project governance are disproportionately those on the projects that went worst — because they are busy, or because they would rather not discuss it. Your finding that governance was broadly adequate may be an artefact of who could spare the time to say so.

Control two — random assignment, against group bias

From the source

Quoted

"Failure to randomize subjects to control and treatment groups in experiments can also produce bias. If you let people select themselves into the groups, or if you select the groups in any way that makes one group different from another, then any result you get might reflect the group difference rather than an effect of the treatment."

This is a different bias from the first and a different remedy. Random selection decides who enters the study. Random assignment decides which group they land in once they are in. You can have one without the other, and the two protect different claims.

WHICH CONTROL PROTECTS WHICH CLAIM

ControlWhat it protectsWhat you lose without it
Random selection from the populationThat your sample resembles the populationThe right to generalise beyond the people you actually studied
Random assignment to groupsThat your groups differ only by the treatmentThe right to attribute a difference to the treatment rather than to the groups
BlindingThat knowledge of the treatment does not create the effectThe right to separate the treatment's effect from the expectation of one

The three-way separation is this library's arrangement of the article's material; the article treats them in sequence without tabulating them.

From the source

Balance, and the variable that matters most

The article requires assignment to be random in a way that ensures the groups are balanced on important variables that could modify the treatment effect. And then it names the one that usually matters most:

"Often the most important variable to balance is the pre-test value of the dependent variable itself."

That is a genuinely useful and slightly counter-intuitive point. If your groups start at different levels on the very thing you are measuring, no amount of randomisation elsewhere rescues the comparison. The article gives a rank-and-pair procedure for achieving near-perfect balance on a numeric variable — rank the subjects on it, split into pairs, and randomise within each pair.

Note

One practical point the article raises and most texts skip

"Human subjects may not be happy about being randomized, so you need to state clearly that it is a condition of taking part."

That is an ethics and recruitment point sitting inside a design section, and it is correct. People want the treatment they think will help them. If assignment is random, they must know before they consent — which connects this directly to voluntary participation and informed consent.

Control three — blinding

The third control addresses a bias the first two cannot touch: that knowing which treatment you received changes the outcome, for the subject and for the researcher measuring them. Blinding withholds that knowledge — from the subjects, from the researchers, or from both.

What blinding buys

SUBJECT

Expectation does not become effect

A subject who knows they received the intervention may improve because they expect to. Blinding them separates the treatment from the expectation of it.

RESEARCHER

Measurement does not drift

A researcher who knows which group they are assessing may score ambiguous cases in the direction they expect. Blinding the assessor removes the opportunity.

UNBLINDED

The magnitude becomes measurable

In an unblinded experiment, mechanism variables can help define how much of the effect was expectation rather than treatment — which is why the article recommends measuring them.

What survives into project research

Caution

Almost none of it intact — and that is the useful finding

You will rarely randomly assign projects, teams or organisations to a treatment. You cannot usually blind anyone to a change in governance or method. Most project research is descriptive, and the article is explicit that a descriptive study establishes only associations.

That does not make this material irrelevant. It makes it a diagnostic. Each control you cannot apply tells you exactly which claim you have forfeited:

- No random selection → do not generalise past the people you studied. - No random assignment → do not attribute the difference to the intervention. - No blinding → do not treat the reported improvement as separable from the expectation of one.

A methods chapter that names each missing control and the claim it withholds is stronger than one that quietly claims everything.

What you can still do

IfYou cannot randomly select but can define your population precisely
ThenDo that, and bound every claim to it. A precisely bounded claim about one sector is worth more than a vague one about industry.
IfYou cannot randomly assign but can measure the pre-existing differences
ThenMeasure them and report them. A reader can then judge how much of your difference the groups already carried.
IfYou cannot blind anyone
ThenSay so, and consider whether an outcome measure exists that expectation cannot move — a recorded date rather than a satisfaction rating.
IfYou have none of the three
ThenYou have a descriptive study. Report associations, decline to claim causes, and say why in the limitations. That is a defensible study, honestly described.

Getting it right

The bias section of your methods chapter

  • You have described the selection procedure precisely enough for a reader to judge its bias
  • Your response or participation rate is reported, with who is likely missing from it
  • If you have groups, you have said how people ended up in them
  • If assignment was not random, the pre-existing differences between groups are measured and reported
  • The pre-test value of your outcome variable is reported by group
  • Every control you could not apply is named, with the claim it withholds
  • No figure from another discipline is carried into your work as a threshold

What to carry forward

  1. Bias is a property of your method, not of your result. You cannot inspect one result and detect it, which is why the defence is entirely at design time.
  2. Random selection, random assignment and blinding protect three different claims. Losing one does not cost you the others.
  3. Where assignment is not random, balance on the pre-test value of the outcome matters more than balance on anything else.
  4. The compliance figure in the set reading is that article's report of editorial practice in its own field. It is not a threshold for your study.
  5. Name the controls you could not apply and the claims they withhold. That is stronger than a methods chapter that claims everything.

Frequently asked questions

What is the difference between random selection and random assignment?

Random selection decides who enters your study, and protects your right to generalise to the population. Random assignment decides which group they land in once inside, and protects your right to attribute a difference to the treatment. They are separate controls on separate biases and you can have either without the other.

Is the compliance rate in the set reading a target I should meet?

No. It is that article's report of what journal editors in sport and exercise science accepted around the time it was written. It is not a project research standard and the library does not carry it forward as a rule. The teaching material's own return-rate figure is unattributable and is not a benchmark either.

Why does the pre-test value of the outcome matter most for balance?

Because if your groups already differ on the very thing you are measuring, the difference at the end may be the difference they started with. Balance on other variables cannot rescue that comparison, which is why the article singles it out.

What can I do if I cannot randomise or blind anything?

Run a descriptive study, report associations rather than causes, and say so. Measure the pre-existing differences between whatever groups you have so a reader can judge them. A methods chapter that names each missing control and the claim it withholds is stronger than one that claims everything.

Do participants need to know assignment is random?

The article says so directly — people may not be happy about being randomised, so it must be stated clearly as a condition of taking part. That is a consent obligation as much as a design one.

References and source attribution

  1. Hopkins 2000, 'Quantitative Research Design', a sport and exercise science web journal, vol. 4, issue 1, approximately 4,318 words — the Week 8 set reading. Retained as a published bibliographic citation; the journal, the reviewer and all institutional affiliations are scrubbed per the library's naming rules.
  2. The supplied teaching source: weekly study notes, slide decks and assessment activities for a master's-level research methods subject in project management. Author, institution and year not stated in the supplied files.

Suggested questions for Ask KEVOS

  • What is the difference between selection bias and group bias?
  • How do I control bias when I cannot randomise anything?
  • Why is a statistic biased rather than a result?
  • What should I balance my groups on if I can only balance on one thing?
  • What claims do I lose without randomisation and blinding?

Related KEVOS knowledge

Descriptive and Experimental Study DesignsAdvanced · quantitative researchSample Size in Quantitative StudiesAdvanced · quantitative researchChoosing What to MeasureAdvanced · quantitative researchNon-Response and Sampling BiasCore · quantitative researchSampling Methods: The Six Named TypesCore · quantitative researchValidity and ReliabilityCore · research design
KEVOS® · Project Delivery · Research Projects Page KVS-PM-RES-0196 · v1.0.0 · content 2026.08 Last reviewed 2026-08-16

Continue learning

Choosing What to MeasureGuide · Research ProjectsNEXT LESSON →What Analysing Qualitative Data InvolvesGuide · Research ProjectsSample Size in Quantitative StudiesGuide · Research ProjectsThe Steps in Qualitative Data AnalysisGuide · Research Projects
KEVOS · Engineering, manufacturing and project improvement
ArticlesServicesCase studiesAboutContact
© 2026 KEVOS®