KEVOS
ArticlesServicesCase studiesAboutContact
ArticlesServicesCase studiesAboutContact
← ArticlesThe Discussion GuidelinesProject Delivery · Research ProjectsLesson 208/216← PrevNext →
GuidePublished 16 Aug 202611 min readBy KEVOS Editorialdiscussion guidelinesstatistical significancelimitationsgeneralisability
On this page

Ask about this page

KEVOS AIThe Discussion Guidelines

KEVOS knowledge first · trusted web sources when needed

KEVOS/Project Delivery/Research Projects/Presenting and Discussing Results
Project DeliveryResearch ProjectsCoreReporting Results

The Discussion Guidelines

Five numbered guidelines, to be addressed in order. One is a bare label, one is quantitative and undefined, one contradicts its own deck — and one is the most transferable passage in the whole week.

Reading time12 minutes
LevelCore
Topic streamReporting Results
Source materialPresenting and Discussing Results
Updated2026-08-16

In brief

  • Five guidelines, numbered by the source, to be addressed in the order given.
  • Guideline 1 is one line with nothing under it, and the term it turns on is never defined anywhere in six weeks.
  • Guideline 2 asks you to discuss statistical significance and never shows you how to determine it — no threshold, no test, no procedure, in either week that raises the subject.
  • Guideline 3 is three sentences and is the strongest, most transferable content in the week.
  • Guideline 5 contradicts an earlier slide in its own deck, and any generalisability claim you make has to reckon with both.

The five, as the source gives them

THE GUIDELINES AND WHAT SITS UNDER EACH

#GuidelineSub-points supplied
1Discuss the implications of the primary analyses firstNone
2Discuss statistical significanceA definition and three parameters
3Discuss any weaknesses and strengths in your research design, or problems with data collection, analysis, or interpretationTwo
4Discuss the results in the context of the published literatureTwo
5Discuss the generalizability of the resultsTwo

The numbering is the source's own — the deck auto-numbers the items across three slides. The guideline wording is quoted.

Guideline 1 — implications of the primary analyses

Source gap

The first of five guidelines is a bare label

It is a single line with no sub-points, and "primary analyses" is never defined anywhere in the supplied source. The term recurs once by contrast, on the conclusions slide — "results of secondary or post hoc analyses should be presented as explanatory" — and neither primary, secondary nor post hoc analysis is defined there either.

The library will not supply a definition the source does not have. What can be said is what the contrast implies: a primary analysis is one your design was built to perform, and a secondary or post hoc analysis is one you ran after seeing the data. That reading is inferred from the contrast, not stated.

The instruction itself is sound whatever the term means: take the analyses your study was designed around before you take anything else. It stops a discussion opening on an incidental finding that happened to be interesting, which is a common failure and an expensive one — the reader forms their impression of what your study was about from your first two pages.

Guideline 2 — statistical significance

From the source

Quoted in full

"Statistical significance relates to how likely the observed effect is due to chance (i.e. sampling variation)."

"Statistical significance depends on three parameters:" - "Sample size (the larger the sample size, the easier to demonstrate statistical significance)" - "Variability in participant response, either by chance or by non-random factors (the smaller the variability, the easier to demonstrate statistical significance)" - "Effect size, or the magnitude of the observed effect between group (the greater the size of the effect, the easier to demonstrate statistical significance)"

The three parameters are correct and the relationships stated for each are correct, and it is worth having them in one place: significance is easier to demonstrate with a bigger sample, less noise, or a bigger effect. That much is genuinely useful, and it explains why a real effect can fail to reach significance in a small study.

Source gap

You are told twice, in two weeks, to discuss significance and never shown how to determine it

The supplied source names no threshold, no p-value, no alpha and no test — not in this week and not in the quantitative analysis week, which defines statistical significance differently again as "unlikely to have happened by chance". No inferential procedure of any kind is named anywhere in either week.

The three parameters compound it. Sample size is used here and no sampling procedure is taught. Variability is named across two weeks and no measure of dispersion appears anywhere. Effect size gets the only definition it has in six weeks — "the magnitude of the observed effect between group" — which is also the only place the term appears.

This library will not fill any of that in. If your study is quantitative and you intend to make a claim about significance, you need a statistics text, and you need it before you collect data rather than after.

Caution

Two definitions, and they are not the same claim

The quantitative week defines statistical significance as an event being "unlikely to have happened by chance". This week defines it as "how likely the observed effect is due to chance".

The first is a statement about a result; the second is a quantity. Read literally, the second says significance is the probability — which is closer to what a p-value measures and further from what significance means. Both are given here and the library does not adjudicate between them.

Guideline 3 — weaknesses and strengths

From the source

Quoted in full — three sentences

"Discuss any weaknesses and strengths in your research design or problems with data collection, analysis, or interpretation."

"Disclosure of weaknesses or limitations is often difficult; however, honesty is the cornerstone of research."

"Discussing them gives you an opportunity to defend them and/or recommend ways to overcome them when others attempt to answer similar questions."

This is the strongest passage in the week and one of the strongest in the whole supplied source, and it earns that in three sentences by doing something the rest of the material rarely does: it acknowledges that the instruction is psychologically hard, and then gives a self-interested reason to follow it anyway.

What the three sentences actually establish

SCOPE

Four places a weakness can live

The research design itself, data collection, analysis, and interpretation. Most limitation sections cover only the first and the second. The third and fourth are where the more serious problems usually sit.

HONESTY

Disclosure is difficult and required anyway

The source names the difficulty rather than pretending it away, which is unusual and worth noticing. A limitations section that cost you nothing to write probably omits the real one.

INCENTIVE

It is an opportunity, not a confession

Discussing a weakness lets you defend it — to show you knew, and chose, and why — and lets you recommend how someone else would avoid it. The second of those is a contribution in its own right.

Source gap

The best passage in the week is unillustrated

No list of typical weaknesses, no worked limitation paragraph and no template is given. Three sentences of excellent principle and nothing to copy.

The library's stating limitations and contribution supplies what this does not, from observed practice: every examined work states its limitations, in four different places and at four different lengths, and contribution claims can quietly contradict the limitations stated a page earlier.

Guideline 4 — the published literature

From the source

Quoted in full

"Describe the similarities and differences of your work with that of other authors who have done similar studies. Make an attempt to explain why your findings may be similar and why they may be different."

"Do not review the whole body of literature on this topic. Brevity is important; be selective in the studies you choose to review."

The instruction to attempt an explanation of the difference is the part that matters. Reporting that your findings differ from a published study is a fact; saying why — a different population, a different instrument, a decade between them, a different definition of the same construct — is the analysis. Most discussion chapters stop at the fact.

Reading a difference against the literature

IfThe other study used a different population
ThenThe difference may be real and bounded. Say what about your population you think produced it.
IfThe other study measured the same construct with a different instrument
ThenYou may not be comparing the same thing. Say so plainly rather than treating it as a substantive disagreement.
IfThe other study is materially older
ThenThe world may have changed. That is itself a finding, and it is usually more interesting than agreement.
IfYou can find no candidate explanation
ThenSay that too. An unexplained difference honestly flagged is better than a manufactured reason, and it is a legitimate direction for further work.
Note

This restates something the same week already said, twenty slides earlier

One of the ten questions the week's own analysis diagram asks is: "Are the findings in agreement with findings from other studies? If not, can this be explained?"

That is guideline 4, arrived at from the analysis side rather than the writing side, in a different document, with neither referring to the other. It is the only cross-document continuity in the week and it is worth reading the two together — see ten questions to ask of your data.

Source gap

Where the literature review does belong is not stated

Guideline 4 forbids reviewing the whole body of literature in the discussion, and no slide in this week mentions a literature review at all. The material never says where the review lives or how the discussion's selective comparison relates to it.

The library's literature review stream comes from a different week and answers this: the review establishes the gap, and the discussion returns to the specific works your findings speak to.

Guideline 5 — generalisability, and the contradiction

From the source

Quoted in full

"The purpose of your study is to produce results your field can apply."

"The ability to generalize your findings is dependent on your study population, its inclusion and exclusion criteria, and other factors such as your follow-up rate."

Source gap

This contradicts slide 5 of its own deck

Five slides into the same week, qualitative analysis is characterised as "careful about the possibility or meaningfulness of generalisations across time and space" and as emphasising transferability to new settings instead.

Guideline 5 then states flatly that the purpose of your study is to produce results your field can apply, and makes generalisability depend on study population, inclusion and exclusion criteria and follow-up rate — none of which is defined anywhere in the supplied source, and all of which is clinical-trial vocabulary with no obvious qualitative reading.

One deck, one week, two incompatible positions on whether generalising is the point. Both are given here. The library does not choose between them, and any generalisability claim you write has to reckon with both.

If you take the transferability position

  • Describe your setting richly enough that a reader can judge the fit to theirs
  • The reader decides what transfers, not you
  • Bound your claim to the case you studied
  • This is the position the same deck takes about qualitative work

If you take the generalisability position

  • State the population your sample was drawn from
  • State who was included and who was excluded, and why
  • State your response or follow-up rate and what it does to the claim
  • This is the position this guideline takes

Using the five without inheriting their problems

A pass over your discussion

  • You have taken the analyses your design was built for before any incidental finding
  • Any significance claim rests on a procedure from a source outside this material, named in your methodology
  • Limitations cover all four places the source names: design, collection, analysis, interpretation
  • For each limitation you have said what you would do differently — turning it into a recommendation
  • The literature comparison names specific studies and attempts to explain each difference
  • Your generalisability claim states which position you are taking and is bounded accordingly
  • You have not re-reviewed the field

What to carry forward

  1. Take the analyses your design was built for first. The reader decides what your study was about from your opening pages.
  2. You are told twice in two weeks to discuss statistical significance and never shown how to determine it. Get that from a statistics text, before you collect data.
  3. Guideline 3 is three sentences and the best content in the week: weaknesses live in design, collection, analysis and interpretation, and disclosing one lets you defend it and recommend around it.
  4. Explaining why your findings differ from published work is the analysis. Reporting that they differ is only the fact.
  5. The generalisability guideline contradicts its own deck. Decide which position you are taking, say so, and bound the claim to match.

Frequently asked questions

What is a primary analysis?

The supplied source never defines it, in this week or any other. Its only contrast is with 'secondary or post hoc analyses' on the conclusions slide, which suggests a primary analysis is one your design was built to perform. That reading is inferred from the contrast, not stated by the source.

How do I determine statistical significance?

Not from this material. Across the two weeks that raise the subject, no threshold, p-value, alpha, test or inferential procedure is named anywhere. The three parameters given — sample size, variability, effect size — are correct as far as they go, and none of the three is defined or measurable from what is supplied.

Where should limitations go — discussion or conclusion?

This guideline places them in the discussion. Observed practice in examined theses puts them in four different places at four different lengths, which the library covers at stating limitations and contribution. What matters more than placement is that they appear before someone else supplies them.

Should a qualitative study claim generalisability at all?

The material takes both positions in one deck: an early slide describes qualitative work as emphasising transferability rather than generalisation, and this guideline states that the purpose of your study is to produce results your field can apply. Choose a position, name it, and bound your claim to it.

How much literature belongs in the discussion?

The source says to be selective and not to review the whole body of literature on the topic. The working principle is that the discussion returns only to the specific works your findings actually speak to — the survey of the field belongs in the literature review chapter.

References and source attribution

  1. The supplied teaching source: weekly study notes, slide decks and assessment activities for a master's-level research methods subject in project management. Author, institution and year not stated in the supplied files.

Suggested questions for Ask KEVOS

  • What are the five discussion guidelines and what does each require?
  • How do I discuss statistical significance if my source never defines a threshold?
  • How should I write a limitations section that helps rather than damages my study?
  • How do I explain why my findings differ from published research?
  • Should a qualitative study claim generalisability or transferability?

Related KEVOS knowledge

Writing the Discussion SectionCore · reporting resultsDrawing Conclusions From Your ResultsCore · reporting resultsStating Limitations and ContributionCore · research exemplarsWriting the Results SectionCore · reporting resultsDescriptive and Inferential StatisticsCore · quantitative analysisTen Questions to Ask of Your DataCore · qualitative analysis
KEVOS® · Project Delivery · Research Projects Page KVS-PM-RES-0208 · v1.0.0 · content 2026.08 Last reviewed 2026-08-16

Continue learning

Writing the Discussion SectionGuide · Research ProjectsNEXT LESSON →Drawing Conclusions From Your ResultsGuide · Research ProjectsPresenting Tables, Figures and AppendicesGuide · Research ProjectsA Thesis Completion Procedure, DocumentedGuide · Research Projects
KEVOS · Engineering, manufacturing and project improvement
ArticlesServicesCase studiesAboutContact
© 2026 KEVOS®