KEVOS
ArticlesServicesCase studiesAboutContact
ArticlesServicesCase studiesAboutContact
← ArticlesWhat This Material Does Not TeachProject Delivery · Research ProjectsLesson 184/216← PrevNext →
GuidePublished 16 Aug 202616 min readBy KEVOS Editorialresearch methods gapslearning objectivesteaching material limitationsresearch design
On this page

Ask about this page

KEVOS AIWhat This Material Does Not Teach

KEVOS knowledge first · trusted web sources when needed

KEVOS/Project Delivery/Research Projects/Synthesis
Project DeliveryResearch ProjectsCoreResearch Practice

What This Material Does Not Teach

A candid handover note. Across six weeks of the supplied teaching source, fourteen learning objectives are stated and not one is fully delivered. Here is what you get, what you do not, and which absences belong to the files rather than to the subject.

Reading time18 minutes
LevelCore
Topic streamResearch Practice
Source materialSynthesis
Updated2026-08-16

In brief

  • Fourteen learning objectives are stated across the six weeks now on record. None is fully delivered. Four are partly delivered. Ten are not delivered at all.
  • The dominant failure mode is a list of labels standing in for the treatment an objective promises — ten methods named and none compared, six collection techniques named and three taught in a sentence each.
  • Four files listed in the upload manifest were absent from disk. Week 11 is the only week in the subject with no study notes, and it is the week carrying the entire quantitative content.
  • Some of this material is good. The questionnaire and question-wording guidance, the qualitative strengths-and-limitations treatment and the table construction rules are all worth your time.
  • Read the distinction between a gap in the supplied files and a gap in the subject as taught. They are not the same thing and this page keeps them apart.

Why a page like this exists

A knowledge library that only reports what a source contains is quietly dishonest, because a reader cannot tell the difference between a topic the source covered well and a topic it named once and abandoned. Both look the same on the page. You would build a research design on the second one and discover the problem at the point where it costs you the most — after you have collected data you cannot analyse, or committed to a method you cannot justify.

So this page states the shortfalls plainly. It is not a review of the teaching and it is not a complaint. It is the note you would want from a colleague handing over a body of material: here is what this gives you, here is what it does not, and here is what you must go and get elsewhere before you rely on it.

Note

Scope of this audit

This page covers the four weeks treated in this part of the library: research design, the nature of qualitative research, gathering your data, and quantitative analysis and presentation. Earlier weeks — the introduction to research methods, developing a topic, the literature review, ethics and the research proposal — are audited on their own pages and are, on the whole, in better condition than the four assessed here.

The objective audit

Each week states its learning objectives on its opening slides. Those statements are the source's own commitment, so they are the fairest standard to assess it against — not an external syllabus, not a comparison with another course. The question asked here is only this: could a reader who worked through the week do the thing the week said they would be able to do?

14objectives stated across six weeks
0fully delivered
4partly delivered
10not delivered

OBJECTIVE DELIVERY BY WEEK

WeekStatedDeliveredPartlyNot delivered
Research design3012
The nature of quantitative research3012
The nature of qualitative research2002
Gathering your data1001
Quantitative analysis and presentation3012
Analysing qualitative data and results2011
Total140410

Assessed against each week's own stated objectives, quoted from its opening slides. Updated when two further weeks were supplied; the earlier four-week figure of nine objectives is superseded.

From the source

What the two partial deliveries actually amount to

The research design week promises you will create a methodology appropriate to your proposal. You are given the decision criteria — four inputs, two process requirements, three capability tests, nine selection questions — and not the options the criteria apply to: the catalogue of methodologies is deferred to an earlier topic and none of the seven is described. You are told to justify your choice and given no template, example, structure or criteria for the justification.

The quantitative week promises you will plan presentation styles. You get seven table rules, three graph principles, one formula and a four-aspect reading procedure — and not one worked table, not one surviving chart image, and no rule for choosing between display types.

The pattern: a list of labels where a treatment was promised

Seven undelivered objectives across four weeks is not seven unrelated oversights. The same failure recurs, and recognising it is more useful than memorising the individual cases, because it tells you what to check for when you meet a new week of material.

In each case a set of things is named — correctly, and often comprehensively — and then nothing is said about any of them. The naming reads as coverage. It is not coverage, and the test that separates the two is simple: could you act on it?

THE SAME FAILURE, FOUR TIMES

Objective promisedWhat is suppliedWhat is missing
Compare types of methodsA grid of ten method namesNo comparison of any two on any dimension. The only comparison performed in the week is between the two paradigms, which is a comparison of approaches, not of methods.
Determine benefits and disadvantages of typesThree benefits and three issues, attached to triangulationNo benefit and no disadvantage for any of the ten methods or any of the seven methodologies. The one benefits-and-drawbacks structure in the week belongs to a mixed-methods rationale and is never linked back to the catalogue.
Design appropriate research toolsFive methods described — what each one isNo interview guide, schedule, protocol, question set, observation schedule, field-note format, coding frame or extraction template is shown or specified anywhere. Field notes are named four times and never defined.
Evaluate methods of data collectionQuestionnaires and surveys in real detailSampling, observations and focus groups get roughly one sentence each. No two methods are ever compared on any criterion — so the objective's verb, evaluate, has nothing to operate on.
Caution

The test to apply

When a week names a set of things, ask what you could do with the naming. If the answer is only that you could repeat the list, the topic has been named and not taught, however complete the list looks. The library page The Method Catalogue is built entirely around one instance of this, because the absence is the whole finding.

Two objectives that appear to belong to a different week

The qualitative research week is the clearest case in the material of a mismatch between what was promised and what was delivered — and it is worth separating from the others, because it looks like a documentation error rather than a teaching shortfall.

Its two stated objectives are to design appropriate research tools and to evaluate types of variables. The week delivered is a conceptual survey of qualitative inquiry: what the approach is, what its practitioners believe, what it is good at and bad at, and how its quality is judged. The word variables occurs exactly once in the entire week, inside a quoted table, in the column describing quantitative research. No type of variable is named, defined, classified or exemplified.

Source gap

A mismatch, not a failure of effort

A week whose own deck states that qualitative concepts take the form of themes, motifs, generalisations and taxonomies rather than variables cannot deliver an objective about evaluating variable types. The two objectives read like the objectives of an instrument-design and measurement topic. The week's own introduction describes its aim in entirely different terms again — gaining a deep understanding of people, places, cultures and contexts — which matches neither stated objective.

The practical consequence for you: judge this week by what it delivers, which is a solid conceptual survey, and do not go looking for tool design in it. Variables are covered in the data-gathering week instead, at Independent and Dependent Variables.

The missing files, and why the distinction matters

Four files appear in the upload manifest and are not present on disk. They could not be read, and nothing in this library is based on them.

  1. A third submission document under the assignment 3 filename. Two were supplied; a third is listed and absent, so the assignment set is incomplete and it is unknown which task the third answered.
  2. A document titled "Gathering your data — Quantitative data analysis". Its title matches the naming pattern of the data-gathering week's notes, which suggests it was that week's missing counterpart.
  3. The quantitative analysis week's study notes, in one document format.
  4. The same study notes, in a second format.

WHAT WAS SUPPLIED, BY WEEK

WeekStudy notesSlides
Research designYes — one fileYes
The nature of qualitative researchYes — two files, identical textYes
Gathering your dataYes — two files, identical textYes
Quantitative analysis and presentationNoneYes
Source gap

This is the load-bearing distinction on this page

In the three weeks where both were supplied, the notes carry the definitional and conceptual material and the slides carry lists, checklists and activities. The quantitative week's slides therefore stand alone in a role they were never built for — and the definitional gaps recorded across that week are exactly the gaps you would expect when the definitional document is the one that is missing.

So: every quantitative-analysis gap this library records is a gap in the supplied material. It is not evidence about the subject as taught. The missing notes may well have contained the definitions. The library has no basis for supplying them, and no basis for asserting they were never given.

That distinction is applied consistently. Where a page says the supplied teaching source does not define a term, that statement is accurate and checkable. You will not find a page saying the subject never taught it, because nothing in the files supports that claim.

The quantitative week in particular

It is worth stating the quantitative position concretely, because it is the week where a reader is most likely to assume the material is sufficient and proceed on it.

QUANTITATIVE VOCABULARY: WHAT THE SLIDES DO AND DO NOT SUPPLY

CategoryPosition
Terms definedAround twenty-two, including the three measures of central tendency, descriptive and inferential statistics, frequency distribution, skew, distribution and parameter.
Terms used but never definedAt least twenty-one — none of them defined anywhere in the week. Standard deviation is used four times and defined nowhere.
FormulaeOne — the histogram class rule. No other statistic is given a formula.
Statistics computedNone. No statistic is calculated anywhere in the week, on any data.
Measures of dispersionNone named. Range, variance, interquartile range and standard deviation do not appear as measures.
Inferential proceduresNone named. No hypothesis test, no p-value, no confidence interval, no named test of any kind.
Caution

The sharpest single consequence

The week's one quantitative rule — the proportions of a normal distribution falling within one, two and three standard deviations of the mean — is expressed entirely in a unit the week never defines. You cannot apply the only rule you are given. That is not a criticism to dwell on; it is a fact to plan around, and the page The Normal Model and the 68-95-99.7 Rule states exactly what a second source has to supply before the rule becomes usable.

The same shape recurs at Variation and Spread: spread is declared one of the key features of every distribution, and no measure of it is named anywhere in a week devoted to quantitative analysis.

What this material does well

A page of this kind is unfair if it stops at the shortfalls, and it would also mislead you about where to spend your time. Several parts of these four weeks are genuinely useful and are the reason the streams exist at all.

Worth your time

STRONGEST

Questionnaire design and question wording

The most concrete, most actionable guidance anywhere in the supplied material. Nine design questions, six design points, question types, response formats and a set of named wording faults — enough to write a usable instrument and to review someone else's.

STRONG

The six qualitative collection approaches

The fullest data collection treatment in the source. Each approach gets a definitional sentence and a set of implications, which is more than any of the ten catalogued methods receives.

STRONG

Table construction rules

Seven rules across two slides plus a typology by number of variables. Concrete, applicable, and the best-delivered part of the quantitative week.

USEFUL

Qualitative strengths, limitations and validity criteria

The study notes give ten strengths, a limitations treatment, and a set of alternative quality criteria to replace validity and reliability. Enough to write a defensible methodology chapter.

USEFUL

The method selection questions

Nine questions and five dependencies for choosing a method. They give you a real procedure, even though the options the procedure selects between are not described.

USEFUL

Interview conduct

A substantial set of instructions on preparing for and conducting an interview — skills, obligations and the encounter itself. Weaker on recording and transcription, and no schedule is ever shown.

What to do about it

The absences are not evenly urgent. Some you can work around; some you must close before you collect data; one or two you can leave until write-up. This ordering is this library's judgement, not a statement from the source.

Triage

IfYou are about to design a quantitative instrument or analyse quantitative results
ThenClose the statistics gap first, and close it properly. You need measures of dispersion, at least one inferential procedure appropriate to your design, and the relationship between level of measurement and permissible analysis. None of it is here.
IfYou are choosing between data collection methods
ThenThe comparison you need does not exist in this material. Use the selection questions as your framework, then get the properties of each candidate method — cost, time, response behaviour, data quality, suitability — from a methods text.
IfYou need to build an interview guide, observation schedule or coding frame
ThenNo instrument of any kind is displayed anywhere in four weeks. Find worked examples elsewhere; the library's exemplar stream shows real instruments in appendices of examined theses, which is the nearest substitute available.
IfYou are planning sampling
ThenTreat this material as supplying nothing. One sentence recommends random selection and immediately withdraws it as usually impossible. There is no frame, no technique, no size guidance.
IfYou are writing a methodology chapter
ThenYou are in reasonable shape. The design, philosophy and qualitative streams give you a defensible structure; the earlier weeks of the subject cover paradigm, ethics and proposal conventions in better condition than these four.
Practice note

One habit worth forming

The source does not prescribe this. When you meet any teaching material, read its stated objectives first and treat them as a checklist you tick off at the end rather than as a description of what is inside. It takes two minutes and it is the single cheapest way to find out whether what you have read is what you were promised — before you rely on it rather than after.

Two further notes on completeness

First, a sequencing gap that has since closed. The weeks supplied to this library originally ran 1 to 7, then 9, 10 and 11, with no week 8 material in any of the first five deliveries — while several items in later weeks referred back to concepts that would plausibly have sat there. That week has since been supplied in full, and it turned out to be the week that teaches sampling — which had been the library's largest recorded gap. It is treated in the quantitative research stream, and the consolidated audit is at the six-week objective audit. Nothing in this library speculated about its contents while it was absent, which is why nothing had to be retracted when it arrived.

Second, the assignments. No assignment brief document exists anywhere in the supplied material. Every brief the library reconstructs is inferred from weekly activity slides and is labelled as an inference. One assignment is specified once, on the last slide of a later week, after the weeks it covers have passed; the other is never specified at all — no composition, no length, no marking criteria, no weighting, no due date. That is worth knowing before you read Answering a Research Methods Assignment, which compares three real submissions against briefs that had to be reconstructed this way.

Check before you proceed

Before you rely on any page in these four streams

  • Check whether the page carries a gap callout, and read it. It tells you what the page could not cover.
  • Check whether the claim you are about to rely on is marked as a source requirement, a source example, an illustrative value or a general principle. Those four things carry very different weight.
  • Where two definitions are given side by side and the conflict is marked, do not pick one silently in your own write-up. Cite both, or cite a source outside this material.
  • For anything quantitative, assume you need a second source until you have checked that you do not.

Two further weeks, and what changed

WHAT THE TWO LATER WEEKS CLOSED AND OPENED

ClosedStill open
The nature of quantitative researchSampling — six types with usable distinctions, non-response bias, and the cost-and-error argument for sampling at allNo procedure for any of the six, no sampling frame, no size rule in the material's own voice, no criterion for choosing between them
Analysing qualitative data and resultsThe library's first complete worked analysis, and the only treatment of the results and discussion sections in the datasetThe interpretation rule is stated three incompatible ways; the reporting half is quantitative guidance filed under a qualitative week

Both weeks also added four more undelivered objectives between them.

Note

An absence is not always permanent

This page recorded a missing week for several deliveries. It was supplied afterwards, and it closed the library's largest gap.

That is worth saying because it is the argument for a page like this one existing at all. Naming what is absent is not complaint — it is the mechanism by which absences get filled. The four missing files recorded above are still missing, and the same applies to them.

What to carry forward

  1. Nine objectives, none fully delivered, seven not delivered at all — and the failure is the same one four times over: a list of names standing in for a treatment.
  2. Ask what you could do with a list before you accept it as coverage. If the answer is only that you could repeat it, the topic was named and not taught.
  3. Four manifest files are missing and one whole week has no study notes. Its gaps belong to the supplied files, not demonstrably to the subject — and this library never blurs the two.
  4. The questionnaire, question-wording, qualitative-approaches and table-construction material is genuinely good. Spend your time there.
  5. Close the statistics gap before you collect quantitative data, not after. It is the one absence here that can invalidate work already done.

Frequently asked questions

Is this page criticising the teaching?

No. It assesses the supplied files against the objectives those files state, which is the only standard available. Where a document is missing, the page says so and declines to draw conclusions about what the missing document contained. Several parts of the material are identified as genuinely strong.

How can an objective be stated and not delivered?

Most often because a set of items is named without being described. An objective to compare methods is not met by a grid of method names, and an objective to evaluate collection techniques is not met by naming six and treating three of them in a sentence each. The naming looks like coverage until you try to act on it.

What is the difference between a gap in the files and a gap in the subject?

One week's study notes were listed in the manifest and are not on disk, so that week is represented by slides alone. Its definitional gaps are exactly what you would expect when the definitional document is missing. The library therefore records them as gaps in the supplied material and makes no claim about what was taught.

Which absence should I close first?

The statistical one, if your project involves quantitative data. You are given one rule expressed in a unit that is never defined, no measure of dispersion, and no inferential procedure. That gap can invalidate analysis you have already done, which none of the others can.

Does the library fill any of these gaps itself?

No. The commissioning standard is that missing information is named rather than invented, because a reader who knows they need a second source is better served than one given a plausible definition attributed to material that does not contain it. Where the library adds its own synthesis, it says so on the page.

Should I still use this material?

Yes, for what it does well — questionnaire and question design, the qualitative approaches and quality criteria, table construction, and the method selection procedure. Treat it as one input to a research design rather than a complete methods education, and pair it with a standard methods text for sampling, instrument design and statistics.

References and source attribution

  1. The supplied teaching source: weekly study notes, slide decks and assessment activities for a master's-level research methods subject in project management. Author, institution and year not stated in the supplied files.
  2. Three anonymised student submissions supplied with the teaching material, used as observed practice rather than as model answers.

Suggested questions for Ask KEVOS

  • Which parts of this research methods material are strong enough to rely on without a second source?
  • What do I need to learn elsewhere before I can analyse quantitative survey data?
  • How do I tell whether a topic has been taught or only named?
  • Which of the stated learning objectives were actually delivered, and which were not?
  • Why does the library refuse to define standard deviation on the quantitative pages?
  • What should I check before relying on a page in the data collection stream?

Related KEVOS knowledge

Research Design and Data Quick ReferenceFoundation · data collectionThe Method Catalogue: Ten Names Without DefinitionsCore · research designVariation and SpreadCore · quantitative analysisThe Normal Model and the 68-95-99.7 RuleAdvanced · quantitative analysisData Collection Methods: Data as EvidenceCore · data collectionAnswering a Research Methods AssignmentCore · research practice
KEVOS® · Project Delivery · Research Projects Page KVS-PM-RES-0184 · v1.0.0 · content 2026.08 Last reviewed 2026-08-16

Continue learning

Research Design and Data Quick ReferenceGuide · Research ProjectsNEXT LESSON →What Quantitative Research IsGuide · Research ProjectsThe Evidence Assembly and Analysis ModelGuide · Research ProjectsPopulation, Sample, Variables and DataGuide · Research Projects
KEVOS · Engineering, manufacturing and project improvement
ArticlesServicesCase studiesAboutContact
© 2026 KEVOS®