The Complete Objective Audit
Nineteen learning objectives across eight audited weeks. Two are fully delivered — both of them in the final fortnight. Here is the reconciled audit, the pattern behind the other seventeen, and what changed at the end.
The standard, and why it is the fair one
Each week opens by stating what a reader will be able to do at the end of it. That statement is the material's own commitment, which makes it the only standard worth judging against — not an external syllabus, not a comparison with another course, and not anybody's opinion about what should have been covered.
One question is asked of each objective: could a reader who worked through the week do the thing the week said they would be able to do? Where the answer is yes for part of it and no for the rest, the objective is recorded as partly delivered and the split is stated.
The audit
OBJECTIVE DELIVERY, WEEK BY WEEK
| Week | Stated | Delivered | Partly | Not delivered |
|---|---|---|---|---|
| Research design | 3 | 0 | 1 | 2 |
| The nature of quantitative research | 3 | 0 | 1 | 2 |
| The nature of qualitative research | 2 | 0 | 0 | 2 |
| Gathering your data | 1 | 0 | 0 | 1 |
| Quantitative analysis and presentation | 3 | 0 | 1 | 2 |
| Analysing qualitative data and results | 2 | 0 | 1 | 1 |
| The challenge of writing up | 3 | 1 | 2 | 0 |
| The unit review | 2 | 1 | 1 | 0 |
| Total | 19 | 2 | 7 | 10 |
Assessed against each week's own stated objectives, quoted from its opening slides.
The pattern behind ten of the shortfalls
Ten undelivered objectives across eight weeks is not ten unrelated oversights. The same failure recurs, and learning to spot it is worth more than memorising the cases, because it is a test you can run on any material anybody hands you.
THE SAME FAILURE, SIX TIMES
| Objective promised | What is named | What is never said |
|---|---|---|
| Compare types of methods | Ten methods, in a grid | No comparison of any two, on any dimension |
| Determine benefits and disadvantages of types | The same ten methods | No benefit and no disadvantage for any of them |
| Design appropriate research tools | Five qualitative methods, described | No interview guide, observation schedule, coding frame or instrument of any kind, in fourteen weeks |
| Evaluate methods of data collection | Six techniques, three of them well | Sampling, observation and focus groups get about a sentence each; no two methods are ever compared |
| Assess categorising, coding, analysing | Coding, in real detail | No analysis procedure; sixteen analysis issues stand as bare labels |
| Evaluate coding options | Coding's timing and two determinants | Not one coding option is named, so none can be evaluated |
Six of the ten. The remaining four are treated below.
What changed in the final fortnight
For six weeks the ratio did not move. In the seventh and eighth it did, and the change is worth understanding rather than just recording.
The two full deliveries
Decide on the process for writing your research proposal
Four reviewer questions, four answering claims, four sections, and component lists of eight, five and fourteen items. A reader could write a proposal from this. The internal contradictions do not prevent that — they require you to choose a structure and say which.
Discuss what you have studied over previous weeks
A comprehensive forty-four-item checklist covering the whole subject, plus an honest statement of how the material expects to be used. The week does what it says it will do.
What made the difference in Week 13 is worth naming, because it is not effort or length. It is that the week describes a thing rather than listing its parts. The proposal material tells you what a reviewer is trying to find out, what each section is for, and what goes in it. Compare the method catalogue that names ten techniques and says nothing about any of them. Same amount of page space; entirely different result.
Where the material is genuinely strong
An audit that stops at shortfalls is unfair and, worse, useless — it does not tell you where to spend your time. These parts are strong and are the reason the streams exist.
Worth your time
- The research proposal — the fullest, most concrete treatment of anything in fourteen weeks
- Questionnaire design and question wording — the most directly actionable guidance in the subject
- Sampling types — six named with usable distinctions, closing the library's largest recorded gap
- The six qualitative collection approaches — the fullest data collection treatment supplied
- The worked inductive categorisation — thirty-one responses into six categories; the only complete worked analysis
- The results and discussion sections — the only treatment of either anywhere in the dataset
- The abstract, with an annotated worked example — four moves shown on a real published abstract
- The supervision breakdown scenario — a failure with no villain, and three competencies that would have prevented it
- The Do's and Don'ts checklist — forty-four items covering the whole subject in one place
The distinction this page will not blur
What the final week says that the audit cannot
That sentence reframes everything above, and it should be read alongside the numbers rather than instead of them. The material was built as a reference set to revisit, not as a self-contained course — and a reference set is fairly judged on whether the right thing is there when you come back for it, not on whether you absorbed it in week nine.
On that standard it does better. The proposal material is there when you write a proposal. The questionnaire guidance is there when you build an instrument. The checklist is there at the end. What it does not survive is the other half of the same claim: many of the resources it tells you to return to are bare addresses, unnamed texts and chapter references into books that were never supplied. You cannot return to what was never reachable. The full argument is at how this material expects to be used.
Using the audit
Triage by what you are about to do
What to carry forward
- Nineteen objectives, two delivered in full, seven partly, ten not at all — and both full deliveries come in the last fortnight.
- Ten shortfalls share one failure: a list of names standing in for a treatment. Ask what you could do with a list before you accept it as coverage.
- What made the final weeks work was describing a thing rather than listing its parts. Same page space, different result.
- Three earlier totals appear in this library and are superseded. Cite nineteen and nothing else.
- A gap in the supplied files is not evidence about the subject as taught — and this material asked to be judged as a reference set, which is a fairer standard than it first looks.
Frequently asked questions
Is this a criticism of the teaching?
No. It assesses the supplied files against the objectives those files state, which is the only standard available. It records nine parts of the material as genuinely strong, and where a document is missing it declines to draw any conclusion about what it contained.
Why do earlier pages give different totals?
Because they audited fewer weeks. Nine objectives over four weeks, then fourteen over six, are both correct for what was then held. Nineteen over eight is current, and no page should cite anything else. The superseded figures are named rather than deleted.
How can an objective be stated and not delivered?
Most often because a set of items is named without being described. An objective to compare methods is not met by a grid of method names, and an objective to evaluate coding options is not met by material that names no coding option at all.
Which parts of the material should I actually rely on?
The research proposal material, questionnaire and question design, the six qualitative collection approaches, the worked categorisation, and the whole write-up run — results, discussion, abstract and report structure. Those are strong enough to work from directly.
What is the single most urgent gap?
Statistics, if your project involves quantitative data. You are given one rule expressed in a unit that is never defined, no measure of dispersion, and no inferential procedure. It is the one absence that can invalidate analysis you have already done.
Does the library fill any of these gaps?
No. The standard it was built to is that missing information is named rather than invented, because a reader who knows they need a second source is better served than one given a plausible definition attributed to material that does not contain it.
References and source attribution
- The supplied teaching source: weekly study notes, slide decks and assessment activities for a master's-level research methods subject in project management, covering fourteen topics. Author, institution and year not stated in the supplied files.
- Anonymised student submissions supplied with the teaching material, used as observed practice rather than as model answers.
Suggested questions for Ask KEVOS
- Which learning objectives did this material actually deliver?
- How do I tell whether a topic has been taught or only named?
- What are the strongest parts of this research methods material?
- Which gap should I close first before starting my project?
- Why does this library refuse to define terms the source leaves undefined?