Of all the chapters in a doctoral dissertation, the methodology chapter receives the most sustained examiner interrogation. Examiners treat it as the chapter that reveals whether the candidate has actually thought through the design of the study rather than adopted it as convention. A weak methodology answer describes what was done. A strong one defends why, against the alternatives, in terms of the consequences for the claims the study can make. That difference is what this article is about.
This article covers only the methodology interrogation: the question patterns examiners use, the escalation logic behind them, and the specific moves that distinguish a strong answer from an adequate one across the main domains of methodological challenge. General defense preparation, including the four-week preparation timeline, mock viva format, and broad question categories, is covered separately in the dissertation defense preparation guide, which complements rather than duplicates what follows here.
Quick Answer:
Examiners probe methodology through a three-level escalation: first asking why you chose a particular approach, then asking why you did not choose the alternative, then asking what the consequences of your choice are for your claims. Weak answers stop at the first level, describing what was done without defending it. The categories most heavily interrogated are research philosophy and paradigm justification, design choice against alternatives, sampling strategy and size, trustworthiness or validity, and analysis approach. Null findings, unexpected results, and "what would you do differently" questions all have structured answers that acknowledge limitations without repudiating the study.
Why Methodology Is the Central Battleground
Examiners use the methodology chapter to test something specific: whether the candidate understands the relationship between the research question, the epistemological position, the design, the method, and the claims the study can and cannot make. Trafford's 2003 analysis of viva questions, published in Quality Assurance in Education, found that "patterns of generic questions transcend disciplines" and that examiners consistently probe conceptualization, the capacity to connect design decisions to their theoretical and epistemological basis, as a threshold capacity for the doctorate.
The empirical evidence on where examiners focus their critical attention confirms this. Holbrook, Bourke, Lovat and Dally's analysis of examiner reports found that the "Approach" category, which covers design, methods, epistemological position, instruments, and analysis, statistically differentiates high-quality from marginal theses. Within that category, sampling, validity, and reliability were most frequently judged "inappropriately done." The candidate who can defend not just what they did but why, against the alternatives, and with an honest account of what the design does and does not allow, is the candidate who passes the methodology interrogation.
The Three-Level Escalation Pattern
Every methodology question follows the same underlying escalation, regardless of which aspect of the design it addresses.
At the first level, the examiner asks why you chose a particular approach: "Why did you use a phenomenological design?" or "Why did you choose purposive sampling?" A first-level answer describes the choice and perhaps offers a brief justification. This is necessary but not sufficient.
At the second level, the examiner asks why you did not choose the alternative: "Why not grounded theory instead of phenomenology?" or "Why not random sampling, given that you were studying a relatively accessible population?" A second-level answer requires knowing the alternatives well enough to explain why they were rejected, not merely that they were.
At the third level, the examiner asks about the consequences of your choice for the claims the study makes: "What does a phenomenological design allow you to claim about the experience you studied, and what does it prevent you from claiming?" This is the level at which candidates either demonstrate genuine methodological understanding or reveal that they adopted their design without thinking it through. A strong answer owns the trade-off: "Phenomenology allows me to establish the structure of meaning in this particular lived experience, but it does not allow me to generalize beyond participants whose biographical context is similar to those I recruited." That is not a concession; it is precision.
Table 1: Methodology Question Categories — What the Examiner Is Testing and What a Strong Answer Addresses
Category | Typical questions | What the examiner is testing | What a strong answer addresses |
|---|---|---|---|
Research philosophy and paradigm | What is your ontological position? Why interpretivist rather than positivist? How does your epistemology generate your methodology? | Whether the paradigm was adopted or reasoned, whether the candidate can trace ontology through to method | The internal coherence of the chain from ontology to epistemology to methodology to methods, and why the alternative paradigm was unsuitable for this research question |
Research design | Why this design? Why not [named alternative]? What could a longitudinal/experimental design have added? | Whether the design was selected for its fit with the research question or for convenience, whether the candidate knows the design space | Why the chosen design was appropriate to the research question; what alternative designs would have answered a different question; what the design cannot establish, and how that is acknowledged |
Sampling | Why this sample size? How did you determine saturation? Why purposive, not random? How does your sample limit generalizability? | Whether sampling decisions were deliberate and defensible, whether the candidate understands what kind of generalization the sample supports | The criterion governing sample size (saturation for qualitative; power analysis for quantitative), the population the sample represents and does not represent, what claims it supports, and at what scope |
Data collection | Why this instrument? Were the interview questions piloted? What might have been missed by this data collection approach? | Whether data collection was systematic and evidence-informed, whether the candidate understands the instrument's limitations | The rationale for instrument choice, piloting and any revisions, what the instrument captures and what it leaves out |
Rigor and trustworthiness | How did you establish credibility? What did participants say during member checking? How did you address your own positionality? | Whether the rigor criteria were implemented or only named, whether the candidate can describe specific decisions and their rationale | Specific strategies for each criterion (credibility, transferability, dependability, confirmability for qualitative; validity threats and mitigation for quantitative); what participants actually said during member checking |
Analysis approach | Why is thematic analysis not grounded theory? How were coding decisions made? How did you ensure consistency across the dataset? | Whether the analytic approach was appropriate and systematically applied, and whether the candidate can account for interpretive decisions made during analysis | Why the chosen analytic approach was appropriate to the research question; how coding was conducted and documented; how interpretive decisions were made and checked |
Research Philosophy and Paradigm Questions
Research philosophy questions are the first thing many examiners raise, particularly in the UK, where the epistemological positioning of the study is treated as a foundational concern. These questions take predictable forms.
"What is your ontological position?" asks what you believe about the nature of reality being studied. "What epistemological position underpins your methodology?" asks how you believe knowledge about that reality can be obtained. "Why did you position this study within an interpretivist rather than a positivist paradigm?" asks for the justification of the paradigm choice, not just its identification.
The appropriate answer traces the internal coherence of the chain: the phenomenon being studied (which is typically a socially constructed experience, a process, or a relationship that cannot be reduced to measurable variables) requires an interpretivist ontology because reality is subjective and contextually constructed; that ontology requires an epistemological position in which knowledge is co-constructed between researcher and participant rather than objectively measured; that epistemology generates a methodology, phenomenology, grounded theory, ethnography, appropriate to generating that kind of knowledge; and that methodology generates the specific methods chosen. Each step follows from the previous one.
The most important thing to avoid in this answer is naming a paradigm without being able to trace the chain. Citing Guba and Lincoln, or naming "interpretivism," without being able to connect it to the specific design and data collection approach, is a signal to examiners that the paradigm label was adopted rather than reasoned. A live guide to choosing and justifying a research philosophy covers the paradigm-selection logic in detail.
When an examiner challenges the paradigm itself, a positivist examiner may push back on an interpretivist study, or vice versa. The appropriate response is not to concede the paradigm. Restate its internal coherence, show the criteria appropriate to it, trustworthiness criteria rather than validity criteria for qualitative work, and demonstrate that you understand the alternative but have reasoned grounds to reject it for this research question. A candidate who can say "A positivist approach would require that I operationalize the phenomenon into measurable variables, which would foreclose the very aspect of the experience I needed to understand" is defending their paradigm from within it, not capitulating to external pressure.
Design Justification: Why This, Not That
Design questions ask candidates to justify their choice of research design against the alternatives. The examiner is testing whether the design was selected because it was appropriate or because it was familiar.
"Why a case study rather than a survey?" requires an answer that grounds the case study in what the research question required, an in-depth understanding of a particular bounded context, and explains why a survey would have answered a different question. "Why a cross-sectional design rather than a longitudinal one?" requires acknowledging the limitation that cross-sectional data establishes association but not temporal sequence, and then arguing for why a longitudinal design was not feasible or necessary given the specific research question.
The logic of every design justification is: this question required this kind of knowledge, this knowledge required this kind of data, and this kind of data required this design. An examiner who asks "what would a different design have allowed you to see?" is inviting the candidate to demonstrate that they understand the design space, not just their corner of it.
For professional doctorate candidates, DNP, EdD, and DBA, the design question often takes a different form. The examiner may ask why the project used a quality improvement design rather than a randomized trial, or what distinguishes the practice improvement methodology from a quasi-experimental research design. The answer traces the purpose: a QI project aims to improve local processes, not to generate generalizable knowledge, and its design choices, pre-post comparison, run charts, and descriptive statistics are appropriate to that purpose. The dissertation discussion chapter covers how the distinction between QI and research claims carries forward into the findings and discussion, a connection that the methodology defense should explicitly make.
Sampling: The Most Frequently Challenged Domain
Sampling is where examiner challenge is most concentrated. Holbrook et al.'s evidence confirms that sampling is among the methodological elements most frequently judged "inappropriately done" in examiner reports. This makes it the highest-priority area to prepare.
Qualitative sampling questions focus on saturation, sampling strategy, and representativeness. "How did you determine that you had reached saturation?" requires an honest account of the analytic process: you stopped recruiting when new interviews added no new themes, categories, or variations that were analytically relevant to the research question, not when a pre-specified number was reached. "Why purposive sampling and not theoretical sampling?" requires knowing the difference: purposive sampling selects participants based on predetermined criteria; theoretical sampling selects them iteratively as the analysis develops, which is appropriate for grounded theory but not for phenomenology or narrative inquiry.
Quantitative sampling questions focus on power, sample size, and representativeness. "Was your sample adequately powered to detect the effect you were interested in?" requires having conducted and being able to reproduce the power analysis, including the effect size assumption and the alpha level used. "How does your convenience sample limit generalizability?" requires a specific answer about which populations the sample represents and which it does not, and what that means for the scope of the claims.
Defending a small or constrained sample is one of the most common challenges doctoral candidates face, particularly in qualitative work where samples of 10-20 are standard but can appear thin to examiners unfamiliar with the paradigm. The appropriate response does not concede that the sample is inadequate. It reframes the constraint as appropriate to the paradigm: depth is the governing criterion in qualitative research, not breadth; a sample of 15 participants each interviewed for two hours produces more analytically rich data than a survey of 200 who each respond to 10 items. State clearly what analytic generalization, rather than statistical generalization, the study can support.
Table 2: The Three-Level Escalation Pattern — Weak, Adequate, and Strong Answers
Escalation level | Examiner question | Weak answer | Strong answer |
|---|---|---|---|
Level 1: Justify the choice | "Why did you use a phenomenological design?" | "Phenomenology is appropriate for studying lived experience, which is what my research question was about." | "Phenomenology was appropriate because my research question asked about the structure of meaning in participants' experience of X, rather than the frequency or distribution of that experience across a population. It assumes that experience has an intelligible structure that can be revealed through rigorous description, which is the epistemological position this study adopts." |
Level 2: Defend against the alternative | "Why not grounded theory instead?" | "Grounded theory is also qualitative, but phenomenology was more appropriate for my topic." | "Grounded theory aims to generate a substantive theory of a social process from iterative data collection and theoretical sampling. My research question was not about how a process unfolds across time, but about the structure of meaning within a specific experience. Phenomenology was designed for exactly that question; grounded theory would have been a category error." |
Level 3: Own the trade-off | "What does a phenomenological design prevent you from claiming?" | "It does have some limitations in terms of generalizability." | "Phenomenology does not support statistical generalization; the findings describe the structure of meaning for participants whose biographical context resembles those I recruited, not the distribution of that experience across the wider population. What it does support is analytic generalization: the claim that the structure I identified is recognizable to others who have had that experience, which I tested through thick description and member checking. The appropriate claim is not 'all people who experience X find Y' but 'the experience of X has this structure in this context, and here is how we know it.'" |
Rigor: Trustworthiness and Validity
For qualitative research, the rigor question asks about trustworthiness. The four criteria established by Lincoln and Guba, credibility, transferability, dependability, and confirmability, are the standard against which qualitative rigor is evaluated, and the examiner will expect the candidate to name both the criteria and the specific strategies used to meet them.
Credibility is established through prolonged engagement with the data, member checking (returning interpretations to participants for verification), and triangulation where appropriate. Transferability is established through thick description, enough contextual detail about the setting, the participants, and the conditions of data collection that a reader can judge whether the findings transfer to their own context. Dependability is established through an audit trail that documents methodological decisions and how they evolved. Confirmability is established through reflexive journaling or other mechanisms that make the researcher's influence on the data visible and accountable.
Candidates who name these criteria without being able to describe their specific implementation strategies have learned the vocabulary without the practice. An examiner will ask: "You say you used member checking, what did participants actually say about your interpretations, and did any of them challenge them?" If the answer is that no participants challenged any interpretation, that itself warrants reflection, because it may signal that the interpretations were too safe.
For quantitative research, the rigor question asks about validity threats and reliability. "What threats to internal validity did your design face, and how did you address them?" requires a systematic account: selection bias, history effects, maturation, instrumentation drift, and attrition are all plausible threats in non-randomized designs, and each should have been anticipated and partially mitigated. "How did you establish the reliability of your instrument?" requires more than citing a Cronbach's alpha value; it requires explaining what that value means about the consistency of measurement and what it does not tell you about validity.
Analysis: Justifying the Approach
Analysis questions ask candidates to defend the choice of analytic approach and to account for the specific decisions made during analysis.
"Why thematic analysis rather than discourse analysis?" requires grounding the answer in what the research question was asking: thematic analysis identifies patterns of meaning across a dataset; discourse analysis examines how language constructs the phenomenon. If the question was about what participants experienced, thematic analysis is appropriate; if it was about how they talked about what they experienced in relation to power structures, discourse analysis may have been more fitting.
"How were your coding decisions made?" requires describing the process: whether coding was inductive or deductive, whether a codebook was used, how codes were revised across the dataset, and how the move from codes to themes was made. An examiner who asks this is testing whether the analysis was a systematic process or an impressionistic one. Candidates who cannot describe their analytic moves in procedural terms have usually not documented them adequately, which is itself a weakness the examiner may note.
"How did you ensure consistency in your analysis?", or, for studies with multiple analysts, "what was your inter-rater reliability procedure?" requires an account of the checks built into the analytic process. For single-analyst qualitative studies, the relevant check is reflexive documentation of how interpretive decisions were made and how the researcher's own positionality may have shaped them. The synthesis matrix used in the literature review is an organizational parallel to this; both are tools for making the analytical process transparent and auditable, rather than impressionistic.
The "What Would You Do Differently?" Question
This question appears in almost every methodology examination, and it is almost always handled poorly. Candidates either panic and concede fatal flaws or deflect by saying they would change nothing, which signals either defensiveness or lack of reflection.
The appropriate answer is genuine methodological reflection: a specific alternative design choice that would have added something the current design could not, a longitudinal component that would have allowed temporal claims, a second site that would have tested transferability, a comparison group that would have strengthened causal inference, without repudiating the study you conducted. The structure is: "If I were designing this study again with more time and resources, I would add X because it would allow the study to establish Y, which the current design could not address. That said, the current design was appropriate to the resources available and the research question as I framed it."
That answer demonstrates exactly what examiners are looking for: a candidate who understands their own work's limitations and can articulate them in terms of the design choices they made, rather than treating limitations as failures.
Going into a viva or defense and not confident about your methodology answers? |
|---|
The methodology interrogation is where most corrections are required, and most candidates underestimate how far examiners will push the escalation from "why did you choose this?" to "what are the consequences for your claims?" A specialist can work through your methodology with you, identify the second- and third-level questions your design is likely to attract, and help you build the answers before the examination. Request a defense preparation consultation, and you will have an itemized quote within 2 to 4 business hours, no obligation. |
Connecting the Methodology Defense to the Rest of the Dissertation
An examiner who is satisfied with the methodology defense will often move directly to the findings and discussion, asking how the methodology shaped or limited what was found. This transition is deliberate: the examiner is testing whether the candidate can trace the consequences of their methodological choices through to the claims the study makes.
The methodology chapter does not stand alone in the examination. It is read against the literature review, which should have established the epistemological framework the methodology implements; against the results, which should report data in terms consistent with the analytic approach; and against the discussion, which should make interpretive claims that do not exceed what the methodology allows. A candidate who understands why methodology chapters get sent back under examination, because the design and the claims are misaligned, is also a candidate who understands why the methodology defense cannot be prepared in isolation from the rest of the dissertation. For candidates who need support with the methodology chapter itself before the defense, our dissertation methodology service works through the design justification, the rigor framework, and the alignment between the chapter and the study's claims. For the defense itself, our defense preparation service covers mock examination sessions targeting the specific weaknesses your methodology is likely to attract under scrutiny.
Frequently Asked Questions
What are the most common methodology questions in a viva?
The most consistently asked are: why did you choose this research paradigm; why this design and not an alternative; how did you determine your sample size and sampling strategy; how did you establish rigor or validity; and what would you do differently if you were conducting this study again. These five categories cover the bulk of methodology interrogation across disciplines and examination formats.
How should I defend a small qualitative sample?
Reframe the sample in terms of what the paradigm requires. Qualitative research seeks depth and analytic richness, not statistical representativeness. A sample of 12 to 18 participants interviewed in depth is appropriate for many phenomenological or interpretive studies, and the relevant criterion is analytic saturation, when new data adds no new analytically relevant material, rather than a number threshold. State clearly what kind of generalization the study supports (analytic or theoretical generalization, not statistical generalization) and what population it does and does not represent.
How do I handle an examiner who fundamentally disagrees with my research paradigm?
Do not concede the paradigm. Restate its internal coherence, the chain from ontology to epistemology to methodology to methods, and show why the alternative paradigm would have been unsuitable for the specific research question. An examiner who challenges an interpretivist study from a positivist standpoint is raising a legitimate methodological question, not a fatal flaw, and a candidate who can trace the reasoning behind their paradigm choice will emerge from that exchange with credit rather than corrections.
What is the difference between the UK viva and the US dissertation defense in terms of methodology interrogation?
In the UK, the viva typically involves two examiners, one internal, one external, and is a closed examination lasting 90 minutes to four hours. The methodology is often interrogated more philosophically, with sustained questions about epistemological positioning. In the US, the defense is typically a committee examination that begins with a public presentation and then moves to closed questioning. The committee members may have varying methodological orientations, and the interrogation tends to be less philosophically sustained but may include more discipline-specific technical challenges. In both formats, the escalation pattern described in this article applies.
How detailed should my answer about trustworthiness be?
Detailed enough to show you implemented each criterion rather than just named it. If you say you used member checking, describe what participants said when you returned your interpretations to them. If you say you kept a reflexive journal, describe what you recorded and how it influenced your analysis. Golding, Sharmini and Lazarovitch found that examiners who find a thesis convincing tend to find it convincing because the candidate demonstrates thorough engagement with the evidence rather than superficial compliance with methodological conventions. The trustworthiness answer is an opportunity to show that engagement.
You May Also Find Useful
- Dissertation Defense and Viva Preparation: PhD Question Guide
- Why Dissertation Methodology Chapters Get Sent Back: What Examiners Actually Look For
- How to Choose and Justify Your Research Philosophy: Positivism, Interpretivism, and Pragmatism
- The Dissertation Discussion Chapter: Interpretation, Limitations, and Contribution
Defending the Design, Not Just Describing It
The methodology examination is not a test of memory. It is a test of understanding: whether the candidate knows why they made each design decision, what alternatives they considered and rejected, and what the consequences of their choices are for the claims the study can make. A candidate who can trace that chain fluently, across all the domains the examiner probes, is demonstrating the scholarly judgment that the doctorate is designed to certify.
The preparation for that defense begins long before the examination. It begins when the methodology chapter is written, when each design decision is explicitly justified rather than assumed, and when the limitations are acknowledged with enough precision to show that the candidate has thought through the trade-offs they accepted. A methodology chapter that has been written with that level of rigor is a chapter that can be defended.
If you would like support strengthening your methodology chapter before the defense, or preparing specifically for the examination interrogation it is likely to attract, share what you are working on, and you will receive an itemized quote within 2 to 4 business hours, with no obligation.
