The Methodology Decision Framework
Answer these 5 questions to choose your methodology with confidence
Research Question Type
What/How Many? → Quantitative
Why/How? → Qualitative
Both? → Mixed Methods
Knowledge Goal
Test theory → Quantitative
Build theory → Qualitative
Explain mechanisms → Mixed
Data Type Needed
Numbers/Statistics → Quantitative
Words/Experiences → Qualitative
Both perspectives → Mixed
Available Resources
Large sample access → Quantitative
Deep access to few → Qualitative
Time & budget for both → Mixed
Field Norms
STEM/Business → Often Quantitative
Social Sciences/Humanities → Often Qualitative
Health/Education → Increasingly Mixed
The Three Methodological Paradigms Explained
Sample Size Determination: Moving Beyond "Rule of Thumb"
Power Analysis Calculator & Guidelines
Stop guessing your sample size. Use evidence-based approaches:
Where:
Z = Z-score (1.96 for 95% confidence)
p = Estimated proportion (0.5 for maximum)
E = Margin of error (0.05 for ±5%)
Result: For 95% confidence, ±5% margin, you need 385 participants
Includes power analysis templates for different statistical tests
7 Deadly Methodology Mistakes (And How to Avoid Them)
Mismatched Methodology
Using quantitative methods for qualitative questions. Fix: Align methodology with research question type.
Weak Sample Justification
"30 participants because that's what others used." Fix: Use power analysis or saturation justification.
Tool-Driven Research
"I'll use SPSS because I know it." Fix: Choose tools based on analysis needs, not familiarity.
Ignoring Validity Threats
Not addressing how you'll ensure credible results. Fix: Include validity/trustworthiness section.
Overcomplicated Design
Complex mixed methods for simple question. Fix: Simpler is often better and more defensible.
No Pilot Study
Skipping pilot testing of instruments. Fix: Always pilot test with 5-10% of sample.
Ethics as Afterthought
Adding ethics section last minute. Fix: Design with ethics from the beginning.
Field-Specific Methodology Recommendations
Different disciplines have different methodological norms and expectations:
| Field | Common Methods | Sample Size Norms | Preferred Analysis |
|---|---|---|---|
| Business/Management | Surveys, Case studies, Regression | 200-500 for surveys | SPSS, SmartPLS, Structural Equation Modeling |
| Computer Science | Experiments, Simulations, Prototyping | Varies by experiment design | Statistical tests, Performance metrics |
| Education | Mixed methods, Action research, Quasi-experiments | 30-200 depending on design | Thematic analysis, ANOVA, Content analysis |
| Social Sciences | Interviews, Ethnography, Focus groups | 10-50 for qualitative | NVivo, Grounded theory, Discourse analysis |
| Health Sciences | Clinical trials, Cohort studies, Systematic reviews | Power analysis determined | SPSS, RevMan, Meta-analysis |
| Engineering | Experiments, Simulations, Modeling | Technical replication focus | MATLAB, ANSYS, Statistical validation |
Essential Tools for Each Methodology
Quantitative Analysis
SPSS: Industry standard
R: Free, powerful
Stata: Econometrics focus
Qualitative Analysis
NVivo: Most comprehensive
Atlas.ti: Visual analysis
Dedoose: Web-based, affordable
Mixed Methods
MAXQDA: Best integration
QDA Miner: Statistical integration
Excel: For basic integration
Getting Supervisor Approval: 5 Pro Tips
Demonstrate how your methodology follows established practices in your field with 3-5 key references.
Prepare answers to "Why this method?" "Why this sample size?" "What are the limitations?"
Create a Gantt chart showing each methodological step with time estimates.
Show you've considered other approaches and explain why you rejected them.
If possible, conduct a small pilot and present initial findings to show feasibility.
Case Study: From Confusion to Confidence
Joyce's Public Health Thesis Journey
Initial Problem: Wanted to study "Factors influencing malaria prevention in rural Ghana" but was torn between quantitative survey (to get numbers) and qualitative interviews (to understand experiences).
Week 1-2
Consultation: We recommended sequential explanatory mixed methods
Week 3-8
Phase 1: Survey of 200 households (quantitative)
Week 9-12
Phase 2: Interviews with 15 survey participants (qualitative)
Week 13-16
Integration: Used survey results to select interview participants
Outcome: Joyce's methodology was praised as "innovative yet rigorous" by her committee. She published 2 papers from her thesis and received a PhD scholarship to the UK.