Validation Experiments & Hypotheses
Transforming assumptions into testable experiments with clear success criteria to validate MedMinder Pro's viability.
Hypothesis Framework
Each hypothesis follows the format: We believe that [target users] will [action] if we provide [solution] and we'll know this when we see [measurable outcome].
Hypothesis #1: Problem Existence 🔴 Critical
Hypothesis Statement:
We believe that adults 50+ managing 3+ daily medications for chronic conditions
Will actively seek better medication management solutions
If we demonstrate understanding of their specific adherence barriers
We will know this is true when we see 70%+ of surveyed users confirm medication adherence is a top-3 daily challenge AND 8%+ landing page conversion rate
Current Evidence:
- Supporting: $300B annual cost of non-adherence, 125,000 preventable deaths, 80% app abandonment
- Contradicting: Some patients deny having problems with adherence
- Gaps: No direct validation of specific pain points from target users
Experiment Design:
- Method: Customer discovery interviews + landing page test
- Sample Size: 30 interviews, 2,000 landing page visitors
- Duration: 3 weeks
- Cost: $1,500 (ads) + 30 hours (interviews)
Success Metrics
| Metric | Fail | Minimum | Success | Home Run |
|---|---|---|---|---|
| Problem confirmation rate | < 50% | 50-70% | 70-85% | >85% |
| Landing page conversion | < 5% | 5-8% | 8-12% | >12% |
Next Steps if Validated: Proceed to solution validation with confidence in problem-solution fit
Next Steps if Invalidated: Re-examine target segment or pivot to adjacent problems in medication management
Hypothesis #2: Solution Fit 🔴 Critical
Hypothesis Statement:
We believe that patients managing complex medication regimens
Will adopt an AI-powered adherence coach
If we provide personalized interventions that address their specific barriers (cost, side effects, forgetfulness)
We will know this is true when we see 65%+ of prototype users rate the intervention as "very helpful" AND 40%+ complete the full onboarding flow
Current Evidence:
- Supporting: Existing apps have 80% abandonment - users clearly want something better
- Contradicting: Some patients prefer simple solutions without AI complexity
- Gaps: No validation that users will trust AI recommendations for health decisions
Experiment Design:
- Method: Wizard of Oz prototype with human-in-the-loop interventions
- Sample Size: 50 users (25 patients, 25 caregivers)
- Duration: 4 weeks
- Cost: $3,000 (participant incentives) + 40 hours (development)
Success Metrics
| Metric | Fail | Minimum | Success | Home Run |
|---|---|---|---|---|
| Intervention helpfulness rating | < 50% | 50-65% | 65-80% | >80% |
| Onboarding completion | < 25% | 25-40% | 40-60% | >60% |
| Week 1 retention | < 30% | 30-50% | 50-70% | >70% |
Hypothesis #3: Willingness to Pay 🟡 High
Hypothesis Statement:
We believe that patients managing 3+ medications
Will pay $4.99/month for premium features
If we demonstrate clear value through cost savings, better health outcomes, or reduced caregiver burden
We will know this is true when we see 20%+ of free users convert to paid within 30 days AND 15+ pre-orders at target price point
Current Evidence:
- Supporting: Similar health apps (Headspace, Noom) have successful subscription models
- Contradicting: Many health apps struggle with monetization, especially with older demographics
- Gaps: No direct validation of price sensitivity for this specific solution
Experiment Design:
- Method: Van Westendorp pricing survey + pre-order test
- Sample Size: 200 survey responses, 50 pre-order testers
- Duration: 3 weeks
- Cost: $2,000 (incentives) + $500 (ads)
Success Metrics
| Metric | Fail | Minimum | Success | Home Run |
|---|---|---|---|---|
| Optimal price point | >$7.99 | $5.99-$7.99 | $4.99-$5.99 | <$4.99 |
| Conversion rate (30 days) | < 10% | 10-20% | 20-30% | >30% |
| Pre-orders collected | < 5 | 5-15 | 15-30 | >30 |
Hypothesis #4: Caregiver Engagement 🟡 High
Hypothesis Statement:
We believe that adult children managing medications for aging parents
Will actively use the caregiver dashboard
If we provide real-time alerts, refill reminders, and doctor visit talking points
We will know this is true when we see 75%+ of caregivers log in at least weekly AND 60%+ complete the onboarding process
Current Evidence:
- Supporting: 43.5M Americans provide unpaid care for adults 50+ (AARP)
- Contradicting: Caregivers may feel overwhelmed by additional tools
- Gaps: No validation that caregivers will trust and use digital tools for medication management
Hypothesis #5: B2B Adoption 🟢 Medium
Hypothesis Statement:
We believe that health plans and pharmacy chains
Will license our solution for their high-risk members
If we demonstrate ROI through reduced hospitalizations and improved adherence metrics
We will know this is true when we see 3+ pilot agreements signed within 6 months of launch AND 80%+ of pilot participants achieve improved PDC scores
Experiment Catalog
12 experiments designed to validate critical assumptions with clear success criteria.
1. Patient Discovery Interviews
Hypothesis Tested: #1 (Problem Existence)
Method: Semi-structured interviews with target users
Setup:
- Recruit 30 patients (50+) managing 3+ meds via Facebook groups, AARP forums, and local senior centers
- Offer $50 gift card incentive
- Schedule 45-minute video calls
- Use interview guide focusing on current challenges and workarounds
- Record and transcribe conversations
Metrics:
- % confirming medication adherence is top-3 daily challenge
- Frequency of specific pain points (cost, side effects, forgetfulness, etc.)
- Current solutions used and their limitations
- Quotes indicating emotional impact
Timeline: 3 weeks
Cost: $1,500 (incentives)
Success Criteria:
- ✅ Pass: 70%+ confirm problem as significant
- ⚠️ Re-evaluate: 50-70% confirmation
- ❌ Fail: <50% confirmation
2. Caregiver Discovery Interviews
Hypothesis Tested: #4 (Caregiver Engagement)
Method: Interviews with adult children managing medications for parents
Setup:
- Recruit 20 caregivers via Facebook groups, Reddit (r/caregivers), and local support groups
- Offer $75 gift card incentive
- Focus on pain points in medication management
- Explore current tools and workarounds
Metrics:
- % who currently track medications for parents
- Tools currently used and their limitations
- Biggest frustrations in the process
- Willingness to use a digital solution
Timeline: 2 weeks
Cost: $1,500 (incentives)
3. Landing Page Smoke Test
Hypothesis Tested: #1 (Problem Existence) + #2 (Solution Interest)
Method: Landing page with waitlist signup
Setup:
- Create 3 landing page variants (Carrd/Unbounce)
- Headline variants:
- A: "Never miss a medication again"
- B: "Your personal medication coach"
- C: "Stop guessing, start managing"
- Add waitlist email capture form
- Drive traffic via Facebook/Google ads targeting:
- 50+ with chronic conditions
- Adult children of aging parents
- Caregivers
Metrics:
- Traffic volume (target: 2,000+ visitors)
- Conversion rate by variant
- Time on page
- Scroll depth
- Demographic breakdown of signups
Timeline: 2 weeks
Cost: $1,500 (ads)
Success Criteria:
- ✅ Pass: >8% conversion rate
- ⚠️ Re-evaluate: 5-8% conversion rate
- ❌ Fail: <5% conversion rate
4. Wizard of Oz MVP
Hypothesis Tested: #2 (Solution Fit) + #3 (Willingness to Pay)
Method: Manually deliver the service using AI + human judgment
Setup:
- Recruit 50 users (25 patients, 25 caregivers) from landing page signups
- Collect medication lists and basic health info via Google Form
- Generate personalized adherence plans using:
- AI for initial analysis (Claude/GPT)
- Human review for clinical appropriateness
- Deliver via email with follow-up survey
- Offer premium features to subset of users
Metrics:
- Time to deliver (target: <24 hours)
- User satisfaction (1-10 rating)
- NPS score
- % finding the intervention "very helpful"
- % willing to pay after seeing output
- Actual payment conversion
Timeline: 4 weeks
Cost: $3,000 (incentives) + 40 hours (development)
Success Criteria:
- ✅ Pass: 8+/10 avg satisfaction, 65%+ would pay
- ⚠️ Re-evaluate: 6-8/10 satisfaction, 50-65% would pay
- ❌ Fail: <6/10 satisfaction, <50% would pay
5. Pricing Sensitivity Survey (Van Westendorp)
Hypothesis Tested: #3 (Willingness to Pay)
Method: Van Westendorp Price Sensitivity Meter
Setup:
- Create survey with 4 key questions:
- At what price would you consider this too expensive?
- At what price would you consider this a bargain?
- At what price would you start to question the quality?
- At what price would this be too expensive to consider?
- Recruit 200 respondents via Facebook ads and patient forums
- Offer $10 gift card incentive
- Analyze results to find optimal price range
Metrics:
- Optimal price point range
- Price sensitivity by demographic segment
- Willingness to pay for specific features
- Comparison between patient and caregiver responses
Timeline: 3 weeks
Cost: $2,000 (incentives)
6. Pre-Order Test
Hypothesis Tested: #3 (Willingness to Pay)
Method: Collect actual payments before building
Setup:
- Create pre-order page with:
- Clear value proposition
- Feature list
- Guarantee (full refund if not satisfied)
- Drive traffic from landing page and email list
- Collect payments via Stripe
- Follow up with survey about purchase decision
Metrics:
- Number of pre-orders
- Conversion rate from visitors to buyers
- Average order value
- Reasons for purchase (survey)
- Reasons for not purchasing (exit survey)
Timeline: 2 weeks
Cost: $500 (ads)
Success Criteria:
- ✅ Pass: 15+ pre-orders at $4.99/month
- ⚠️ Re-evaluate: 5-15 pre-orders
- ❌ Fail: <5 pre-orders
7. Fake Door Feature Test
Hypothesis Tested: #2 (Solution Fit)
Method: Measure interest in specific features before building
Setup:
- Create landing page with 5 "coming soon" features:
- AI adherence coach
- Pharmacy price comparison
- Caregiver dashboard
- Doctor visit talking points
- Side effect management
- Track clicks on each feature
- Ask users to vote for most important feature
- Offer early access to top feature
Metrics:
- Click-through rate for each feature
- Vote distribution
- Conversion to early access waitlist
- Demographic differences in feature preference
Timeline: 2 weeks
Cost: $500 (ads)
8. Channel Testing
Hypothesis Tested: #1 (Problem Existence) + #4 (Caregiver Engagement)
Method: Test customer acquisition cost across channels
Setup:
- Run identical ads on 5 channels:
- Facebook (senior groups)
- Google Search (medication management keywords)
- Reddit (r/caregivers, r/diabetes, etc.)
- Nextdoor (local senior communities)
- Healthcare forums (PatientsLikeMe)
- Track conversions to landing page
- Calculate CAC for each channel
Metrics:
- Cost per click
- Conversion rate
- Cost per signup
- Demographic quality of each channel
- Retention by channel
Timeline: 3 weeks
Cost: $2,500 (ads)
Success Criteria:
- ✅ Pass: CAC < $20 with >5% conversion
- ⚠️ Re-evaluate: CAC $20-$40
- ❌ Fail: CAC > $40
Experiment Prioritization Matrix
Prioritizing experiments based on impact, effort, and risk mitigation.
| Experiment | Hypothesis | Impact | Effort | Risk if Skipped | Priority |
|---|---|---|---|---|---|
| Patient Discovery Interviews | #1 | 🔴 Critical | Medium | Fail | 1 |
| Landing Page Smoke Test | #1, #2 | 🔴 Critical | Low | Fail | 2 |
| Wizard of Oz MVP | #2, #3 | 🔴 Critical | High | Fail | 3 |
| Caregiver Discovery Interviews | #4 | 🟡 High | Medium | Suboptimal positioning | 4 |
| Pricing Sensitivity Survey | #3 | 🟡 High | Low | Suboptimal pricing | 5 |
| Pre-Order Test | #3 | 🟡 High | Medium | Lack of validation | 6 |
| Fake Door Feature Test | #2 | 🟢 Medium | Low | Build wrong features | 7 |
| Channel Testing | #1, #4 | 🟢 Medium | Medium | Inefficient CAC | 8 |
| Health Plan Outreach | #5 | 🟢 Medium | High | Miss B2B opportunity | 9 |
Priority Logic:
- Critical Path First: Experiments that determine Go/No-Go decisions
- Low Effort, High Impact: Quick wins for validation
- Dependent Experiments Last: Only run after prerequisites pass
- Risk Mitigation: Prioritize experiments that reduce highest risks first
8-Week Validation Sprint
Phased approach to validate critical assumptions efficiently.
Week 1-2: Problem Validation
| Day | Activity | Owner | Deliverable |
|---|---|---|---|
| D1-D2 | Design interview guides | Product | Final interview scripts |
| D1-D3 | Build landing page variants | Marketing | 3 live landing pages |
| D1-D7 | Recruit interview participants | Research | 30 scheduled calls |
| D4-D14 | Conduct patient interviews | Research | 20 completed interviews |
| D8-D14 | Run landing page ads ($1,000) | Marketing | 1,500+ visitors |
Week 3-4: Solution Validation
| Day | Activity | Owner | Deliverable |
|---|---|---|---|
| D15-D18 | Analyze interview data | Product | Problem validation report |
| D15-D21 | Build Wizard of Oz process | Engineering | Manual delivery workflow |
| D19-D28 | Deliver to 25 users | Operations |