BMAD-METHOD/expansion-packs/bmad-trend-insights-platform/data/internet-pipes-framework.md

16 KiB

Internet Pipes Framework

Overview

The Internet Pipes Framework is a methodology for discovering what people actually want by analyzing digital footprints across the web. Unlike traditional market research (focus groups, surveys, interviews), Internet Pipes taps into authentic revealed preferences through search behavior, social activity, and online conversations.

Core Philosophy

The Problem with Traditional Research

  • Focus groups: People lie (consciously or not) about their preferences
  • Surveys: Response bias, social desirability bias, limited sample size
  • Interviews: Time-consuming, expensive, can't scale
  • Intuition: Often wrong, based on personal experience not data

The Internet Pipes Solution

  • Revealed preferences: Watch what people do, not what they say
  • Scale: Billions of data points daily (6M Google searches/minute!)
  • Authenticity: People searching when nobody's watching = real desires
  • Real-time: Identify trends as they emerge, not after they peak
  • Accessible: Available to anyone with internet access

The Five Pillars

1. Signal Detection

What it is: Monitoring multiple internet sources for emerging patterns

Data Sources:

  • Search engines: Google Trends, search autocomplete, related searches
  • Social media: TikTok, Instagram, Twitter/X, Reddit, Pinterest
  • E-commerce: Amazon Best Sellers, Etsy trending, eBay watching
  • Content platforms: YouTube trends, Medium tags, Substack growth
  • News: Google News, niche publications, industry blogs
  • Communities: Subreddits, Facebook groups, Discord servers, forums

What to look for:

  • Rising search volumes
  • Increasing social mentions
  • New hashtags gaining traction
  • Product categories showing growth
  • Questions being asked repeatedly
  • Gaps in existing conversations

Signals vs. Noise:

  • Signal: Sustained increase over weeks/months
  • Noise: Single viral moment or spike
  • Signal: Multiple independent sources showing similar patterns
  • Noise: One influencer's isolated post
  • Signal: Organic growth without paid promotion
  • Noise: Obvious paid advertising campaigns

2. Pattern Recognition

What it is: Identifying trend clusters and relationships

Pattern Types:

A. Category Clusters

  • Related trends emerging simultaneously
  • Example: Cold plunging + breathwork + contrast therapy = wellness recovery trend cluster

B. Demographic Patterns

  • Specific age groups, genders, or locations driving interest
  • Example: Gen Z interest in "underconsumption core" and anti-haul content

C. Temporal Patterns

  • Seasonal trends (Halloween costumes, summer wellness)
  • Cyclical trends (New Year resolutions, back-to-school)
  • Secular trends (long-term shifts like plant-based eating)

D. Causal Relationships

  • Technology enablers (TikTok enables short-form content trends)
  • Cultural catalysts (pandemic drives home fitness)
  • Economic drivers (inflation drives budget-friendly trends)

E. Substitution Patterns

  • New alternatives replacing existing solutions
  • Example: Monk fruit sweetener replacing stevia

F. Intersection Opportunities

  • Two trends combining to create new niches
  • Example: Sustainable + athletic wear = eco-friendly activewear

Pattern Analysis Questions:

  1. Are these trends related or coincidental?
  2. What underlying need connects these trends?
  3. Who is driving this pattern?
  4. What external factors enable this pattern?
  5. Is this pattern accelerating or decelerating?

3. Context Analysis

What it is: Understanding the "why" behind the trend

Context Layers:

A. Need Analysis What need is being fulfilled?

  • Functional: Solves a practical problem (air quality monitors → know if air is safe)
  • Emotional: Provides feelings (cozy cardio → guilt-free movement)
  • Social: Enables identity/status/belonging (permanent jewelry → commitment symbol)
  • Novelty: Satisfies curiosity (butterfly pea tea → magical color-changing)

B. Timing Analysis Why is this trending NOW?

  • Technology: New tech makes it possible (AI enables ChatGPT)
  • Cultural shift: Values changing (sustainability drives eco-products)
  • Economic: Financial conditions (recession drives "dupe culture")
  • Regulatory: Laws change landscape (CBD legalization)
  • Influencer effect: Celebrity/creator adoption (Huberman drives AG1)
  • Pandemic effects: COVID changes behavior (remote work drives home office)

C. Audience Analysis Who wants this?

  • Early adopters: First to try, willing to pay premium
  • Demographics: Age, gender, location, income
  • Psychographics: Values, interests, lifestyle
  • Pain points: What problem are they trying to solve?
  • Current alternatives: What are they using now?

D. Competitive Context What's the market situation?

  • Market stage: Emerging, growth, mature, declining
  • Competition: None, few, many, dominated
  • Alternatives: What else solves this problem?
  • Barriers: Easy or hard to enter?

4. Opportunity Mapping

What it is: Connecting trends to business opportunities

Opportunity Types:

A. Direct Product/Service

  • Create product serving the trend
  • Example: Glowing sunscreen → Develop UV-reactive sunscreen brand

B. Complementary Products

  • Sell products that enhance the trend
  • Example: Cold plunge trend → Sell recovery protocols, thermometers

C. Content & Education

  • Create content about the trend
  • Example: Butterfly pea tea → YouTube channel on color-changing drinks

D. Community & Connection

  • Build community around the trend
  • Example: Permanent jewelry → Instagram community for wearers

E. Tools & Platforms

  • Create tools to serve the trend
  • Example: Air quality trend → App comparing local air quality data

F. Distribution & Access

  • Improve access to existing trend products
  • Example: Subscription box for trending wellness products

Opportunity Evaluation Framework:

Criterion Questions to Ask
Market Size How many people want this? Growing or shrinking?
Competition How many others are doing this? Quality of competition?
Barriers How hard is it to enter? Capital, expertise, distribution?
Timing Early, middle, or late in trend lifecycle?
Monetization How do you make money? Proven models exist?
Defensibility Can you build a moat? Or easily copied?
Alignment Does it fit broader macro trends?
Passion Do you care about this? (Important for longevity)

Opportunity Scoring: Rate each criterion 1-10, calculate average for overall opportunity score.

5. Validation

What it is: Cross-referencing across multiple data sources

Validation Methods:

A. Multi-Source Validation

  • Check 3+ independent data sources
  • Search (Google Trends) + Social (TikTok views) + Commerce (Amazon sales rank)
  • If all point same direction = high confidence

B. Temporal Validation

  • Check trend over time (not just current snapshot)
  • Look for: sustained growth, not just spikes
  • Minimum 3-6 months of data

C. Geographic Validation

  • Where is this trending? Just one region or multiple?
  • US-only or global? Urban or rural?
  • Early markets often predict later markets

D. Demographic Validation

  • Is this just one demographic or crossing segments?
  • Single-demo = niche opportunity
  • Cross-demo = mainstream potential

E. Conversation Validation

  • People asking questions? (indicates interest + info gap)
  • People answering questions? (indicates expertise forming)
  • People creating content? (indicates community forming)

F. Commercial Validation

  • Products being sold?
  • Sales data available?
  • Price points established?
  • Reviews and ratings?

Validation Confidence Levels:

  • 🟢 High confidence: 5+ sources, 6+ months data, multiple demographics, commercial activity
  • 🟡 Medium confidence: 3-4 sources, 3-6 months data, single-demo, early commercial activity
  • 🔴 Low confidence: 1-2 sources, <3 months data, unclear demo, no commercial activity

Practical Application

Step-by-Step Process

Step 1: Choose Your Domain

  • Industry/category to explore (wellness, tech, food, fashion, etc.)
  • Or: Open exploration (what's trending generally?)

Step 2: Gather Signals

  • Google Trends: Search for category keywords, check "rising" queries
  • Reddit: Browse relevant subreddits, sort by "hot" and "top this month"
  • TikTok: Search hashtags, note view counts and growth
  • Amazon: Check best sellers and movers & shakers in category
  • YouTube: Search category, sort by upload date, note views/subscriber ratio

Step 3: Document Potential Trends For each signal, note:

  • Trend name
  • Where you found it
  • Approximate interest level (search volume, social mentions)
  • First observation of trend

Step 4: Analyze Patterns

  • Group related trends
  • Identify common themes
  • Look for intersections
  • Note demographics

Step 5: Investigate Context For promising trends:

  • Search "why is [trend] popular"
  • Read articles about the trend
  • Watch video content about it
  • Join communities discussing it
  • Understand who wants it and why

Step 6: Map Opportunities

  • Brainstorm ways to serve this trend
  • Evaluate each opportunity against framework criteria
  • Score opportunities

Step 7: Validate

  • Check multiple sources (minimum 3)
  • Verify sustained interest (not just spike)
  • Confirm commercial viability
  • Test assumptions with small experiments

Step 8: Act or Monitor

  • High confidence + good opportunity → Act
  • High confidence + poor opportunity → Pass
  • Low confidence + good opportunity → Monitor and re-assess
  • Low confidence + poor opportunity → Pass

Common Pitfalls to Avoid

Mistaking Noise for Signal

  • Pitfall: Chasing every viral moment
  • Solution: Require sustained interest over time

Confirmation Bias

  • Pitfall: Only looking for data that confirms your hypothesis
  • Solution: Actively seek contradictory evidence

Jumping on Too Late

  • Pitfall: By the time it's mainstream, opportunity is gone
  • Solution: Look for "rising" trends, not current trends

Too Narrow or Too Broad

  • Pitfall: "Food is trending" (too broad) or "gluten-free oat milk for dogs" (too narrow)
  • Solution: Find the goldilocks zone - specific but addressable

Ignoring Execution Difficulty

  • Pitfall: Great trend but impossible for you to execute
  • Solution: Consider your resources, skills, and constraints

Confusing Fad with Trend

  • Pitfall: Investing in something that will die quickly
  • Solution: Look for underlying needs, not just novelty

Not Validating Willingness to Pay

  • Pitfall: People are interested but won't actually buy
  • Solution: Look for evidence of commercial transactions

Examples in Action

Example 1: Glowing Sunscreen 📈

Signal Detection:

  • Rising Google searches for "glowing sunscreen" and "UV sunscreen"
  • TikTok videos showing UV-reactive sunscreen going viral
  • Amazon sales of color-changing sunscreen increasing

Pattern Recognition:

  • Part of "visible skincare" trend cluster
  • Related to sun safety awareness + social media shareability
  • Particularly popular with Gen Z and millennial parents

Context Analysis:

  • Why trending: Makes sun protection visible (functional) + fun for kids (emotional) + shareable on social (social)
  • Why now: TikTok enables demonstration of color-changing effect
  • Target audience: Parents with young kids, skincare enthusiasts, beach-goers

Opportunity Mapping:

  • Direct: Create glowing sunscreen brand
  • Complementary: UV detection accessories
  • Content: Educational content about sun safety
  • Community: Reviews and recommendations platform

Validation:

  • Multiple sources (Google, TikTok, Amazon)
  • Sustained interest over 12+ months
  • Multiple demographics
  • Products being sold and reviewed
  • 🟢 High confidence

Example 2: Butterfly Pea Tea 📈

Signal Detection:

  • Search interest for "butterfly pea tea" rising
  • Instagram aesthetic posts featuring color-changing tea
  • Health blogs discussing benefits

Pattern Recognition:

  • Part of "functional beverages" trend cluster
  • Related to natural colors, health trends, Instagram aesthetics
  • Popular with health-conscious millennials

Context Analysis:

  • Why trending: Natural color changing (novelty) + health benefits (functional) + beautiful photos (social)
  • Why now: Instagram culture values aesthetic beverages
  • Target audience: Health-conscious, Instagram-active, interested in natural products

Opportunity Mapping:

  • Direct: Sell butterfly pea tea products
  • Complementary: Recipe books, serving ware
  • Content: How to make color-changing drinks
  • Community: Natural beverage enthusiasts

Validation:

  • Multiple sources (Google, Instagram, health blogs)
  • Sustained interest
  • Products available but not oversaturated
  • Strong community engagement
  • 🟢 High confidence

Advanced Techniques

Trend Forecasting

Look for leading indicators:

  • Early adopter platforms: What's on Reddit before it hits Facebook
  • Geographic progression: Asia → US → Europe pattern for some trends
  • Adjacent trends: If A is trending, related trend B might be next
  • Underlying drivers: If values shift toward X, products serving X will trend

Niche Discovery

Find underserved segments:

  • Search "[main trend] for [demographic]"
  • Look for questions without good answers
  • Find passionate communities with poor products
  • Identify intersection opportunities

Competitive Intelligence

Use Internet Pipes for competitive analysis:

  • Track competitors' search volume
  • Monitor their social media growth
  • Analyze their product reviews for gaps
  • Identify alternatives people are searching for

Content Strategy

Use trends to guide content:

  • Create content about rising trends (early)
  • Answer questions people are asking
  • Fill gaps in existing content
  • Ride trend momentum for distribution

Tools & Resources

Free Tools

  • Google Trends: Search volume over time, related queries, geographic data
  • Reddit: Community discussions, voting signals, trending posts
  • TikTok: Video view counts, hashtag growth, creator adoption
  • YouTube: Upload frequency, view counts, engagement rates
  • Amazon Best Sellers: Sales rank, movers & shakers, new releases
  • Twitter/X: Trending topics, hashtag volume, conversation analysis

Paid Tools (Optional)

  • SEMrush/Ahrefs: Keyword research, search volume, SEO difficulty
  • Exploding Topics: Curated trend discovery
  • Google Keyword Planner: Search volume data
  • Social listening tools: Mention tracking, sentiment analysis

Learning Resources

  • Google Trends tutorial
  • Reddit research guides
  • Amazon seller forums (for commerce insights)
  • Social media analytics courses

Conclusion

The Internet Pipes Framework transforms passive internet browsing into active opportunity discovery. By systematically:

  1. Detecting signals across multiple sources
  2. Recognizing patterns and relationships
  3. Analyzing context and causation
  4. Mapping opportunities
  5. Validating with cross-references

...you can discover what people actually want before your competitors do.

The internet is constantly broadcasting signals about human desire. Most people scroll past these signals. You're now equipped to see them.

Remember: Every minute, 6 million people search Google. They're telling you what they want. Are you listening?

Now go discover the next big thing. 🚀