Who This Is For

This lab is for content creators, marketers, and founders who want content ideas that come from what real people are actually saying — not what an AI thinks they might be saying.

It is especially useful if you are:

  • Using Claude for content brainstorming and getting generic, surface-level suggestions

  • Writing for a niche audience but not spending time in the communities they live in

  • Spending hours researching topics manually across Reddit and other online spaces before sitting down to write

  • Managing content for a brand and needing a repeatable monthly process for staying on top of what your audience cares about

  • Creating B2B or specialist content where Reddit communities are genuinely active and candid

This is not for someone posting once or twice a month with no consistent content strategy. This workflow makes the most sense when you are producing content at least weekly and want a grounded, repeatable way to generate ideas from real audience data.

How the Workflow Runs

Connect Apify to Claude → Tell Claude your niche and communities → Claude scrapes Reddit directly → Claude analyzes posts and comments and sentiments → Claude generates strategy-aligned content ideas

Time to Set Up

  • Time to set up: 30–40 minutes for the initial setup and your first full run.

  • Daily time after that: 15–20 minutes monthly to re-run the scrape on your target communities and refresh your content idea bank.

Tools Needed

  • Claude desktop app (with MCP enabled in settings)

  • Apify account — free tier available at apify.com

  • Your Apify API token (from your Apify account settings)

  • Your content strategy: platform, format, audience, and goal

Step-by-Step Walkthrough

Step 1: Understand what this workflow should and should not do

Before setting anything up, set the right expectations.

This workflow can help with:

  • Surfacing the exact language, questions, and frustrations your audience uses in the wild

  • Identifying which topics generate the most comments, debate, and engagement on Reddit

  • Spotting recurring pain points and objections that translate into strong content angles

  • Giving Claude grounded, specific input — so its output reflects real conversations, not generic patterns

  • Building a repeatable content research process you can run monthly

It cannot fully replace your judgment about which ideas fit your brand, voice, or specific platform.

It does not cover:

  • Scraping private or members-only Reddit communities

  • Analyzing other platforms (Twitter/X, LinkedIn, Discord require separate Apify Actors)

  • Predicting which idea will perform best — it surfaces options, you decide

  • Writing the final content — this workflow gives you ideas, not ready-to-publish posts

Step 2: Connect Apify to Claude

What is Apify? Apify is a web scraping platform with thousands of pre-built scrapers — called Actors — for sites like Reddit, LinkedIn, Instagram, and more. Their MCP plugin lets Claude trigger these scrapers directly from your conversation, so the data comes straight back into Claude without you leaving the app.

Step 2a: Create a free Apify account

Go to apify.com and sign up. The free plan gives you $5/month in platform credits — enough to test this workflow. For regular monthly use, the $49/month Starter plan gives you over 10,000 results per month.

Step 2b: Get your Apify API token

Once logged in, go to Console → your account → Integrations. Copy your API token — you'll need it in the next step.

Step 2c: Add Apify MCP to Claude Desktop

Open Claude Desktop → Settings → Developer. Open the configuration file and add the following:

{
  "mcpServers": {
    "actors-mcp-server": {
      "command": "npx",
      "args": ["-y", "@apify/actors-mcp-server"],
      "env": {
        "APIFY_TOKEN": "your-token-here"
      }
    }
  }
}

Replace your-token-here with the API token you copied from Apify. Save the file and restart Claude Desktop.

Note: This step requires Node.js v18 or higher to be installed on your computer. If npx doesn't run, download Node.js from nodejs.org first. Once connected, you'll see Apify tools available in your Claude session.

Step 3: Provide Claude enough Context

Before triggering any scrape, give Claude what it needs to do this well — not generically.

Tell Claude:

  • Your niche or topic area (e.g. "B2B SaaS sales", "personal finance for freelancers", "fitness for people over 40")

  • Your content platform and format (e.g. "LinkedIn posts, 150–300 words" or "YouTube videos, 8–12 minutes")

  • Your target audience and their level of sophistication (beginner, practitioner, expert)

  • Your content goal — what you want content to do: build trust, generate leads, educate, provoke debate

  • Any topics or angles you've already covered and want to avoid repeating

Claude will use this context to both identify the right subreddits to scrape and filter the analysis so the ideas it generates are relevant to your strategy — not just popular on Reddit.

Want the full breakdown?

This is where you get real AI workflows, prompts, and systems you can use to automate your work. If you're serious about using tools like Claude to grow your business, this is for you.

Reply

Avatar

or to participate

Recommended for you