AI Competitor Intelligence Agent 🕵️‍♂️

An autonomous Business Intelligence agent that monitors competitor websites, extracts key strategic changes (pricing, features, news), and generates structured intelligence reports.

This is an example project demonstrating the power of the Firecrawl SDK for LLM-ready data extraction.

✨ Features

• Firecrawl-Powered: Uses Firecrawl's scrape_url to convert complex competitor pages into clean, LLM-optimized Markdown.
• Autonomous Analysis: Leverages GPT-4o with Structured Outputs to identify business-critical updates.
• Smart Filtering: Automatically ignores UI noise, footers, and technical updates to focus on business impact.
• Portable Intelligence: Delivers reports in a machine-readable format ready for Slack/Discord integrations or databases.

🚀 Quick Start

1. Prerequisites

• Python 3.8+
• Firecrawl API Key
• OpenAI API Key

2. Setup

• Clone the repository:

  git clone https://github.com/sosal123tyu1/firecrawl-competitor-agent
  cd firecrawl-competitor-agent

• Install dependencies:

  pip install -r requirements.txt

• Configure environment variables:

  cp .env.example .env
  # Edit .env with your API keys and target URLs

3. Usage

Run the agent:

python main.py

🛠 How it works

The agent uses Firecrawl to "see" the competitor's website just like a human would, but in a format perfectly suited for AI. By requesting markdown format, we eliminate 90% of the junk HTML, allowing the LLM to focus on what actually changed in the business.

---

Built as a part of the Firecrawl Example Project Bounty Program.

Made with ❤️ using Firecrawl