What is Mcp Scrape Copilot

mcp-scrape-copilot is a Model Context Protocol server that leverages Puppeteer for browser automation, allowing large language models (LLMs) to interact with web pages, take screenshots, and execute JavaScript in a real browser environment.

Use cases

Use cases for mcp-scrape-copilot include automating data collection from websites, testing web applications by simulating user interactions, taking screenshots for documentation, and executing scripts for dynamic content manipulation.

How to use

To use mcp-scrape-copilot, you can utilize various tools provided by the server, such as navigating to URLs, capturing screenshots, clicking elements, filling out forms, and executing JavaScript. Each tool requires specific inputs like CSS selectors and values.

Key features

Key features of mcp-scrape-copilot include browser automation, console log monitoring, screenshot capabilities, JavaScript execution, and basic web interactions such as navigation, clicking, and form filling.

Where to use

mcp-scrape-copilot can be used in various fields including web scraping, automated testing, data extraction, and any scenario where interaction with web pages is required.

Puppeteer

A Model Context Protocol server that provides browser automation capabilities using Puppeteer. This server enables LLMs to interact with web pages, take screenshots, and execute JavaScript in a real browser environment.

Components

Tools

• puppeteer_navigate

  • Navigate to any URL in the browser
  • Input: url (string)

• puppeteer_screenshot

  • Capture screenshots of the entire page or specific elements
  • Inputs:
    • name (string, required): Name for the screenshot
    • selector (string, optional): CSS selector for element to screenshot
    • width (number, optional, default: 800): Screenshot width
    • height (number, optional, default: 600): Screenshot height

• puppeteer_click

  • Click elements on the page
  • Input: selector (string): CSS selector for element to click

• puppeteer_hover

  • Hover elements on the page
  • Input: selector (string): CSS selector for element to hover

• puppeteer_fill

  • Fill out input fields
  • Inputs:
    • selector (string): CSS selector for input field
    • value (string): Value to fill

• puppeteer_select

  • Select an element with SELECT tag
  • Inputs:
    • selector (string): CSS selector for element to select
    • value (string): Value to select

• puppeteer_evaluate

  • Execute JavaScript in the browser console
  • Input: script (string): JavaScript code to execute

Resources

The server provides access to two types of resources:

1. Console Logs (console://logs)

   • Browser console output in text format
   • Includes all console messages from the browser

2. Screenshots (screenshot://<name>)

   • PNG images of captured screenshots
   • Accessible via the screenshot name specified during capture

Key Features

• Browser automation
• Console log monitoring
• Screenshot capabilities
• JavaScript execution
• Basic web interaction (navigation, clicking, form filling)

Configuration to use Puppeteer Server

Here’s the Claude Desktop configuration to use the Puppeter server:

Docker

NOTE The docker implementation will use headless chromium, where as the NPX version will open a browser window.

{
  "mcpServers": {
    "puppeteer": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "--init",
        "-e",
        "DOCKER_CONTAINER=true",
        "mcp/puppeteer"
      ]
    }
  }
}

NPX

{
  "mcpServers": {
    "puppeteer": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-puppeteer"
      ]
    }
  }
}

Build

Docker build:

docker build -t mcp/puppeteer -f src/puppeteer/Dockerfile .

License

This MCP server is licensed under the MIT License. This means you are free to use, modify, and distribute the software, subject to the terms and conditions of the MIT License. For more details, please see the LICENSE file in the project repository.