What is Usescraper Mcp Server

usescraper-mcp-server is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It allows users to extract content from web pages in various formats such as text, HTML, or markdown.

Use cases

Use cases include scraping product information from e-commerce sites, gathering news articles from multiple sources, extracting data for research purposes, and automating content updates for blogs or websites.

How to use

To use usescraper-mcp-server, you can install it via Smithery with the command ‘npx -y @smithery/cli install usescraper-server --client claude’. Alternatively, you can clone the repository, install dependencies, and build the server manually.

Key features

Key features include a single tool ‘scrape’ that extracts content from web pages, customizable output formats (text, HTML, markdown), advanced proxy options to bypass bot detection, and the ability to specify data extraction parameters.

Where to use

usescraper-mcp-server can be used in various fields such as data analysis, content aggregation, SEO optimization, and any application requiring web data extraction.

UseScraper MCP Server

This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool ‘scrape’ that can extract content from web pages in various formats.

Features

Tools

• scrape - Extract content from a webpage
  • Parameters:
    • url (required): The URL of the webpage to scrape
    • format (optional): The format to save the content (text, html, markdown). Default: markdown
    • advanced_proxy (optional): Use advanced proxy to circumvent bot detection. Default: false
    • extract_object (optional): Object specifying data to extract

Installation

Installing via Smithery

To install UseScraper for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install usescraper-server --client claude

Manual Installation

1. Clone the repository:

   git clone https://github.com/your-repo/usescraper-server.git
   cd usescraper-server
   

2. Install dependencies:

   npm install
   

3. Build the server:

   npm run build
   

Configuration

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json
On Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "usescraper-server": {
      "command": "node",
      "args": [
        "/path/to/usescraper-server/build/index.js"
      ],
      "env": {
        "USESCRAPER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.

Usage

Once configured, you can use the ‘scrape’ tool through the MCP interface. Example usage:

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown"
  }
}

Development

For development with auto-rebuild:

npm run watch

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

npm run inspector

The Inspector will provide a URL to access debugging tools in your browser.