Website Downloader
What is Website Downloader
Website-downloader is an MCP server tool designed to download entire websites using wget, preserving the website structure and converting links for local use.
Use cases
Use cases for website-downloader include archiving websites for offline access, creating local copies for development and testing, and analyzing website content without internet dependency.
How to use
To use website-downloader, install wget on your system, then utilize the ‘download_website’ command with the required parameters: ‘url’ for the website to download, ‘outputPath’ for the download directory, and ‘depth’ for the recursion level.
Key features
Key features include recursive downloading with infinite depth, inclusion of all page requisites (CSS, images), local link conversion, file extension management, domain restriction, and preservation of website structure.
Where to use
undefined
Clients Supporting MCP
The following are the main client software that supports the Model Context Protocol. Click the link to visit the official website for more information.
Overview
What is Website Downloader
Website-downloader is an MCP server tool designed to download entire websites using wget, preserving the website structure and converting links for local use.
Use cases
Use cases for website-downloader include archiving websites for offline access, creating local copies for development and testing, and analyzing website content without internet dependency.
How to use
To use website-downloader, install wget on your system, then utilize the ‘download_website’ command with the required parameters: ‘url’ for the website to download, ‘outputPath’ for the download directory, and ‘depth’ for the recursion level.
Key features
Key features include recursive downloading with infinite depth, inclusion of all page requisites (CSS, images), local link conversion, file extension management, domain restriction, and preservation of website structure.
Where to use
undefined
Clients Supporting MCP
The following are the main client software that supports the Model Context Protocol. Click the link to visit the official website for more information.
Content
Website Downloader MCP Server
This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
Prerequisites
The server requires wget to be installed on your system.
Installing wget
macOS
Using Homebrew:
brew install wget
Linux (Debian/Ubuntu)
sudo apt-get update
sudo apt-get install wget
Linux (Red Hat/Fedora)
sudo dnf install wget
Windows
- Using Chocolatey:
choco install wget
- Or download the binary from: https://eternallybored.org/misc/wget/
- Download the latest wget.exe
- Place it in a directory that’s in your PATH (e.g., C:\Windows\System32)
Usage
The server provides a tool called download_website with the following parameters:
url(required): The URL of the website to downloadoutputPath(optional): The directory where the website should be downloaded. Defaults to the current directory.depth(optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.
Example
Features
The website downloader:
- Downloads recursively with infinite depth
- Includes all page requisites (CSS, images, etc.)
- Converts links to work locally
- Adds appropriate extensions to files
- Restricts downloads to the same domain
- Preserves the website structure
Installation
- Build the server:
npm install npm run build
- Add to MCP settings:
{
"mcpServers": {
"website-downloader": {
"command": "node",
"args": [
"/path/to/website-downloader/build/index.js"
]
}
}
}Dev Tools Supporting MCP
The following are the main code editors that support the Model Context Protocol. Click the link to visit the official website for more information.
