MCP ExplorerExplorer

Mcpedl Scraping

@kchan139on 19 days ago
1 MIT
FreeCommunity
AI Systems
A lightweight Python utility for scraping addon information from MCPEDL.

Overview

What is Mcpedl Scraping

mcpedl-scraping is a lightweight Python utility designed for scraping addon information from the MCPEDL website, which hosts downloads for Minecraft PE/Bedrock Edition.

Use cases

Use cases include gathering data for creating a database of Minecraft addons, analyzing trends in addon popularity, and simplifying the process of content curation for Minecraft players.

How to use

To use mcpedl-scraping, clone the repository from GitHub, install the required dependencies, and run the scraper with a specific MCPEDL URL. The output will be saved in structured JSON and plain text formats.

Key features

Key features include scraping addon pages, extracting titles, descriptions, and media URLs, saving data as structured JSON, and converting content into plain text format.

Where to use

mcpedl-scraping can be used in fields such as game development, content creation for Minecraft, and data analysis for addon information.

Content

MCPEDL Scraper

A lightweight Python utility for scraping addon information from MCPEDL (Minecraft PE/Bedrock Edition downloads) website.

Features

  • Scrapes addon pages from mcpedl.com
  • Extracts title, description text, and media URLs
  • Saves data as structured JSON
  • Converts content to plain text format

Installation

  1. Clone the repository:

    git clone https://github.com/kchan139/mcpedl-scraping.git
    cd kchan139-mcpedl-scraping
    
  2. Install dependencies:

    pip install -r requirements.txt
    

Usage

Run the scraper with a MCPEDL URL:

python main.py https://mcpedl.com/addon-name/

Output files will be stored in the output directory:

  • mcpedl_data.json - Complete structured data
  • mcpedl_data.txt - Simplified text version with title, URL, and content

Requirements

  • Python 3.6+
  • Chrome/Chromium browser (for Selenium WebDriver)

Legal Notice

This tool is for personal use only. Please respect MCPEDL’s Terms of Service and use responsibly with reasonable request rates. Content from MCPEDL may be subject to copyright protection. The author assumes no liability for misuse of this tool.

Tools

No tools

Comments