What is Mcp Server Pixeltable

mcp-server-pixeltable is a multimodal MCP server designed to handle indexing and querying of various types of multimodal data including audio, video, images, and documents.

Use cases

Use cases include building a searchable media library, developing applications for content-based retrieval, enhancing user experience in multimedia platforms, and integrating with AI models for advanced data processing.

How to use

To use mcp-server-pixeltable, clone the repository, install the required package, and run the services using Docker. Each service can be accessed at its designated endpoint.

Key features

Key features include audio indexing with transcription, video frame extraction, image object detection, document text extraction, and support for semantic and similarity searches across different media types.

Where to use

mcp-server-pixeltable can be used in fields such as media management, content creation, digital asset management, and any application that requires efficient handling of multimodal data.

Multimodal Model Context Protocol Server

This repository contains a collection of server implementations for Pixeltable, designed to handle multimodal data indexing and querying (audio, video, images, and documents). These services are orchestrated using Docker for local development.

🚀 Available Servers

Audio Index Server

Located in servers/audio-index/, this server provides:

• Audio file indexing with transcription capabilities
• Semantic search over audio content
• Multi-index support for audio collections
• Accessible at /audio endpoint

Video Index Server

Located in servers/video-index/, this server provides:

• Video file indexing with frame extraction
• Content-based video search
• Accessible at /video endpoint

Image Index Server

Located in servers/image-index/, this server provides:

• Image indexing with object detection
• Similarity search for images
• Accessible at /image endpoint

Document Index Server

Located in servers/doc-index/, this server provides:

• Document indexing with text extraction
• Retrieval-Augmented Generation (RAG) support
• Accessible at /doc endpoint

Base SDK Server

Located in servers/base-sdk/, this server provides:

• Core functionality for Pixeltable integration
• Foundation for building specialized servers

📦 Installation

Local Development

pip install pixeltable
git clone https://github.com/pixeltable/mcp-server-pixeltable.git

cd mcp-server-pixeltable/servers

docker-compose up --build                 # Run locally with docker-compose
docker-compose down                       # Take down resources

🔧 Configuration

• Each service runs on its designated port (8080 for audio, 8081 for video, 8082 for image, 8083 for doc).
• Configure service settings in the respective Dockerfile or through environment variables.

🔗 Links

• Pixeltable GitHub
• Pixeltable Documentation
• Discord Community

📞 Support

• GitHub Issues: Report bugs or request features
• Discord: Join our community

📜 License

This project is licensed under the Apache 2.0 License.