Project Overview
Transform the Monte Carlo Data platform into a fully agent-ready system implementing modern AI accessibility standards including MCP, OAuth discovery, Agent Skills, content negotiation, and agentic commerce protocols.
Implementation Phases
Phase 1: Discoverability & Bot Access Control
2 hours
-
•
robots.txt with AI bot rules
Currently: Missing or incomplete. Will add: GPTBot, ClaudeBot, PerplexityBot allow/disallow rules + crawl-delay directives
-
•
XML Sitemap
Currently: No sitemap reference. Will add: Auto-generated sitemap with all public pages, proper lastmod timestamps
-
•
Link Headers
Currently: No discovery headers. Will add: Link rel=alternate, rel=sitemap, and canonical headers on all responses
-
•
Content Signals
Currently: No metadata. Will add: X-Content-Signals headers indicating data freshness, update frequency, content type
Phase 2: Content Accessibility
4 hours
-
•
Markdown Content Negotiation
Currently: HTML only. Will add: Accept: text/markdown support on all content endpoints, automatic HTML-to-Markdown conversion middleware
-
•
Structured Data
Currently: No schema markup. Will add: JSON-LD with Organization, WebSite, BreadcrumbList schemas on every page
-
•
Clean Semantic HTML
Currently: Potentially cluttered markup. Will refactor: Use semantic tags (article, section, nav), strip unnecessary divs, improve heading hierarchy
-
•
Accessible Navigation
Currently: Unknown ARIA support. Will ensure: Proper ARIA labels, keyboard navigation, focus management for agent traversal
Phase 3: Protocol Discovery (MCP, OAuth, Agent Skills)
3 hours
-
•
MCP Server Card
Currently: No MCP endpoint. Will create: /.well-known/mcp-server.json with server metadata, capabilities, supported tools/prompts
-
•
Agent Skills Manifest
Currently: No skill definitions. Will add: SKILL.md files defining agent-executable workflows, input/output schemas, and usage examples
-
•
OAuth Discovery
Currently: No OAuth metadata. Will implement: /.well-known/oauth-authorization-server endpoint with token URLs, scopes, grant types
-
•
API Catalog
Currently: Undocumented APIs. Will publish: OpenAPI 3.1 spec at /api-catalog.json with all endpoints, request/response schemas, authentication requirements
Phase 4: Commerce & Web Bot Auth
1.5 hours
-
•
Web Bot Auth
Currently: No bot authentication. Will implement: /.well-known/web-bot-auth endpoint with VAPID keys for verified bot access
-
•
x402 Payment Headers
Currently: No payment metadata. Will add: HTTP 402 responses with x402 payment required headers on premium content endpoints
-
•
Testing & Validation
Run isitagentready.com scan, verify all endpoints return correct headers, test Markdown negotiation with curl
-
•
Documentation
Create README with agent integration examples, update API docs with new endpoints, publish changelog