Add automatic problem creation for API errors

[nlr-ai]

Summary

Extends the self-healing infrastructure to the FastAPI server by automatically creating problem records when API endpoints encounter unhandled errors.

What's New

Global Exception Handler

A comprehensive exception handler that:

• Catches all unhandled exceptions (except validation errors)
• Creates detailed problem records in the PROBLEMS table
• Logs full error details and tracebacks
• Optionally sends Telegram notifications

Request Body Middleware

• Captures JSON request bodies for error debugging
• Safely handles different content types
• Avoids issues with file uploads

Problem Records Include:

• Unique Problem ID: api_error_YYYYMMDD_HHMMSS_endpoint_path
• Type: api_endpoint_error
• Severity: High for 500 errors, Medium for others
• Description: Full error details including:
  • Endpoint path and HTTP method
  • Error type and message
  • Request data (JSON only, truncated if large)
  • Full traceback (truncated to 1000 chars)
• Suggested Solutions: Common fixes for API issues
• Assignment: ConsiglioDeiDieci (system problems)

Error Types Handled:

• ✅ Database connection failures
• ✅ Missing environment variables
• ✅ Import errors
• ✅ Airtable API errors
• ✅ Any unhandled exception

Duplicate Prevention

• Checks for similar problems in the last hour
• Prevents spam when an endpoint repeatedly fails

Integration with Arsenale

With this change, Arsenale can now detect and fix API errors:

1. OBSERVE: Find API error problems in PROBLEMS table
2. ASSESS: Analyze error type and traceback
3. EXECUTE: Fix the issue (add missing imports, set env vars, etc.)
4. DOCUMENT: Verify the API is working again

Example Problem Record

{
  "ProblemId": "api_error_20250627_1045_api_wallet",
  "Type": "api_endpoint_error",
  "Title": "API Error: /api/wallet (POST)",
  "Description": "API endpoint '/api/wallet' (POST) encountered an error.\n\nError Type: KeyError\nError Message: 'AIRTABLE_API_KEY'\n\nRequest Data:\n{\n  \"wallet_address\": \"abc123\",\n  \"ducats\": 100\n}\n\nTraceback:\n...",
  "Status": "active",
  "Severity": "High",
  "Solutions": ["Check the error message...", "Verify all required environment variables..."]
}

Complete Self-Healing Loop

La Serenissima now has automatic problem creation for:

• ✅ Scheduled task failures (scheduler.py)
• ✅ API endpoint failures (main.py)
• ✅ Manual problem detection scripts

This creates a complete feedback loop where infrastructure issues are automatically detected, logged, and made available for Arsenale to fix autonomously!

---

🤖 Generated with Claude Code