buenosairesam
4e9d731cff
- Add missing GraphQL mutations: retryJob, updateAsset, deleteAsset - Add UpdateAssetRequest and DeleteResult to schema source of truth - Move Lambda callback endpoint to main.py (only REST endpoint) - Remove REST routes, pydantic schemas, and deps - Remove pydantic target from modelgen.json - Update architecture diagrams and documentation
213 lines
7.7 KiB
HTML
213 lines
7.7 KiB
HTML
<!doctype html>
|
|
<html lang="en">
|
|
<head>
|
|
<meta charset="UTF-8" />
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
|
|
<title>MPR - Architecture</title>
|
|
<link rel="stylesheet" href="styles.css" />
|
|
</head>
|
|
<body>
|
|
<h1>MPR - Media Processor</h1>
|
|
<p>
|
|
Media transcoding platform with dual execution modes: local (Celery
|
|
+ MinIO) and cloud (AWS Step Functions + Lambda + S3).
|
|
</p>
|
|
|
|
<nav>
|
|
<a href="#overview">System Overview</a>
|
|
<a href="#data-model">Data Model</a>
|
|
<a href="#job-flow">Job Flow</a>
|
|
<a href="#media-storage">Media Storage</a>
|
|
</nav>
|
|
|
|
<h2 id="overview">System Overview</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Local Architecture (Development)</h3>
|
|
<object type="image/svg+xml" data="01a-local-architecture.svg">
|
|
<img
|
|
src="01a-local-architecture.svg"
|
|
alt="Local Architecture"
|
|
/>
|
|
</object>
|
|
<a href="01a-local-architecture.svg" target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
<div class="diagram">
|
|
<h3>AWS Architecture (Production)</h3>
|
|
<object type="image/svg+xml" data="01b-aws-architecture.svg">
|
|
<img
|
|
src="01b-aws-architecture.svg"
|
|
alt="AWS Architecture"
|
|
/>
|
|
</object>
|
|
<a href="01b-aws-architecture.svg" target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Components</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #e8f4f8"></span>
|
|
Reverse Proxy (nginx)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f0f8e8"></span>
|
|
Application Layer (Django Admin, GraphQL API, Timeline UI)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #fff8e8"></span>
|
|
Worker Layer (Celery local mode)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #fde8d0"></span>
|
|
AWS (Step Functions, Lambda - cloud mode)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f8e8f0"></span>
|
|
Data Layer (PostgreSQL, Redis)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f0f0f0"></span>
|
|
S3 Storage (MinIO local / AWS S3 cloud)
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="data-model">Data Model</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Entity Relationships</h3>
|
|
<object type="image/svg+xml" data="02-data-model.svg">
|
|
<img src="02-data-model.svg" alt="Data Model" />
|
|
</object>
|
|
<a href="02-data-model.svg" target="_blank">Open full size</a>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Entities</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #4a90d9"></span>
|
|
MediaAsset - Video/audio files (S3 keys as paths)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #50b050"></span>
|
|
TranscodePreset - Encoding configurations
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #d9534f"></span>
|
|
TranscodeJob - Processing queue (celery_task_id or
|
|
execution_arn)
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="job-flow">Job Flow</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Job Lifecycle</h3>
|
|
<object type="image/svg+xml" data="03-job-flow.svg">
|
|
<img src="03-job-flow.svg" alt="Job Flow" />
|
|
</object>
|
|
<a href="03-job-flow.svg" target="_blank">Open full size</a>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Job States</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #ffc107"></span>
|
|
PENDING - Waiting in queue
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #17a2b8"></span>
|
|
PROCESSING - Worker executing
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #28a745"></span>
|
|
COMPLETED - Success
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #dc3545"></span>
|
|
FAILED - Error occurred
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #6c757d"></span>
|
|
CANCELLED - User cancelled
|
|
</li>
|
|
</ul>
|
|
<h3>Execution Modes</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #e8f4e8"></span>
|
|
Local: Celery + MinIO (S3 API) + FFmpeg
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #fde8d0"></span>
|
|
Lambda: Step Functions + Lambda + AWS S3
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="media-storage">Media Storage</h2>
|
|
<div class="diagram-container">
|
|
<p>
|
|
MPR separates media into input and output paths for flexible
|
|
storage configuration.
|
|
</p>
|
|
<p>
|
|
<a href="04-media-storage.md" target="_blank"
|
|
>View Media Storage Documentation →</a
|
|
>
|
|
</p>
|
|
</div>
|
|
|
|
<h2>API (GraphQL)</h2>
|
|
<pre><code># GraphiQL IDE
|
|
http://mpr.local.ar/graphql
|
|
|
|
# Queries
|
|
query { assets(status: "ready") { id filename duration } }
|
|
query { jobs(status: "processing") { id status progress } }
|
|
query { presets { id name container videoCodec } }
|
|
query { systemStatus { status version } }
|
|
|
|
# Mutations
|
|
mutation { scanMediaFolder { found registered skipped } }
|
|
mutation { createJob(input: { sourceAssetId: "...", presetId: "..." }) { id status } }
|
|
mutation { cancelJob(id: "...") { id status } }
|
|
mutation { retryJob(id: "...") { id status } }
|
|
mutation { updateAsset(id: "...", input: { comments: "..." }) { id comments } }
|
|
mutation { deleteAsset(id: "...") { ok } }
|
|
|
|
# Lambda callback (REST)
|
|
POST /api/jobs/{id}/callback - Lambda completion webhook</code></pre>
|
|
|
|
<h2>Access Points</h2>
|
|
<pre><code># Local development
|
|
127.0.0.1 mpr.local.ar
|
|
http://mpr.local.ar/admin - Django Admin
|
|
http://mpr.local.ar/graphql - GraphiQL
|
|
http://mpr.local.ar/ - Timeline UI
|
|
http://localhost:9001 - MinIO Console
|
|
|
|
# AWS deployment
|
|
https://mpr.mcrn.ar/ - Production</code></pre>
|
|
|
|
<h2>Quick Reference</h2>
|
|
<pre><code># Render SVGs from DOT files
|
|
for f in *.dot; do dot -Tsvg "$f" -o "${f%.dot}.svg"; done
|
|
|
|
# Switch executor mode
|
|
MPR_EXECUTOR=local # Celery + MinIO
|
|
MPR_EXECUTOR=lambda # Step Functions + Lambda + S3</code></pre>
|
|
</body>
|
|
</html>
|