256 lines
9.1 KiB
HTML
256 lines
9.1 KiB
HTML
<!doctype html>
|
|
<html lang="en">
|
|
<head>
|
|
<meta charset="UTF-8" />
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
|
|
<title>MPR - Architecture</title>
|
|
<link rel="stylesheet" href="architecture/styles.css" />
|
|
</head>
|
|
<body>
|
|
<h1>MPR - Media Processor</h1>
|
|
<p>
|
|
Media transcoding platform with dual execution modes: local (Celery
|
|
+ MinIO) and cloud (AWS Step Functions + Lambda + S3).
|
|
</p>
|
|
|
|
<nav>
|
|
<a href="#overview">System Overview</a>
|
|
<a href="#data-model">Data Model</a>
|
|
<a href="#job-flow">Job Flow</a>
|
|
<a href="#media-storage">Media Storage</a>
|
|
</nav>
|
|
|
|
<h2 id="overview">System Overview</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Local Architecture (Development)</h3>
|
|
<object
|
|
type="image/svg+xml"
|
|
data="architecture/01a-local-architecture.svg"
|
|
>
|
|
<img
|
|
src="architecture/01a-local-architecture.svg"
|
|
alt="Local Architecture"
|
|
/>
|
|
</object>
|
|
<a
|
|
href="architecture/01a-local-architecture.svg"
|
|
target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
<div class="diagram">
|
|
<h3>AWS Architecture (Production)</h3>
|
|
<object
|
|
type="image/svg+xml"
|
|
data="architecture/01b-aws-architecture.svg"
|
|
>
|
|
<img
|
|
src="architecture/01b-aws-architecture.svg"
|
|
alt="AWS Architecture"
|
|
/>
|
|
</object>
|
|
<a href="architecture/01b-aws-architecture.svg" target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Components</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #e8f4f8"></span>
|
|
Reverse Proxy (nginx)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f0f8e8"></span>
|
|
Application Layer (Django Admin, FastAPI + GraphQL, Timeline
|
|
UI)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #fff8e8"></span>
|
|
Worker Layer (Celery local mode)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #fde8d0"></span>
|
|
AWS (Step Functions, Lambda - cloud mode)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f8e8f0"></span>
|
|
Data Layer (PostgreSQL, Redis)
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #f0f0f0"></span>
|
|
S3 Storage (MinIO local / AWS S3 cloud)
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="data-model">Data Model</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Entity Relationships</h3>
|
|
<object
|
|
type="image/svg+xml"
|
|
data="architecture/02-data-model.svg"
|
|
>
|
|
<img
|
|
src="architecture/02-data-model.svg"
|
|
alt="Data Model"
|
|
/>
|
|
</object>
|
|
<a href="architecture/02-data-model.svg" target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Entities</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #4a90d9"></span>
|
|
MediaAsset - Video/audio files with metadata
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #50b050"></span>
|
|
TranscodePreset - Encoding configurations
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #d9534f"></span>
|
|
TranscodeJob - Processing queue items
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="job-flow">Job Flow</h2>
|
|
<div class="diagram-container">
|
|
<div class="diagram">
|
|
<h3>Job Lifecycle</h3>
|
|
<object
|
|
type="image/svg+xml"
|
|
data="architecture/03-job-flow.svg"
|
|
>
|
|
<img src="architecture/03-job-flow.svg" alt="Job Flow" />
|
|
</object>
|
|
<a href="architecture/03-job-flow.svg" target="_blank"
|
|
>Open full size</a
|
|
>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Job States</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #ffc107"></span>
|
|
PENDING - Waiting in queue
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #17a2b8"></span>
|
|
PROCESSING - Worker executing
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #28a745"></span>
|
|
COMPLETED - Success
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #dc3545"></span>
|
|
FAILED - Error occurred
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #6c757d"></span>
|
|
CANCELLED - User cancelled
|
|
</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<h2 id="media-storage">Media Storage</h2>
|
|
<div class="diagram-container">
|
|
<p>
|
|
MPR separates media into <strong>input</strong> and
|
|
<strong>output</strong> paths, each independently configurable.
|
|
File paths are stored
|
|
<strong>relative to their respective root</strong> to ensure
|
|
portability between local development and cloud deployments (AWS
|
|
S3, etc.).
|
|
</p>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Input / Output Separation</h3>
|
|
<ul>
|
|
<li>
|
|
<span class="color-box" style="background: #4a90d9"></span>
|
|
<code>MEDIA_IN</code> - Source media files to process
|
|
</li>
|
|
<li>
|
|
<span class="color-box" style="background: #50b050"></span>
|
|
<code>MEDIA_OUT</code> - Transcoded/trimmed output files
|
|
</li>
|
|
</ul>
|
|
<p><strong>Why Relative Paths?</strong></p>
|
|
<ul>
|
|
<li>Portability: Same database works locally and in cloud</li>
|
|
<li>Flexibility: Easy to switch between storage backends</li>
|
|
<li>Simplicity: No need to update paths when migrating</li>
|
|
</ul>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>Local Development</h3>
|
|
<pre><code>MEDIA_IN=/app/media/in
|
|
MEDIA_OUT=/app/media/out
|
|
|
|
/app/media/
|
|
├── in/ # Source files
|
|
│ ├── video1.mp4
|
|
│ └── subfolder/video3.mp4
|
|
└── out/ # Transcoded output
|
|
└── video1_h264.mp4</code></pre>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>AWS/Cloud Deployment</h3>
|
|
<pre><code>MEDIA_IN=s3://source-bucket/media/
|
|
MEDIA_OUT=s3://output-bucket/transcoded/
|
|
MEDIA_BASE_URL=https://source-bucket.s3.amazonaws.com/media/</code></pre>
|
|
<p>
|
|
Database paths remain unchanged (already relative). Just upload
|
|
files to S3 and update environment variables.
|
|
</p>
|
|
</div>
|
|
|
|
<div class="legend">
|
|
<h3>API Endpoints</h3>
|
|
<ul>
|
|
<li>
|
|
<code>POST /api/assets/scan</code> - Recursively scans
|
|
MEDIA_IN and registers video/audio files
|
|
</li>
|
|
<li>
|
|
<code>POST /api/jobs/</code> - Creates transcoding job with
|
|
source asset, preset, and optional trim times
|
|
</li>
|
|
</ul>
|
|
<p><strong>Supported File Types:</strong></p>
|
|
<p>
|
|
Video: mp4, mkv, avi, mov, webm, flv, wmv, m4v<br />
|
|
Audio: mp3, wav, flac, aac, ogg, m4a
|
|
</p>
|
|
</div>
|
|
|
|
<h2>Quick Reference</h2>
|
|
|
|
<h2>Access Points</h2>
|
|
<pre><code># Add to /etc/hosts
|
|
127.0.0.1 mpr.local.ar
|
|
|
|
# URLs
|
|
http://mpr.local.ar/admin - Django Admin
|
|
http://mpr.local.ar/api - FastAPI (docs at /api/docs)
|
|
http://mpr.local.ar/ui - Timeline UI</code></pre>
|
|
</body>
|
|
</html>
|