doocus first ver

doocus/README.md

@@ -0,0 +1,76 @@
+# doocus — local document extraction
+
+The document twin of meetus. Turns locally-downloaded files (Drive exports,
+PDFs, images, ...) into a shareable **textified** product (`content.md`) plus
+structured `meta.json`, mirroring the meetus `output/<run>/` contract.
+
+Extraction is **deterministic and offline** — no cloud AI touches the raw source.
+The textified output is what feeds permitted services (Gemini web, NotebookLM)
+and the local search index; the raw source stays on disk.
+
+## Quick start
+
+```bash
+# one document
+python process_doc.py notes.docx                 # → docs-output/<YYYYMMDD-NNN-notes>/
+python process_doc.py report.pdf --render        # also render page 1 → thumb.jpg
+python process_doc.py scan.png --ocr             # OCR the image into content.md
+
+# a whole downloaded folder (mirrors the input tree)
+make docs IN="/mnt/win/drive"                    # → docs-output/...
+make docs IN="..." DOC_EXTRA="--render --ocr"
+make docs-dry IN="..."                           # list what would run
+```
+
+## Output contract
+
+```
+docs-output/<YYYYMMDD-NNN-stem>/
+  content.md      textified document — the shareable product
+  meta.json       source info, sha256, dates, author, title, pages/sheets/slides, word_count, warnings
+  thumb.jpg       optional single preview (image / rendered page / video frame)
+  manifest.json   run config + outputs inventory + source pointer (path, not a copy)
+```
+
+## Supported types
+
+| Family  | Extensions              | Notes |
+|---------|-------------------------|-------|
+| text    | md, txt, yaml/yml, json | passthrough; json/yaml add a structure summary |
+| tabular | csv                     | markdown table + row/col metadata (stdlib) |
+| office  | docx, pptx, xlsx        | text + core properties (author, dates, title) |
+| pdf     | pdf                     | text per page + info dict; `--render` for page-1 thumb |
+| web     | html/htm                | visible text + title/meta tags |
+| image   | jpg/jpeg, png           | EXIF (incl. capture date) + thumbnail; `--ocr` for text |
+| media   | mp4                     | ffprobe metadata + thumbnail; **delegates transcription to meetus** |
+
+Each extractor is isolated: a missing optional dependency or a corrupt file is
+recorded as a warning in `meta.json`, never aborting a batch (same resilience as
+`ctrl/batch.sh`).
+
+## Dependencies
+
+Core text/tabular use only the stdlib. Everything else is a uv group in the
+repo's `pyproject.toml`:
+
+```bash
+uv sync --group doocus                 # Pillow, PyYAML, python-docx, python-pptx,
+                                       # openpyxl, pypdf, beautifulsoup4, lxml
+uv sync --group doocus --group ocr     # + pytesseract (needs system `tesseract`)
+```
+
+`mp4` uses system `ffmpeg`/`ffprobe` (shared with meetus). PDF page rendering
+(`--render`) additionally needs the `pdf-render` group (`pdf2image`) + system
+`poppler`.
+
+## Browser UI
+
+`ui/doocus-app/` (sibling of `ui/meetus-app/`, shares `ui/framework/`) browses the
+extracted docs with per-type viewers, a metadata panel, and a package builder
+that zips the **original file + content.md + meta.json** per doc for a chosen
+target (Gemini web / NotebookLM):
+
+```bash
+cd ui/doocus-app && npm install
+DOOCUS_OUTPUT=/path/to/docs-output npm run dev
+```