re-publisher

01 / The task

Telegram posts to topic channels in MAX

I wanted to sort a stream from multiple channels without copying every post by hand. I built a pipeline that shows why a post matched, what OCR read and where it was sent.

Use case: My workspace for topic feeds. MAX channels are public; the administrative interface requires a password.

Work done

• New-message collection with Telethon; storage of originals, attachments and processing states.
• Corpus annotation with Codex, local TF-IDF and MiniLM training, model versions and run history.
• Filter builder, label dictionary and separate text/OCR scores.
• MAX sender, delivery verification, queue, retries, migrations and deployment.

03 / Technology

Stack

Shares use Git application-file bytes at pinned revisions. Each file belongs to one subsystem under scripts/generate-stack-share.mjs rules; tests, assets, dependencies and generated files are excluded. Rounded to 0.1%. This describes code composition, not proficiency.

04 / Decisions

How the project works

• A new_only collector receives new messages. The old unprocessed buffer is not processed automatically.
• Separate processes: web, collector, coordinator, TF-IDF, MiniLM, OCR and the MAX sender. Queues and results are stored in PostgreSQL.
• RapidOCR reads images and static video previews. OCR text is not appended to a publication.
• A missing score stays unknown. Filters support categories, subcategories, model features, length and nested AND / OR / NOT.
• The original post is sent with media and a Source link. There is no additional extracted-links block.

05 / Verification

Demo workflows

1. Open the public MAX channels and an example repost.
2. With owner access, open the board: Received → Sorted → Filtered → Source attribution → Ready.
3. Open a card and select post text or OCR as the result input. Compare saved runs.
4. Open a filter and inspect its model, conditions, label and matching preview evidence.
5. In MAX history, inspect the destination, delivery state, saved link and errors.

Check results

• Nine MAX channels are connected. The initial batch contains 180 publications, 20 per channel. Sending of new matching posts is enabled.
• The captured history includes later deliveries. The publication count changes as new messages arrive.

Limitations

• Corpus labels were assigned by Codex. Model measurements describe agreement with those labels, not independent human accuracy.
• The beginner and humor routes are experimental. Beginners: 57/65 test matches; OCR humor: 92/104 validation matches. The agreed quality gates were not passed.
• OCR does not understand an image without text, listen to audio or inspect the whole video. Reading errors need review.
• Media over 100 MB and unavailable album parts block automatic readiness. The interface contains stopped cards.
• Screenshot counters and timings are a state snapshot, not a performance guarantee.