Back to Projects

StayUpdated

•Multimodal Fact-Checking Engine
Python
FastAPI
Meta Llama 3.3 (70B)
Groq LPUs
OpenAI Whisper v3
Salesforce BLIP
EasyOCR
PyTorch
OpenCV
DuckDuckGo RAG
Next.js 15
Supabase

In an era of generative hallucinations and viral synthetic media, distinguishing factual reporting from fabricated narratives requires verifying multiple sensory modalities simultaneously. StayUpdated is an automated fact-checking engine that algorithmically validates text, PDFs, images, and videos by combining vision models, audio transcription, OCR scanning, and live web retrieval into an integrated verification verdict.

Tri-Modal Video Decomposition Stream

When evaluating video files for synthetic manipulation, MoviePy decouples the audio track while OpenCV samples silent video frames every 5 seconds. Audio is routed to OpenAI Whisper Large v3 on Groq LPUs for rapid transcription, while sampled visual frames are processed locally through Salesforce BLIP to assemble a continuous chronological scene log.

Optical Text Extraction & Cognitive Fusion

Concurrently runs EasyOCR over video frames and image uploads to detect embedded watermarks, dynamic news tickers, and subtitles. The pipeline bundles the audio transcript, visual scene descriptions, and extracted overlay text into a unified context packet, passing it to Meta Llama 3.3 (70B) to detect contradictions between spoken dialogue and visual representations.

Real-Time Web Verification & Deepfake Audit

Cross-references extracted claims against current real-world publications using a DuckDuckGo Search retrieval engine. Llama 3.3 cross-checks findings against live news coverage to confirm whether referenced events truly occurred, compiling an automated JSON verification audit with multidimensional confidence scores and source citations.

✦
Hey there! 👋

Abhinandan Ghosh

Based in West Bengal, India•
IST
Crafted with code & chai ☕