Déjà 讓用戶透過本機螢幕記錄找回昨日看過的酒店
What was that hotel? Asking my laptop about yesterday
開發者 Phantom842 建成 Déjà,一款在手提電腦本機記錄螢幕並可透過對話搜尋過往畫面的工具。Déjà 每隔數秒檢查畫面變化,RapidOCR 約 5 秒在 CPU 上辨識訂房頁面;faster-whisper 不到 1 秒將語音轉成文字,再由搜尋選出匹配畫面,交 Gemma 3 1B(透過 Ollama)閲讀前五項並圈出答案所據截圖。
Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle Submission 💸
This is a submission for the Hacktoberfest Open-Source AI Challenge, Week 2: Side Hustle.
Built with: RapidOCR (PP-OCR on ONNX Runtime), faster-whisper, Gemma 3 1B via Ollama, SQLite FTS5, python-mss. All open source, all running locally.
Yesterday I had a hotel open in a tab. Today I couldn't remember its name. So I built Déjà, a memory of my own screen that I can talk to.
Asking Déjà about a hotel: it answers in one line and circles the screenshot it came from
Try the demo · Windows download · Code
Yesterday
Every few seconds Déjà checks whether the screen changed. When the booking page appeared, RapidOCR read it in about 5 seconds on the CPU. Secrets like API keys and card numbers were blacked out first. Password managers, private windows and the lock screen are never read at all. The text and a small screenshot went to disk, encrypted with a key only my Windows account can open.
Today
I asked out loud. Whisper turned it into text in under a second. Plain search found the matching screens, and only then did Gemma 3 1B read the top five and answer: "That was the Hotel Mirador in Lisbon," with the screenshot circled. If the model ever puts a number in its answer that isn't on those screens, the answer is thrown out and the matching line is quoted instead.
Why open
A cloud API would mean uploading my screen every few seconds, paying for thousands of calls a day, and nothing working offline. Here everything runs on the laptop, for free, and nothing leaves it. Open models also let me test the OCR myself: 99.7% of words on normal screens.
Who'd pay
Freelancers, developers, students: anyone who has said "I just saw that". It runs on an ordinary laptop with no server, so it can be a one-time purchase instead of a subscription.
AI disclosure: AI assistance was used for this project. I did the planning and laid the base foundations; the rest of the coding was done by a team of AI agents led by Claude (Anthropic). I left the debugging for myself so that I am accountable for the code.*
來源:DEV Community · dev.to

