跳到正文
DEV Community· Michael Hairetis·· 4 小時前AI 評分48

我花數星期調校 OCR 流程,視覺模型九秒內勝出

I tuned an OCR pipeline for weeks. A vision model beat it in nine seconds.

AI 導讀

作者花數星期調校本地 OCR 流程,但視覺模型在相同照片上只用九秒便勝過該流程。閲讀教練以孩子拍攝的手寫頁面為輸入,遇上無法有信心辨認的字詞便要求重拍,不會評分。測試共進行 22 次,周轉時間中位數為 169 秒,索引了 3 本書及 20,726 個字,並生成 566 道涵蓋九個科目的題目。

正文

Michael Hairetis

I spent weeks tuning a local OCR pipeline. Downscaling, adaptive thresholding, per-word confidence filtering, all of it.

A vision model beat it in nine seconds on the same photographs.

Here is the constraint that got me there. I built a reading coach for my two kids, and the reading and the writing do not happen on a screen. The child reads a physical book, writes about the chapter by hand, and photographs the page. That photograph is the system's entire input.

Everything interesting in the project falls out of that one decision.

The OCR. Real photographs of a paperback taken by a child have curved pages, bad light and a thumb in the frame. My tuned pipeline produced gibberish on exactly the input it was built for. The vision model read it cold. The local pipeline is still there as a fallback for when the primary is unreachable, which turns out to be the right place for it.

Refusing to answer is a feature. If handwriting cannot be read with confidence the app does not grade it. It names the words it could not resolve and asks for the page again. An app that guesses at illegible writing and then grades its own guess teaches a child that the machine is arbitrary.

One grader does not fit every subject. Every marker wants the final answer correct, except the Fermi one. That passes anything within a factor of ten and fails a bare number with no working behind it, even when the number is right. I tested it with the correct answer and no reasoning, and it refused it.

The bug I could not have predicted. "Draw the next two steps of the pattern, then take a photo" is itself a reading test. My seven-year-old could not get past it. The software was working perfectly and was completely unusable without an adult sitting next to her. Every instruction now has a read-aloud button.

22 sessions. 169 second median turnaround. 3 books and 20,726 words indexed. 566 generated items across nine subjects.

https://openred.space/blog/verso-kids-read-real-books.html

來源:DEV Community · dev.to