Skip to content

About

No description, website, or topics provided.

Resources

Stars

7 stars

Watchers

0 watching

Forks

Repository files navigation

finger-read

Your hands are busy. Keep reading anyway.

finger-read lets you read on your computer without touching it. Your webcam watches your hand, and three simple poses control the page — scroll a recipe with flour on your fingers, page through a paper over lunch, or lean back and read from across the room.

finger-read in action — click for the full-quality video

🖐️ Try it live → sophiamyang.github.io/finger-read · ▶ full-quality video

Do this The page…
☝️ 👎 Point your index finger — any direction — or hold a thumbs-down …scrolls or pans that way, and keeps moving until you stop
✋ Wave an open palm left or right …turns to the next or previous page
🤏 Touch thumb and index together, then spread or close …zooms in or out

There is nothing to learn beyond that. Scrolling is a held pose — no repeated flicking, no running out of arm. A wave turns exactly one page, even when your hand swings back.

Read your own documents

Drop a PDF onto the page (or press Open PDF) and it opens like a book: two pages side by side, sized to your screen. Images and plain-text notes work too, and you can keep several documents open and flip between them. Prefer one long page? The toolbar switches to a continuous scroll view. Arrow keys work whenever your hands are back on the keyboard.

Your camera is only a small tile in the corner — the document is the star — and you can drag the tile's top-left corner to make it any size you like. And everything happens on your device: camera frames, your files, and the reading itself never leave the browser. No account, no upload, no analytics.

Try it

Nothing to install: open sophiamyang.github.io/finger-read in a browser with a webcam.

To run it locally instead, you need Node.js 22.13+ and pnpm:

pnpm install
pnpm dev

Open the address it prints, press Start camera in the corner tile, and give it a hand. A built-in six-page sample guide is one click away if you want something to practice on.

Take it into Chrome

The finger-read extension brings the same poses to real websites: thumbs scroll any page, a wave switches tabs, a pinch zooms.

pnpm extension:package

Then unzip public/finger-read-chrome-extension.zip, open chrome://extensions, turn on Developer mode, choose Load unpacked, and pick the finger-read-extension folder. Click the finger-read icon in the toolbar, press Start finger-read, and keep the side panel open while you browse — it holds the camera.

The extension carries its own copy of the hand-tracking model, so it makes no network requests at all — a test suite fails if any networking ever appears in its code. When you press Start, Chrome asks whether finger-read may scroll the pages you visit; say no and tab switching and zoom still work. Two limits to know about: Chrome keeps extensions off its own pages (chrome://…), and local PDF files need Allow access to file URLs turned on in the extension's details.

Make it yours

The Speed slider in the toolbar sets how fast a held thumb scrolls. If a pose triggers too easily or not easily enough, every threshold lives in one file, gesture-config.json — wave sensitivity, zoom strength, pose strictness. After editing, carry the change into the extension:

pnpm gesture:sync && pnpm extension:package

For developers

The reader is a static Next.js export (pnpm build → out/), the extension is plain Manifest V3, and both share one small pose engine. pnpm lint and pnpm test check everything, and CI runs both on every push.

About

No description, website, or topics provided.

Resources

Stars

7 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages