跳到正文
DEV Community· Dang Tran·· 1 小時前AI 評分37

Smile Garden:以微笑澆水、聊天施肥的桌面花園

Smile Garden — smile to water, talk to fertilize

AI 導讀

Smile Garden 是一款使用 Presage SmartSpectra SDK 的桌面花園遊戲,透過鏡頭偵測微笑、説話和伸展動作,分別為植物澆水、施肥和固定。植物按日生長,缺席不會受罰或枯萎;用戶也可改用鍵盤遊玩。攝影機影像在裝置上處理,影片和音訊不會被錄製、上傳或儲存。

正文

Dang Tran

Presage SmartSpectra SDK Challenge Submission

This is a submission for the Presage SmartSpectra SDK Challenge

What I Built

Smile Garden is a calm desktop garden you visit for a few minutes a day.
Instead of clicking to care for plants, you tend each bed with live camera signals from the Presage SmartSpectra SDK:

  • Smile → water your plants
  • Talk to them → fertilize
  • Sunlight arrives on its own from the garden clock (daylight fills sun dots)
  • Some taller plants also need a neck stretch to stake them Plants grow over real days when their daily needs are met. Nothing dies or wilts. Missing a day costs nothing — there’s a weekly visit count, not a streak. Built with Electron + Node.js and @smartspectra/node-sdk (face expression + talking detection + landmarks for stretch), with a keyboard/demo fallback so it runs without a camera or API key.

Demo

Demo video:
| Dawn | Smile → water | Talk → fertilize | Summary |
|---|---|---|---|
|
 |
 |
 |
 |

Code Repository

GitHub: https://github.com/sea2709/smile-garden

Setup

Requirements: Node 20+, a webcam, and a Presage API key with face metrics enabled (register here).

git clone https://github.com/sea2709/smile-garden.git
cd smile-garden
npm install
cp .env.example .env
# set SMARTSPECTRA_API_KEY=...
npm start

No camera or key? Choose Play with keyboard instead (hold S to smile / water, T to talk / fertilize, [ / ] to stretch / stake) so judges can still walk the full loop.
More detail: see the repo README for packaging, privacy notes, and the full SDK call table.

How It Responds to Human Signals

Signal How Smile Garden uses it
Face expression → HAPPY (smoothed, with hysteresis) Fills water dots while you smile at a selected bed (~10 s per dot).
Face talking (detected) Fills fertilizer dots while you talk to the plant (~15 s per dot).
Landmarks / posture (stretch) Completes the optional stake need with a short left/right neck stretch.
Validation / no-face Care waits; soft hints appear if you leave frame or lighting is poor.

Sun dots fill automatically while the garden clock is in daylight — no smile required for sun.
Daily care is per bed, once per day:

  1. Wellness notice once (18+, wellness-only — not a medical device)
  2. Plant seeds / pick a bed that needs tending
  3. Smile to water · talk to fertilize · stretch to stake (when needed)
  4. Harvest when mature · summary of what grew Growth happens when needs are met — plants that are short just wait kindly. Nothing wilts.

Prize Categories

Most Creative or Delightful Use
Smile Garden asks: what if a camera wellness SDK didn’t mean another metric dashboard — just smiling at a tomato and chatting with mint?
Mapping HAPPY → water and talking → fertilizer is playful on purpose. The garden never punishes you. The goal is a tiny daily moment of care, not streaks or medical claims.
(Also eligible for Best Overall Human-Sensing Experience.)

Consent and Data Handling

  • Consent: First launch shows a wellness notice (not a medical device; 18+ checkbox). Camera use requires OS permission. Users can switch to keyboard mode any time.
  • Camera / video: Frames are processed on-device by SmartSpectra. Smile Garden does not record, upload, or store video/audio.
  • App storage: Garden state (beds, journal, visit days, settings) lives in localStorage (smile-garden.v3) on the user’s machine only. No accounts, no cloud sync.
  • Sharing: The app shares nothing with third parties. No optional AI / LLM Insights.
  • Retention / deletion: Clear site/profile storage to wipe the garden. Closing the app stops the camera session.
  • SDK telemetry: On by default per SmartSpectra defaults; opt out with SMARTSPECTRA_TELEMETRY=0. Aggregate session/performance data only — not raw video or physiological values. Details: Telemetry and Privacy.
  • Terms: Wellness / informational only — no diagnosis or treatment claims. Thanks for visiting the garden 🌻

來源:DEV Community · dev.to