Smile Garden:以微笑澆水、聊天施肥的桌面花園
Smile Garden — smile to water, talk to fertilize
Smile Garden 是一款使用 Presage SmartSpectra SDK 的桌面花園遊戲,透過鏡頭偵測微笑、説話和伸展動作,分別為植物澆水、施肥和固定。植物按日生長,缺席不會受罰或枯萎;用戶也可改用鍵盤遊玩。攝影機影像在裝置上處理,影片和音訊不會被錄製、上傳或儲存。
Presage SmartSpectra SDK Challenge Submission
This is a submission for the Presage SmartSpectra SDK Challenge
What I Built
Smile Garden is a calm desktop garden you visit for a few minutes a day.
Instead of clicking to care for plants, you tend each bed with live camera signals from the Presage SmartSpectra SDK:
- Smile → water your plants
- Talk to them → fertilize
- Sunlight arrives on its own from the garden clock (daylight fills sun dots)
- Some taller plants also need a neck stretch to stake them
Plants grow over real days when their daily needs are met. Nothing dies or wilts. Missing a day costs nothing — there’s a weekly visit count, not a streak.
Built with Electron + Node.js and
@smartspectra/node-sdk(face expression + talking detection + landmarks for stretch), with a keyboard/demo fallback so it runs without a camera or API key.
Demo
Demo video:
| Dawn | Smile → water | Talk → fertilize | Summary |
|---|---|---|---|
|
|
|
|
|
Code Repository
GitHub: https://github.com/sea2709/smile-garden
Setup
Requirements: Node 20+, a webcam, and a Presage API key with face metrics enabled (register here).
git clone https://github.com/sea2709/smile-garden.git
cd smile-garden
npm install
cp .env.example .env
# set SMARTSPECTRA_API_KEY=...
npm start
No camera or key? Choose Play with keyboard instead (hold S to smile / water, T to talk / fertilize, [ / ] to stretch / stake) so judges can still walk the full loop.
More detail: see the repo README for packaging, privacy notes, and the full SDK call table.
How It Responds to Human Signals
| Signal | How Smile Garden uses it |
|---|---|
| Face expression → HAPPY (smoothed, with hysteresis) | Fills water dots while you smile at a selected bed (~10 s per dot). |
Face talking (detected) |
Fills fertilizer dots while you talk to the plant (~15 s per dot). |
| Landmarks / posture (stretch) | Completes the optional stake need with a short left/right neck stretch. |
| Validation / no-face | Care waits; soft hints appear if you leave frame or lighting is poor. |
Sun dots fill automatically while the garden clock is in daylight — no smile required for sun.
Daily care is per bed, once per day:
- Wellness notice once (18+, wellness-only — not a medical device)
- Plant seeds / pick a bed that needs tending
- Smile to water · talk to fertilize · stretch to stake (when needed)
- Harvest when mature · summary of what grew Growth happens when needs are met — plants that are short just wait kindly. Nothing wilts.
Prize Categories
Most Creative or Delightful Use
Smile Garden asks: what if a camera wellness SDK didn’t mean another metric dashboard — just smiling at a tomato and chatting with mint?
Mapping HAPPY → water and talking → fertilizer is playful on purpose. The garden never punishes you. The goal is a tiny daily moment of care, not streaks or medical claims.
(Also eligible for Best Overall Human-Sensing Experience.)
Consent and Data Handling
- Consent: First launch shows a wellness notice (not a medical device; 18+ checkbox). Camera use requires OS permission. Users can switch to keyboard mode any time.
- Camera / video: Frames are processed on-device by SmartSpectra. Smile Garden does not record, upload, or store video/audio.
-
App storage: Garden state (beds, journal, visit days, settings) lives in
localStorage(smile-garden.v3) on the user’s machine only. No accounts, no cloud sync. - Sharing: The app shares nothing with third parties. No optional AI / LLM Insights.
- Retention / deletion: Clear site/profile storage to wipe the garden. Closing the app stops the camera session.
-
SDK telemetry: On by default per SmartSpectra defaults; opt out with
SMARTSPECTRA_TELEMETRY=0. Aggregate session/performance data only — not raw video or physiological values. Details: Telemetry and Privacy. - Terms: Wellness / informational only — no diagnosis or treatment claims. Thanks for visiting the garden 🌻
來源:DEV Community · dev.to