跳到正文
DEV Community· 赵yj·· 14 天前AI 評分46

OBS 瀏覽器即時虛擬化身鏡頭:無需動作捕捉設備

Browser-based live avatar camera for OBS (no mocap rig)

AI 導讀

瀏覽器即時虛擬化身流程可在無需動作捕捉設備下,把攝影機影像轉換後透過 OBS 虛擬攝影機,供直播及視像通話使用。LiveSwap 按這套流程打造,提供 30 個免費額度供用戶測試;流程亦須注意延遲、光線及音畫同步。

正文

赵yj

I've been experimenting with getting a live avatar into streams and video calls without a mocap rig. Here's the pipeline that worked for me, plus the pitfalls.

The pipeline

  1. Capture: navigator.mediaDevices.getUserMedia({ video: { width: 1280, height: 720, frameRate: 30 } }) gives you the webcam stream in the browser.
  2. Transform: each frame (or a downscaled copy) is sent through an avatar/restyle model. Latency is the main constraint, so keep input resolution modest and avoid blocking the render loop.
  3. Render: draw the result to a <canvas> and keep it visible in a dedicated tab or window.
  4. Expose to apps: in OBS, add a Window Capture or Browser Source of that canvas, then enable Start Virtual Camera. Zoom, Meet, Teams, Discord and Twitch Studio can now pick "OBS Virtual Camera" as the webcam.

Pitfalls

  • Latency: aim for a steady frame rate over peak quality; viewers notice jitter more than softness.
  • Lighting: even front lighting makes face tracking noticeably more stable.
  • Permissions: only use reference images you have the rights to use.
  • Audio sync: if the video lags, add a small audio delay filter in OBS.

Try it

I work on LiveSwap, a browser-based live avatar camera built around this workflow (disclosure: it's my project). It has a free tier with 30 credits, so you can test the OBS virtual camera setup without paying. I'd be glad to hear which latency and quality trade-offs matter most in your setups.

來源:DEV Community · dev.to