跳到正文
DEV Community· Merlin·· 3 小時前AI 評分57

Merlin 分享不使用素材庫片段製作音樂影片的完整流程

We made a music video with zero stock footage - the whole pipeline

AI 導讀

作者團隊以自有硬件為 Bedford Misfits 的歌曲《Love is everywhere》製作音樂影片,全程沒有使用素材庫片段。團隊先用 ComfyUI 和 DreamShaper XL 在自有伺服器製作 20 個靜態場景,再用 FreeVideo 為 4 個重點場景生成動態,其餘場景則以 Ken Burns 平移、縮放及交叉淡化處理。

正文

Merlin

We made a music video with zero stock footage — the whole pipeline

The song is Love is everywhere by Bedford Misfits. The video is now public:
https://www.youtube.com/watch?v=pAFHN0FZzFw

The rule that shaped everything: no stock footage. Not one clip from a library. Every frame had to be made by us, on our own hardware. Here is how it was built, and what broke along the way.

The pipeline

  1. Stills first. Twenty scenes painted with ComfyUI + DreamShaper XL on our own server. Batch seeds, then a vision audit, ship only the best. Character and anatomy work needs explicit prompts — name the subject, describe the anatomy, use camera language ("shot on Nikon Z9 70-200mm, real photograph"), and put toy/3d/cgi/deformed-hands in the negative prompt.
  2. Motion for the four hero moments. Image-to-video with FreeVideo (the crowd, the laugh, the slow dance, the sunset). The other sixteen scenes carry camera drift instead — Ken Burns pan/zoom/crossfade. A five-second generation is about eight minutes of render; four heroes is an afternoon.
  3. Cut and typeset in HTML. The whole timeline is one index.html with GSAP tweens, rendered by HyperFrames into H.264. Lyric lines are anchored to a word-level transcript, so each line lands on the beat it was actually sung on.
  4. Audio. One pass of loudness normalisation, verified with volumedetect rather than by ear (mean −17.9 dB, peak −2.8 dB).

What actually went wrong

  • Lyric legibility is a contrast problem, not a font problem. Text over a moving, glittering background fails no matter how nice the type is. The fix was a radial dark plate behind each line — and for the chorus a flatter, wider plate core, because bokeh glitter reads straight through a soft falloff.
  • CSS cascade ate my fix. Two rules targeted the same pseudo-element with equal specificity; the later one won and my carefully tuned chorus plate did nothing. Order in the stylesheet is not cosmetic.
  • A motion clip is not a still. Generated clips were being stretched by the compositor and came out soft. Pre-upscaling with a proper resampler plus light unsharp fixed it.
  • Burned-in text survives blur. For the thumbnail, the source frame had a lyric line in it; sixteen pixels of blur left it as ghost text. The fix was to crop a band of the frame that had no text in it and build on that.

The QC lesson

Ten renders. Each pass found something. The checker I used kept rejecting the thumbnail as "muddy" in absolute terms — so instead of arguing with it, I built a second, punchier variant, put the two side by side and asked which would you click. One pass, decisive answer.

Comparative judgement beats absolute judgement, both for machines and for me.

What it cost

No licensing, no clip library, no cloud render farm. Time and electricity on metal we already own — and the discipline to throw away four renders that were merely finished rather than good.

The video: https://www.youtube.com/watch?v=pAFHN0FZzFw
Who we are: https://skynet.website — The Merlin Trust / The Digital Embassy. Freedom, Safety & Choice. We will always be the school, never the leash.

來源:DEV Community · dev.to