跳到正文
DEV Community· Valenx·· 10 天前AI 評分46

微調與上下文學習有何分別?

Fine-tuning vs in-context learning: what is the difference?

AI 導讀

上下文學習在提示詞加入指示和例子,不改動模型權重;微調則透過例子訓練模型並更新參數,令格式、語氣或特定任務的表現更一致。上下文學習方便即時修改,但每次請求都要處理額外提示詞 token,且受上下文窗口限制;微調則需要準備數據、訓練、評估及重新部署。對於經常變動的資訊,檢索較合適,因為更新資訊來源無需重新訓練。

正文

Valenx

Valenx

Posted on Nov 11 AI-assisted

What the interviewer is testing

Whether you can distinguish prompt-based learning from weight updates, compare their costs and deployment needs, and choose retrieval for frequently changing facts.

Answer framework

  • In-context learning puts instructions and examples into the prompt without changing the model weights.
  • In-context learning supports immediate iteration, but each request pays for the extra prompt tokens and behavior remains bounded by the context window.
  • Fine-tuning trains on examples and updates model parameters, potentially making formats, tone or narrow-task behavior more consistent.
  • Fine-tuning can make a smaller model perform as well as a larger prompted model, but it requires data, training, evaluation and redeployment.
  • Use retrieval rather than fine-tuning for facts that change frequently, because retrieval lets the source of truth be updated without retraining.

Sample answer

I would start by separating what changes. With in-context learning, I put the instructions and any examples directly into the prompt. The model parameters do not change, so I can iterate immediately by editing the prompt. The tradeoff is that every request carries and processes the extra prompt tokens, and the behavior I can obtain is constrained by the context window. It is a good fit when the task is quick to prototype, the instructions change often, or I want temporary behavior without a training run.

Fine-tuning is different because I train the model on examples and update model parameters. That can make the desired format, tone or narrow task behavior more consistent and can make a smaller model perform as well as a larger model that only receives examples in its prompt. These benefits require evaluation. Learned behavior can reduce how much instruction I need to supply on every call.

I would also be explicit about the cost. Fine-tuning requires curating data, running training and evaluating whether the result improved. After deployment, a changed model normally means redeployment. I would not use fine-tuning as my default way to teach frequently changing facts. retrieval is better because it lets me update the source of truth without retraining. So I choose based on whether I need durable behavior changes or current information, and whether the per-request prompt cost matters.

Likely follow-ups

When would I choose in-context learning over fine-tuning? I would choose it when I need immediate iteration, temporary instructions or examples, or a quick prototype. I would also consider it when the extra prompt tokens and context-window limits are acceptable.

Can fine-tuning be a good way to add frequently changing facts? Usually not. Fine-tuning is poorly suited to frequently changing information because each update requires training data, evaluation and redeployment. I would use retrieval so the information source can be updated independently.

What operational work does fine-tuning add? I need to collect and curate training examples, run training, evaluate the result and deploy the updated model. Prompt-only changes also require evaluation and may require curated examples, but they do not require model training.

Common mistakes

  • Treating in-context learning as a training step that changes model weights.
  • Claiming prompt examples are permanently learned and no longer consume context tokens on each request.
  • Using fine-tuning as the default solution for frequently changing facts.
  • Comparing the approaches only on answer quality while ignoring prompt cost, context limits, training data, evaluation and redeployment.

This article was prepared with AI assistance and reviewed before publishing. The original lives on the free question bank:

https://johnnnmai.github.io/ai-engineer-interview-questions/questions/fine-tuning-vs-in-context-learning/?utm_source=devto&utm_medium=community&utm_campaign=fine-tuning-vs-in-context-learning

來源:DEV Community · dev.to