為甚麼要讓神經網絡重試，再只從最佳答案學習？

Training a neural network can take a lot of time. I used to think the obvious fix was simply to make the model smaller or find faster hardware. Those can help, but I’ve learned that training time has several possible bottlenecks: the model’s architecture, the way it processes data and updates its weights, and how effectively it uses the hardware.

That led me to a more surprising question: What if a model generated several answers, but learned only from the best one?
The idea sounds simple. A model produces multiple candidate outputs. A scoring method picks the strongest candidate, and training focuses on that one. Instead of treating every attempt as equally useful, the model gives its learning signal to the answer that best meets the goal.

I found connections to selective backpropagation and rejection sampling. Selective backpropagation chooses which examples contribute to the model’s gradient updates. In some reinforcement learning fine-tuning methods, rejection sampling filters generated answers so that preferred ones can be used for further training. They share a broad idea—being selective about what the model learns from but they are not the same technique.

I also came across early exit architectures, which sound related but solve a different problem. They let a model stop processing an input early when it already has a confident answer. That can save computation during inference. It does not, by itself, mean generating multiple answers and training on only the best one.
The catch is that “try several and keep the best” is not automatically faster. Generating and scoring extra answers costs time, and the scoring method has to choose well. If it takes too much effort to find the winner or if the winner is not actually useful the approach may not save training time.

What I learned is that speeding up training isn’t only about making every step faster. It can also mean asking which steps are worth taking at all. The challenge is finding the right balance: give the model enough chances to produce a strong answer, then make sure the learning signal goes to the attempts that genuinely help it improve.