πŸ”

Did fine-tuning break anything?

You fine-tuned for better customer service tone. The tone improved. Three weeks later: your model can no longer handle refund requests β€” a capability that wasn't in the fine-tuning data at all. Catastrophic forgetting hit a feature you never intended to change.

1 / 10