Quality and diversity matter more than quantity: a few hundred to a few thousand clean, representative examples often suffice for style and format changes; harder skills need more.
Examples must match the real prompt format, cover edge cases, and have consistent, correct outputs; noisy labels directly teach the model mistakes.
Hold out a validation set, watch for duplicates and leakage with the evaluation data, and compare against a strong prompting baseline.
Loading…