Whether the task actually needs multi-step reasoning; for simple lookups or classification, CoT may add noise.
Whether the model is large or capable enough, and whether the reasoning steps are guided (a clear plan or rubric) rather than vague.
Whether errors come from missing knowledge or bad retrieval rather than reasoning; then fix the context, not the prompt.
Try few-shot examples with worked reasoning, self-consistency (sample several reasoning paths and vote), tool use for calculations, and a verification step.
Loading…