Microsoft released a paper on progressive learning and fine-tuning using chain-of-though style data produces impressive results with little compute resource.

From the paper:

Our research indicates that learning from step-by-step explanations, whether these are generated by humans or more advanced AI models, is a promising direction to improve model capabilities and skills.