Skip to content

Conversation

@mtake
Copy link
Contributor

@mtake mtake commented Jul 28, 2025

This tutorial aims to guide you through building a model with fine-tuning followed by interpolation.
Based on the tutorial for building a reasoning model, this tutorial has the minimum changes described below.

  • Use granite-3.3-8b-instruct as the student model.
  • Apply the pre-defined chat template for granite models.
  • After fine-tuning, interpolate the last checkpoint with the original student model.

@mtake mtake marked this pull request as draft July 29, 2025 07:40
@mergify mergify bot added the ci-failure label Jul 30, 2025
@mtake mtake marked this pull request as ready for review July 30, 2025 17:59
@mergify mergify bot removed the ci-failure label Jul 31, 2025
@RobotSail
Copy link
Member

Thanks for the contribution @mtake ! LGTM!!

@RobotSail RobotSail merged commit bfd0d73 into instructlab:main Aug 2, 2025
17 checks passed
@mergify mergify bot added the one-approval label Aug 2, 2025
@mtake mtake deleted the fine-tuning-and-interpolation-tutorial branch August 2, 2025 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants