Skip to content

docs: add LoRA fine-tuning tutorial#3601

Merged
RexBearIU merged 1 commit intoAI-Hypercomputer:jackyf/feat/lora-nnxfrom
CIeNET-International:emma/lora-tutorial-final
Apr 15, 2026
Merged

docs: add LoRA fine-tuning tutorial#3601
RexBearIU merged 1 commit intoAI-Hypercomputer:jackyf/feat/lora-nnxfrom
CIeNET-International:emma/lora-tutorial-final

Conversation

@chiajunglien
Copy link
Copy Markdown

@chiajunglien chiajunglien commented Apr 8, 2026 •
edited
Loading

Description

Start with a short description of what the PR does and how this is a change from
the past.

The rest of the description includes relevant details and context, examples:

  • why is this change being made,
  • the problem being solved and any relevant context,
  • why this is a good solution,
  • some information about the specific implementation,
  • shortcomings of the solution and possible future improvements.

If the change fixes a bug or a Github issue, please include a link, e.g.,:
FIXES: b/123456
FIXES: #123456

Notice 1: Once all tests pass, the "pull ready" label will automatically be assigned.
This label is used for administrative purposes. Please do not add it manually.

Notice 2: For external contributions, our settings currently require an approval from a MaxText maintainer to trigger CI tests.

Tests

Please describe how you tested this change, and include any instructions and/or
commands to reproduce.

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.

RexBearIU
RexBearIU reviewed Apr 9, 2026
View reviewed changes
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md
Comment thread docs/tutorials/posttraining/lora.md Outdated
RexBearIU
RexBearIU requested changes Apr 9, 2026
View reviewed changes
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md
Comment thread docs/tutorials/posttraining/lora.md Outdated
RexBearIU
RexBearIU reviewed Apr 10, 2026
View reviewed changes
Comment thread docs/tutorials/posttraining/lora.md Outdated
RexBearIU
RexBearIU reviewed Apr 10, 2026
View reviewed changes
Comment thread docs/tutorials/posttraining/lora.md Outdated

Your fine-tuned model checkpoints will be saved here: `$BASE_OUTPUT_DIRECTORY/$RUN_NAME/checkpoints`.

## (Optional) Export Fine-tuned LoRA to Hugging Face Format
Copy link
Copy Markdown
Collaborator

@RexBearIU RexBearIU Apr 10, 2026 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Convert should be more appropriate

RexBearIU
RexBearIU requested changes Apr 10, 2026
View reviewed changes
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
Comment thread docs/tutorials/posttraining/lora.md Outdated
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch 4 times, most recently from 49ce72a to 94d5499 Compare April 13, 2026 08:23
@RexBearIU RexBearIU force-pushed the jackyf/feat/lora-nnx branch 5 times, most recently from 5a05148 to 7570b3d Compare April 14, 2026 02:45
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch 2 times, most recently from 8986894 to dc83202 Compare April 14, 2026 03:42
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 14, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@RexBearIU RexBearIU force-pushed the jackyf/feat/lora-nnx branch from 7570b3d to 4af2ded Compare April 14, 2026 07:54
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch from 62c7a9d to cd4820f Compare April 14, 2026 08:51
@RexBearIU RexBearIU force-pushed the jackyf/feat/lora-nnx branch 2 times, most recently from bde3527 to 3f2a7c6 Compare April 15, 2026 07:04
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch from cd4820f to a76b556 Compare April 15, 2026 07:06
@RexBearIU RexBearIU force-pushed the jackyf/feat/lora-nnx branch 2 times, most recently from 77e692a to a0bb088 Compare April 15, 2026 08:19
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch 4 times, most recently from b8b039c to 8840ee3 Compare April 15, 2026 08:37
@chiajunglien chiajunglien force-pushed the emma/lora-tutorial-final branch from b1eac6d to 1e43e7c Compare April 15, 2026 08:42
@RexBearIU RexBearIU marked this pull request as ready for review April 15, 2026 08:45
@RexBearIU RexBearIU merged commit d3170c1 into AI-Hypercomputer:jackyf/feat/lora-nnx Apr 15, 2026
1 check passed
RexBearIU pushed a commit that referenced this pull request Apr 15, 2026
@chiajunglien @RexBearIU
docs: add LoRA tutorial and update pyconfig (#3601)
bc505b8
RexBearIU pushed a commit that referenced this pull request Apr 15, 2026
@chiajunglien @RexBearIU
docs: add LoRA tutorial and update pyconfig (#3601)
3ad7d36
RexBearIU pushed a commit that referenced this pull request Apr 15, 2026
@chiajunglien @RexBearIU
docs: add LoRA tutorial and update pyconfig (#3601)
faa14d9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@RexBearIU RexBearIU RexBearIU requested changes

@jacoguzo jacoguzo Awaiting requested review from jacoguzo jacoguzo is a code owner

@bvandermoon bvandermoon Awaiting requested review from bvandermoon bvandermoon is a code owner

@SurbhiJainUSC SurbhiJainUSC Awaiting requested review from SurbhiJainUSC SurbhiJainUSC is a code owner

@richjames0 richjames0 Awaiting requested review from richjames0 richjames0 is a code owner

@shralex shralex Awaiting requested review from shralex shralex is a code owner

@gobbleturk gobbleturk Awaiting requested review from gobbleturk gobbleturk is a code owner

@RissyRan RissyRan Awaiting requested review from RissyRan RissyRan is a code owner

@gagika gagika Awaiting requested review from gagika gagika is a code owner

@A9isha A9isha Awaiting requested review from A9isha A9isha is a code owner

@jiangjy1982 jiangjy1982 Awaiting requested review from jiangjy1982 jiangjy1982 is a code owner

@vipannalla vipannalla Awaiting requested review from vipannalla vipannalla is a code owner

@abhinavclemson abhinavclemson Awaiting requested review from abhinavclemson abhinavclemson is a code owner

@khatwanimohit khatwanimohit Awaiting requested review from khatwanimohit khatwanimohit is a code owner

@hengtaoguo hengtaoguo Awaiting requested review from hengtaoguo hengtaoguo is a code owner

@aireenmei aireenmei Awaiting requested review from aireenmei aireenmei is a code owner

@NuojCheng NuojCheng Awaiting requested review from NuojCheng NuojCheng is a code owner

@suexu1025 suexu1025 Awaiting requested review from suexu1025 suexu1025 is a code owner

@NicoGrande NicoGrande Awaiting requested review from NicoGrande NicoGrande is a code owner

@jesselu-google jesselu-google Awaiting requested review from jesselu-google jesselu-google is a code owner

@dipannita08 dipannita08 Awaiting requested review from dipannita08 dipannita08 is a code owner

@igorts-git igorts-git Awaiting requested review from igorts-git igorts-git is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@chiajunglien @RexBearIU