Skip to content

Preserve eager numeric parity (#24035) - #24035

Merged
meta-codesync[bot] merged 1 commit into
pytorch:mainfrom
YIWENX14:export-D125556968
Oct 21, 2026
Merged

meta-codesync[bot] merged 1 commit into
pytorch:mainfrom
YIWENX14:export-D125556968

Conversation

@YIWENX14

@YIWENX14 YIWENX14 commented Oct 21, 2026 •

Copy link
Copy Markdown
Contributor

No description provided.

@pytorch-bot

pytorch-bot Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24035

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit efbfcc0 with merge base d1f7f1f (image):

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 21, 2026
@meta-codesync

meta-codesync Bot commented Oct 21, 2026

Copy link
Copy Markdown
Contributor

@YIWENX14 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D125556968.

@github-actions

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@meta-codesync meta-codesync Bot changed the title Preserve AvoEdge eager numeric parity Preserve AvoEdge eager numeric parity (#24035) Oct 21, 2026
YIWENX14 added a commit to YIWENX14/executorch that referenced this pull request Oct 21, 2026
Summary:

Preserve rlllama4x query scaling and weightless sandwich-norm semantics through the landed AvoEdge trainer-override path. Keep shared rlformers conversion defaults unchanged, validate legacy head-dimension fallback before division, and gate the dense ExecuTorch scaleless post-FFN norm on a dedicated AvoEdge field so Gemma2/3 shared post_ffn_norm behavior remains unchanged.

Differential Revision: D125556968
YIWENX14 added a commit to YIWENX14/executorch that referenced this pull request Oct 21, 2026
Summary:

Preserve rlllama4x query scaling and weightless sandwich-norm semantics through the landed AvoEdge trainer-override path. Keep shared rlformers conversion defaults unchanged, validate legacy head-dimension fallback before division, and gate the dense ExecuTorch scaleless post-FFN norm on a dedicated AvoEdge field so Gemma2/3 shared post_ffn_norm behavior remains unchanged.

Differential Revision: D125556968
YIWENX14 added a commit to YIWENX14/executorch that referenced this pull request Oct 21, 2026
Summary:
Pull Request resolved: pytorch#24035

Preserve rlllama4x query scaling and weightless sandwich-norm semantics through the landed AvoEdge trainer-override path. Keep shared rlformers conversion defaults unchanged, validate legacy head-dimension fallback before division, and gate the dense ExecuTorch scaleless post-FFN norm on a dedicated AvoEdge field so Gemma2/3 shared post_ffn_norm behavior remains unchanged.

Differential Revision: D125556968
Summary:

Preserve rlllama4x query scaling and weightless sandwich-norm semantics through the landed AvoEdge trainer-override path. Keep shared rlformers conversion defaults unchanged, validate legacy head-dimension fallback before division, and gate the dense ExecuTorch scaleless post-FFN norm on a dedicated AvoEdge field so Gemma2/3 shared post_ffn_norm behavior remains unchanged.

Differential Revision: D125556968
@YIWENX14
YIWENX14 requested a review from billmguo October 21, 2026 19:58
@YIWENX14 YIWENX14 changed the title Preserve AvoEdge eager numeric parity (#24035) Preserve eager numeric parity (#24035) Oct 21, 2026
@meta-codesync
meta-codesync Bot merged commit 141f543 into pytorch:main Oct 21, 2026
242 of 244 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants