[Gasoonjia]

Stack from ghstack (oldest at bottom):

• [executorch][cuda] Grow sequence-layout ring layers on demand #24076
• [executorch][muse-glimmer] Bound the CUDA prefill logits selector by the sampler rows #24107
• [executorch][muse] Serve Muse Glimmer CUDA batching on a batched-sequence cache #24075
• [executorch][cuda] Lower off-graph KV to the batched-sequence layout #24074
• [executorch][cuda] Add a batched-sequence CUDA KV cache #24073
• [executorch][cuda] Add a length-aware Triton SDPA over per-sequence KV columns #24072
• [executorch][muse] Accept images in CUDA DFlash batching #24066
• [executorch][muse] Serve images on CUDA batching #24065
• [executorch][muse] Export vision with the CUDA batching contract #24064
• -> [executorch][cuda] Run CudaExecutor steps from prepared embeddings #24063
• [executorch][muse] Share the Muse Glimmer embeddings engine across backends #24062

Steps that carry a prepared (image) input run forward_from_embeddings with the
materialized rows; token-only steps keep the static forward_{N} methods and
their CUDA graphs. SessionTable packs prepared rows as placeholders so the
cache still plans their positions.

Differential Revision: D125987291

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24063

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 1 Cancelled Job, 8 Pending

As of commit 325bc57 with merge base 2c3e231 ():

NEW FAILURES - The following jobs have failed:

• pull / test-models-linux-basic (mv3, portable, buck2, mt-l-x86iavx512-8-64, executorch-ubuntu-22.04-clan... / linux-job (gh)
  RuntimeError: Command bash /__w/_temp/exec_script failed with exit code 1
• pull / test-qnn-passes-linux / linux-job (gh)
  RuntimeError: Command bash /__w/_temp/exec_script failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• pull / test-qnn-python-imports-linux / linux-job (gh)
  ##[error]received SIGINT

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.