Skip to content

NXP backend: refactor dataset_creators to enable better benchmarking - #23886

Open
novak-vaclav wants to merge 1 commit into
pytorch:mainfrom
nxp-upstream:feature/EIEX-1139-refactor-dataset-creators
Open

novak-vaclav wants to merge 1 commit into
pytorch:mainfrom
nxp-upstream:feature/EIEX-1139-refactor-dataset-creators

Conversation

@novak-vaclav

Copy link
Copy Markdown
Collaborator

Summary

Refactor dataset creators of NXP backend to make the benchmarking code more maintainable. With that, I also implemented changes to make sharing the results of benchmarks better to NXP's internal testers.

Test plan

tests can be manually run using pytest -c /dev/null backends/nxp/tests/

cc @robert-kalmar @JakeStevens @digantdesai @rascani

Copilot AI balanced review requested due to automatic review settings October 15, 2026 08:26
@novak-vaclav novak-vaclav added module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/ release notes: nxp Changes to the NXP Neutron backend delegate labels Oct 15, 2026
@pytorch-bot

pytorch-bot Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/23886

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit d1df03f with merge base 86b967e (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 15, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@linux-foundation-easycla

linux-foundation-easycla Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

CLA Not Signed

@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from bf9e2f4 to 8d706ee Compare October 15, 2026 09:52
Comment thread backends/nxp/tests/dataset_creators/base_dataset_creator.py Outdated
Comment thread backends/nxp/tests/dataset_creators/real_dataset_creators.py Outdated
Comment thread backends/nxp/tests/dataset_creators/synthetic_creators.py Outdated
Comment thread backends/nxp/tests/dataset_creators/real_dataset_creators.py Outdated
Comment thread backends/nxp/tests/dataset_creators/synthetic_creators.py
Comment thread backends/nxp/tests/executorch_pipeline.py Outdated
Copilot AI balanced review requested due to automatic review settings October 19, 2026 08:01
@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from 8d706ee to 4c579ef Compare October 19, 2026 08:01

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI balanced review requested due to automatic review settings October 19, 2026 13:24
@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from 4c579ef to f6daca9 Compare October 19, 2026 13:24

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from f6daca9 to 43df070 Compare October 19, 2026 13:29
@novak-vaclav

Copy link
Copy Markdown
Collaborator Author

I initially created this PR and did not assign reviewers because I wanted to double check something, while letting the OSS CI run (in draft mode, CI does not run).
However thank you @roman-janik-nxp for early review, the thing I wanted to double check did not change the outcome, so I just addressed your comments and removed the renaming commit (I have it stashed locally if it ends up being needed). The renaming is under further discussion and will be resolved separately.

Rebased onto current main, ready for review by everyone 😄

@roman-janik-nxp roman-janik-nxp left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a lot of failing tests.

Comment thread backends/nxp/tests/dataset_creators/real_dataset_creators.py Outdated
class BaseDatasetCreator(abc.ABC):
"""Abstract base class for all dataset creators."""

def __init__(self) -> None:

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please don't add type hints -> None. They are meaningless. What I meant in the previous comment was to add type hints for function parameters where it increased clarity, not to add it always everywhere.

@novak-vaclav novak-vaclav Oct 21, 2026 •

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I disagree with them being meaningless. Since we don't enforce strict typing, if -> None is omitted, we can't distinguish whether the method/function returns None, or is missing the typing. So imo it also increases clarity. We sometimes use -> None, and other backends use it as well, and the presence of -> None does not cause any harm imo.

Copilot AI balanced review requested due to automatic review settings October 21, 2026 14:58
@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from 43df070 to 35d9ef3 Compare October 21, 2026 14:58

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from 35d9ef3 to 338d209 Compare October 21, 2026 14:59
@novak-vaclav

Copy link
Copy Markdown
Collaborator Author

Fixed test issues and rebased onto main

@novak-vaclav
novak-vaclav force-pushed the feature/EIEX-1139-refactor-dataset-creators branch from 338d209 to d1df03f Compare October 21, 2026 20:29
Copilot AI balanced review requested due to automatic review settings October 21, 2026 20:29

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: nxp Issues related to NXP Neutron NPU delegation and code under backends/nxp/ release notes: nxp Changes to the NXP Neutron backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants