Skip to content

Add TODO for duplicate find_common_workloads() call in hwqueue pipeline#126

Merged
prosenjitdhole merged 2 commits into
prosenj_cli_hq_eval_report_phase_2from
copilot/sub-pr-99
Mar 6, 2026
Merged

Add TODO for duplicate find_common_workloads() call in hwqueue pipeline#126
prosenjitdhole merged 2 commits into
prosenj_cli_hq_eval_report_phase_2from
copilot/sub-pr-99

Conversation

Copilot AI commented Mar 6, 2026

Copy link
Copy Markdown
Contributor

find_common_workloads() is called explicitly in the pipeline, then called again internally by load_comparison_data(), duplicating directory scanning work — noticeable at scale.

Changes

  • Added a TODO comment at the load_comparison_data() call site in hwqueue_pipeline.py documenting the redundant scan and suggesting two remediation paths:
    • Use only load_comparison_data() and extract common/baseline_only/test_only from its return value
    • Pass the already-computed common list to avoid re-scanning

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Co-authored-by: prosenjitdhole <239307697+prosenjitdhole@users.noreply.github.com>
Copilot AI changed the title [WIP] Add optimization TODO in pipeline command Add TODO for duplicate find_common_workloads() call in hwqueue pipeline Mar 6, 2026
@prosenjitdhole prosenjitdhole marked this pull request as ready for review March 6, 2026 12:31
Copilot AI review requested due to automatic review settings March 6, 2026 12:31
@prosenjitdhole prosenjitdhole merged commit 5949798 into prosenj_cli_hq_eval_report_phase_2 Mar 6, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Documents a known performance inefficiency in the HWQueue comparison pipeline where workload discovery is performed twice, helping future maintainers avoid redundant directory scanning at scale.

Changes:

  • Added a TODO comment at the HWQueueLoader.load_comparison_data() call site noting the duplicate find_common_workloads() scan.
  • Suggested two concrete follow-up remediation paths (use load_comparison_data() as the single source of truth, or pass/derive from already-computed workload sets).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants