Skip to content

SG-38126 Update CI - Test results and code coverage#1082

Merged
julien-lang merged 6 commits intomasterfrom
ticket/SG-38126
Jan 28, 2026
Merged

SG-38126 Update CI - Test results and code coverage#1082
julien-lang merged 6 commits intomasterfrom
ticket/SG-38126

Conversation

@julien-lang
Copy link
Copy Markdown
Member

@julien-lang julien-lang commented Jan 22, 2026

Align new CI test results and code coverage strategy

Comment thread developer/populate_bundle_cache.py
@codecov
Copy link
Copy Markdown

codecov Bot commented Jan 22, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.61%. Comparing base (5bfcaa7) to head (ffc33fa).
⚠️ Report is 35 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1082      +/-   ##
==========================================
- Coverage   79.79%   79.61%   -0.18%     
==========================================
  Files         198      198              
  Lines       20776    20623     -153     
==========================================
- Hits        16579    16420     -159     
- Misses       4197     4203       +6     
Flag Coverage Δ
Linux 79.08% <ø> (?)
Python-3.10 79.43% <ø> (?)
Python-3.11 79.34% <ø> (?)
Python-3.9 79.40% <ø> (?)
Windows 79.11% <ø> (?)
macOS 79.09% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Comment thread tests/integration_tests/run_integration_tests.py Outdated
Comment thread azure-pipelines.yml Outdated
Comment thread azure-pipelines.yml Outdated
@julien-lang julien-lang changed the title SG-38126 SG-38126 Update CI - Test results and code coverage Jan 23, 2026
@julien-lang julien-lang marked this pull request as ready for review January 23, 2026 00:04
@julien-lang julien-lang requested review from a team and Copilot January 23, 2026 00:05
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR aligns the repository with a new CI testing and code coverage strategy, updating the test execution process to use pytest with unique test results and coverage files, enabling parallel test execution with proper result combination.

Changes:

  • Updated integration test runner to use pytest with unique test result and coverage filenames
  • Removed redundant environment variable assignments for Shotgun credentials
  • Applied Black formatting updates (removed unnecessary tuple unpacking parentheses and blank lines)

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated no comments.

Show a summary per file
File Description
tests/integration_tests/run_integration_tests.py Implemented pytest-based test execution with UUID-based unique filenames for test results and coverage
setup/tank_api_proxy/tank/init.py Removed extra blank line (Black formatting)
setup/tank_api_proxy/sgtk/init.py Removed extra blank line (Black formatting)
scripts/tank_cmd.py Removed unnecessary tuple unpacking parentheses (Black formatting)
hooks/default_storage_root.py Added blank line after docstring (Black formatting)
hooks/context_additional_entities.py Added blank line after docstring (Black formatting)
developer/utils/authentication.py Removed extra blank line (Black formatting)
developer/populate_bundle_cache.py Removed unnecessary tuple unpacking parentheses and condensed format chain (Black formatting)
developer/build_plugin.py Removed unnecessary tuple unpacking parentheses and condensed format chain (Black formatting)
developer/bake_config.py Changed to f-string, but with incomplete template variable substitution
azure-pipelines.yml Updated tk-ci-tools reference to feature branch
.pre-commit-config.yaml Updated pre-commit-hooks and black versions
Comments suppressed due to low confidence (1)

developer/bake_config.py:1

  • The f-string at line 214 has incorrect syntax. The 'f' prefix should be outside the string content. The variable automated_setup_documentation is treated as a literal string "f{automated_setup_documentation}" instead of being interpolated. Additionally, the previous .format() chain was removed but the f-string conversion is incomplete. Either use proper f-string syntax with the variable inside the f-string template (line 194), or revert to the original .format() approach.
# Copyright (c) 2018 Shotgun Software Inc.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@julien-lang julien-lang merged commit 3fed2c4 into master Jan 28, 2026
24 checks passed
@julien-lang julien-lang deleted the ticket/SG-38126 branch January 28, 2026 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants