Auto-activate ruby easy wins for feature-flagging-and-experimentation-sdk by dd-octo-sts[bot] · Pull Request #7044 · DataDog/system-tests

dd-octo-sts · 2026-05-29T07:11:00Z

Automated activation of easy-win tests for ruby owned by feature-flagging-and-experimentation-sdk
View nightly workflow run

If you approve this PR please also merge it.
If the tests are failing it might be due to a change made since the last nightly system-tests run. You can close the PR, an updated one will be available tomorrow.
If you close the PR please also delete the branch

github-actions · 2026-05-29T07:11:32Z

CODEOWNERS have been resolved as:

manifests/ruby.yml                                                      @DataDog/system-tests-reviewers

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 3979338806

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector · 2026-05-29T07:12:42Z

  tests/parametric/test_dynamic_configuration.py::TestDynamicConfigV2::test_tracing_client_tracing_tags: missing_feature  # Created by easy win activation script
  tests/parametric/test_ffe/test_dynamic_evaluation.py::Test_Feature_Flag_Dynamic_Evaluation: v2.23.0
-  tests/parametric/test_ffe/test_span_enrichment.py: missing_feature
+  tests/parametric/test_ffe/test_span_enrichment.py: '>=2.34.0'  # TODO: a lower version might be supported


Keep subject-limit tests disabled until they assert enrichment

With this file-level activation, Test_Span_Enrichment_Max_Subjects is now enabled for Ruby because it is the only subject-enrichment class not listed below as missing_feature. I checked tests/parametric/test_ffe/test_span_enrichment.py: test_max_10_subjects_enforced only validates the limit inside if "ffe_subjects_enc" in meta, so Ruby can emit no ffe_subjects_enc at all and still pass, while the adjacent subject-enrichment classes remain marked unsupported. This makes the easy-win activation report subject enrichment support even when the tracer does not provide it; either keep this class disabled too or make the test fail when the tag is absent.

Useful? React with 👍 / 👎.

dd-prapprover-prod-77c48c · 2026-08-05T07:32:21Z

PRApprover will approve and merge this PR, FAQ, #dx-source-code-management

🛠️ PRApproval Status

✅ PR is eligible for auto-approval by rule system-tests-auto-activate-easy-wins - 2026-08-25T07:12:46Z
✅ CI tests passed - 2026-08-25T07:12:52Z
✅ Approved (commit: db3d9ba) - 2026-08-25T07:12:53Z
Manual merge required: this rule does not auto-merge.

➡️ Current phase: approved - manual merge required (this rule does not auto-merge)

datadog-prod-us1-5 · 2026-08-05T07:46:07Z

⚠️ Warnings

🚦 3 Pipeline jobs failed

Testing the test | System Tests (ruby, dev) / End-to-end #1 / rails72 1 — ❌ 1 test failed

View more details · View in GitHub Actions

1 failed test. Timed out waiting for EVP flagevaluation count to reach expected value of 12000 for flag 'evp-degradation-flag'.
Showing tests most relevant to this failure.
❌ tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Degradation.test_ffe_evp_flagevaluation_degradation[rails72] from system_tests_suite
AssertionError: Timed out waiting for EVP flagevaluation count &gt;= 12000 for flag evp-degradation-flag
assert False
 &#43;  where False = &lt;bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator(&#39;agent&#39;)&gt;(&lt;function wait_for_evp_flagevaluation_count.&lt;locals&gt;.&lt;lambda&gt; at 0x7fe5b3a11ee0&gt;, timeout=60)
 &#43;    where &lt;bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator(&#39;agent&#39;)&gt; = AgentInterfaceValidator(&#39;agent&#39;).wait_for
 &#43;      where AgentInterfaceValidator(&#39;agent&#39;) = interfaces.agent

self = &lt;tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Degradation object at 0x7fe5d3d49310&gt;

    def test_ffe_evp_flagevaluation_degradation(self) -&gt; None:
        for index, response in enumerate(self.responses):
...
Testing the test | System Tests (ruby, prod) / End-to-end #1 / rails72 1 — 🔄 Retry may pass, looks flaky

View more details · View in GitHub Actions

1 failed test due to timeout waiting for EVP flagevaluation count >= 12000 for flag 'evp-degradation-flag'.

Testing the test | all-jobs-are-green

View more details · View in GitHub Actions

Job did not run: blocked by a failed job in an earlier pipeline stage.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: db3d9ba | Docs | View more details | Give us feedback!}

dd-prapprover-prod-77c48c