Skip to content

tests: sending test results to test predictor from self-hosted runner - #17689

Open
sergiocazzolato wants to merge 6 commits into
canonical:masterfrom
sergiocazzolato:tests-send-garden-results-test-predictor
Open

sergiocazzolato wants to merge 6 commits into
canonical:masterfrom
sergiocazzolato:tests-send-garden-results-test-predictor

Conversation

@sergiocazzolato

Copy link
Copy Markdown
Contributor

This is needed to be able to send results executed in github runners to test predictor (specifically for tests executed in garden).

This is needed to be able to send results executed in github runners to
test predictor (specifically for tests executed in garde).
@sergiocazzolato
sergiocazzolato force-pushed the tests-send-garden-results-test-predictor branch from 7e0bb1f to 064e6ef Compare September 21, 2026 21:36
@codecov

codecov Bot commented Sep 21, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 78.45%. Comparing base (4c50dda) to head (cbdb657).
⚠️ Report is 19 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #17689      +/-   ##
==========================================
+ Coverage   78.36%   78.45%   +0.09%     
==========================================
  Files        1415     1409       -6     
  Lines      200459   200496      +37     
  Branches     2503     2503              
==========================================
+ Hits       157084   157306     +222     
+ Misses      33950    33776     -174     
+ Partials     9425     9414      -11     
Flag Coverage Δ
unittests 78.45% <ø> (+0.09%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions

github-actions Bot commented Sep 21, 2026 •

Copy link
Copy Markdown

Fri Sep 25 01:14:45 UTC 2026
The following results are from: https://github.com/canonical/snapd/actions/runs/36057406165

Test Predictor Analysis

Executing

Test Success %
garden:arch-linux-64:tests/main/snapd-snap:lxd unavailable
garden:debian-12-64:tests/main/snapd-snap:lxd unavailable
garden:debian-sid-64:tests/main/snapd-snap:lxd unavailable
garden:fedora-44-64:tests/main/snapd-snap:lxd unavailable
garden:opensuse-tumbleweed-64:tests/main/snapd-snap:lxd unavailable
garden:opensuse-tumbleweed-selinux-64:tests/main/snapd-snap:lxd unavailable
garden:ubuntu-20.04-64:tests/main/snapd-snap:lxd unavailable
garden:ubuntu-22.04-64:tests/main/snapd-snap:lxd unavailable
garden:ubuntu-24.04-64:tests/main/snapd-snap:lxd unavailable
garden:ubuntu-26.04-64:tests/main/snapd-snap:lxd unavailable
garden:ubuntu-core-18-64:tests/core/gadget-kernel-refs-update-pc unavailable
openstack:debian-sid-64:tests/main/snapd-reexec:snapd 🔴 3.0%
openstack:ubuntu-26.10-64:tests/main/snapd-reexec:snapd 🔴 3.0%

Restoring

Test Success %
openstack:debian-sid-64:tests/main/snapd-reexec:snapd 🔴 1.2%
openstack:ubuntu-26.10-64:tests/main/snapd-reexec:snapd 🔴 0.9%

Skipped tests from snapd-testing-skip

If you wish to have any of the below tests run in your PR, in your PR description, add 'unskip:' followed by a copy-and-pasted list of the below tests you wish to run (unskip plus test list must be valid yaml)

  • garden:fedora-44-64:tests/main/network-retry
  • garden:ubuntu-24.04-64:tests/main/apparmor-prompting-support
  • garden:ubuntu-24.04-64:tests/main/auto-refresh-retry
  • garden:ubuntu-24.04-64:tests/main/network-retry
  • garden:ubuntu-26.04-64:tests/main/apparmor-prompting-support
  • garden:ubuntu-26.04-64:tests/main/auto-refresh-retry
  • garden:ubuntu-26.04-64:tests/main/network-retry
  • openstack-arm:ubuntu-24.04-arm-64:tests/main/i18n
  • openstack-arm:ubuntu-24.04-arm-64:tests/main/interfaces-location-control
  • openstack-arm:ubuntu-core-24-arm-64:tests/main/i18n
  • openstack:amazon-linux-2023-64:tests/main/interfaces-location-control
  • openstack:arch-linux-64:tests/main/interfaces-location-control
  • openstack:centos-9-64:tests/main/interfaces-location-control
  • openstack:debian-12-64:tests/main/interfaces-location-control
  • openstack:debian-sid-64:tests/main/interfaces-location-control
  • openstack:debian-sid-64:tests/main/interfaces-network-status-classic
  • openstack:debian-sid-64:tests/main/interfaces-xdg-portal-permission-store
  • openstack:fedora-44-64:tests/main/interfaces-location-control
  • openstack:fedora-44-64:tests/main/network-retry
  • openstack:opensuse-16.0-64:tests/main/interfaces-location-control
  • openstack:opensuse-tumbleweed-64:tests/main/interfaces-location-control
  • openstack:opensuse-tumbleweed-selinux-64:tests/main/interfaces-location-control
  • openstack:ubuntu-16.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-18.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-20.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-22.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-flag-restart
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-integration-tests
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-prompt-restoration
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-smoke
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-snapd-startup
  • openstack:ubuntu-24.04-64:tests/main/apparmor-prompting-support
  • openstack:ubuntu-24.04-64:tests/main/auto-refresh-retry
  • openstack:ubuntu-24.04-64:tests/main/i18n
  • openstack:ubuntu-24.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-24.04-64:tests/main/interfaces-requests-activates-handlers
  • openstack:ubuntu-24.04-64:tests/main/network-retry
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-flag-restart
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-integration-tests
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-prompt-restoration
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-smoke
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-snapd-startup
  • openstack:ubuntu-26.04-64:tests/main/apparmor-prompting-support
  • openstack:ubuntu-26.04-64:tests/main/auto-refresh-retry
  • openstack:ubuntu-26.04-64:tests/main/i18n
  • openstack:ubuntu-26.04-64:tests/main/interfaces-location-control
  • openstack:ubuntu-26.04-64:tests/main/interfaces-requests-activates-handlers
  • openstack:ubuntu-26.04-64:tests/main/network-retry
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-flag-restart
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-integration-tests
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-prompt-restoration
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-smoke
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-snapd-startup
  • openstack:ubuntu-26.10-64:tests/main/apparmor-prompting-support
  • openstack:ubuntu-26.10-64:tests/main/interfaces-location-control
  • openstack:ubuntu-26.10-64:tests/main/interfaces-requests-activates-handlers

Comment thread .github/workflows/spread-tests.yaml Outdated

@maykathm maykathm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks

This is in case the tests are executed in a github runner

@maykathm maykathm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding in the grafana logs bit

@Rnfudge02 Rnfudge02 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@github-actions github-actions Bot added the Auto rerun spread Auto reruns spread up to 4 times in non-draft PRs w/ >=1 approval and <20 fails in any fund. system label Sep 23, 2026
@sergiocazzolato
sergiocazzolato force-pushed the tests-send-garden-results-test-predictor branch from f0bd59f to 1ec15b5 Compare September 24, 2026 12:08

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Auto rerun spread Auto reruns spread up to 4 times in non-draft PRs w/ >=1 approval and <20 fails in any fund. system

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants