Skip to content

GitHub cache #463

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
afeefghannam89 merged 12 commits into from
Jun 25, 2026
Merged

GitHub cache #463

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
619b151
Cache elastic packages in the cache
afeefghannam89 Apr 24, 2026
c4a1d16
Cleaen up the outdated packages in cache
afeefghannam89 Apr 24, 2026
28a674b
Prevent race condition when locking the cache path
afeefghannam89 Apr 24, 2026
1b2e52d
Fix das fetching of latest package name
afeefghannam89 Apr 24, 2026
ae9546b
Fix matching latest release
afeefghannam89 Apr 24, 2026
afa442a
Get cache keys
afeefghannam89 Apr 24, 2026
7158f48
Fix key match
afeefghannam89 Apr 24, 2026
727e6e8
test
afeefghannam89 Apr 24, 2026
5acd2a6
* Use dedicated workflow to update caching packages
afeefghannam89 Apr 27, 2026
e085a6f
Use pip cache only where nedded
afeefghannam89 Apr 27, 2026
cb8ac43
Delete test.md
afeefghannam89 Jun 24, 2026
b02ada0
Merge branch 'feature/molecule-pipelines-refactoring' into github-cache
afeefghannam89 Jun 24, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/workflows/test_linting.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,8 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: "3.11"
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install test dependencies.
run: |
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_plugins.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,13 +181,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: "3.11"
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "ansible-core>=2.19,<2.20"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_role_beats.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,13 +63,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: ${{ matrix.python_version }}
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "${{ matrix.ansible_version }}"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_role_elasticsearch.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,13 +62,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: ${{ matrix.python_version }}
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "${{ matrix.ansible_version }}"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_role_kibana.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,13 +63,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: ${{ matrix.python_version }}
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "${{ matrix.ansible_version }}"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_role_logstash.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,13 +63,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: ${{ matrix.python_version }}
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "${{ matrix.ansible_version }}"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/test_role_repos.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -66,13 +66,53 @@ jobs:
uses: actions/setup-python@v6
with:
python-version: ${{ matrix.python_version }}
cache: 'pip'
cache-dependency-path: requirements-test.txt

- name: Install dependencies
run: |
python3 -m pip install --upgrade pip
python3 -m pip install "${{ matrix.ansible_version }}"
python3 -m pip install -r requirements-test.txt

- name: Get latest Elasticsearch release
id: elastic-version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
curl -fsSL \
"https://artifacts.elastic.co/packages/${{ matrix.release }}.x/apt/dists/stable/main/binary-amd64/Packages.gz" \
-o /tmp/Packages.gz
VERSION=$(zcat /tmp/Packages.gz \
| awk '$1=="Package:" && $2=="elasticsearch"{p=1} p && $1=="Version:"{print $2; p=0}' \
| sort -V \
| tail -n 1)
rm -f /tmp/Packages.gz
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Debug - latest Elasticsearch version
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: echo "Latest Elasticsearch ${{ matrix.release }}.x = ${{ steps.elastic-version.outputs.version }}"

- name: Restore Elastic apt cache
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
uses: actions/cache/restore@v5
with:
path: /tmp/elastic-apt-cache
key: ${{ runner.os }}-apt-elastic-${{ steps.elastic-version.outputs.version }}
restore-keys: |
${{ runner.os }}-apt-elastic-${{ matrix.release }}.

- name: Debug - apt cache contents
if: contains(matrix.distro, 'ubuntu') || contains(matrix.distro, 'debian')
run: |
echo "=== /tmp/elastic-apt-cache/ ==="
ls -lh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(empty or does not exist)"
echo "=== Total size ==="
du -sh /tmp/elastic-apt-cache/ 2>/dev/null || echo "(n/a)"

- name: Ensure apt cache directory exists
run: mkdir -p /tmp/elastic-apt-cache

- name: Install collection
run: |
mkdir -p ~/.ansible/collections/ansible_collections/$COLLECTION_NAMESPACE
Expand Down
Loading
Loading