Compare commits

..

33 Commits

Author SHA1 Message Date
Curtis Vogt
b02b27b5c2 Check if gh can stream logs 2025-01-24 11:15:16 -06:00
Curtis Vogt
69674bfc14 fixup! Add delay 2025-01-24 10:34:42 -06:00
Curtis Vogt
0a42a3633d fixup! Add delay 2025-01-24 10:31:40 -06:00
Curtis Vogt
9d9d37994b Add delay 2025-01-24 10:20:51 -06:00
Curtis Vogt
e49ff51323 Validate access isn't the problem 2025-01-24 10:13:55 -06:00
Curtis Vogt
5a04d111ea fixup! Experiment with access logs during execution 2025-01-24 10:10:02 -06:00
Curtis Vogt
b4c6d4b10c Experiment with access logs during execution 2025-01-24 10:08:35 -06:00
Curtis Vogt
46044e72ab fixup! Compare more context 2025-01-24 08:48:06 -06:00
Curtis Vogt
41be7ea14c fixup! Compare more context 2025-01-24 08:43:28 -06:00
Curtis Vogt
ef17b41963 Compare more context 2025-01-24 08:32:26 -06:00
Curtis Vogt
e81fae1916 fixup! Use upload for passing context 2025-01-24 08:24:39 -06:00
Curtis Vogt
1c132479c0 fixup! Use upload for passing context 2025-01-24 08:23:23 -06:00
Curtis Vogt
e7a9e0f340 fixup! Use upload for passing context 2025-01-24 08:22:26 -06:00
Curtis Vogt
7096dc43a1 fixup! Use upload for passing context 2025-01-24 08:20:50 -06:00
Curtis Vogt
cc7375cd98 Use upload for passing context 2025-01-24 08:17:26 -06:00
Curtis Vogt
0217e24a50 Encode to avoid GH checks 2025-01-23 15:56:51 -06:00
Curtis Vogt
66728dbe42 fixup! Check for differences in github context 2025-01-23 15:52:27 -06:00
Curtis Vogt
fd02edc686 fixup! Check for differences in github context 2025-01-23 15:51:36 -06:00
Curtis Vogt
a216f5035e fixup! Check for differences in github context 2025-01-23 15:46:17 -06:00
Curtis Vogt
f5316fefee fixup! Check for differences in github context 2025-01-23 15:43:05 -06:00
Curtis Vogt
11cd6b1ef0 fixup! Check for differences in github context 2025-01-23 15:40:09 -06:00
Curtis Vogt
69d3a9406a fixup! Check for differences in github context 2025-01-23 15:37:26 -06:00
Curtis Vogt
4818bbd194 fixup! Check for differences in github context 2025-01-23 15:35:19 -06:00
Curtis Vogt
d9466e9938 fixup! Check for differences in github context 2025-01-23 15:33:47 -06:00
Curtis Vogt
096c710202 Check for differences in github context 2025-01-23 15:30:05 -06:00
Curtis Vogt
3f52c6b71c Dig further 2025-01-23 13:47:27 -06:00
Curtis Vogt
19f527d7a8 Experiment with theoretical cache key conflict 2025-01-23 13:17:25 -06:00
Ian Butterworth
2b1bf4d8a1 fix slashes in windows depot path (#153) 2025-01-09 13:23:45 -06:00
dependabot[bot]
49fd7c4af0 Bump pyTooling/Actions from 1.0.5 to 3.1.1 (#157)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Ian Butterworth <i.r.butterworth@gmail.com>
2025-01-09 13:06:18 -05:00
dependabot[bot]
d343189aad Bump actions/cache from 4.1.2 to 4.2.0 (#156)
Bumps [actions/cache](https://github.com/actions/cache) from 4.1.2 to 4.2.0.
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](6849a64899...1bd1e32a3b)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-01 11:41:51 +01:00
dependabot[bot]
315c171d17 Bump actions/checkout from 4.1.7 to 4.2.2 (#150)
* Bump actions/checkout from 4.1.7 to 4.2.2

Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.7 to 4.2.2.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](692973e3d9...11bd71901b)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Apply suggestions from code review

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mosè Giordano <765740+giordano@users.noreply.github.com>
2024-12-01 21:41:35 +00:00
dependabot[bot]
f4098e6050 Bump actions/cache from 4.0.2 to 4.1.2 (#151)
Bumps [actions/cache](https://github.com/actions/cache) from 4.0.2 to 4.1.2.
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](0c45773b62...6849a64899)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-01 13:48:31 +00:00
dependabot[bot]
0c8892ce7f Bump dcarbone/install-jq-action from 2.1.0 to 3.0.1 (#155)
* Bump dcarbone/install-jq-action from 2.1.0 to 3.0.1

Bumps [dcarbone/install-jq-action](https://github.com/dcarbone/install-jq-action) from 2.1.0 to 3.0.1.
- [Release notes](https://github.com/dcarbone/install-jq-action/releases)
- [Commits](8867ddb478...e397bd8743)

---
updated-dependencies:
- dependency-name: dcarbone/install-jq-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update action.yml

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mosè Giordano <765740+giordano@users.noreply.github.com>
2024-12-01 13:47:49 +00:00
4 changed files with 154 additions and 22 deletions

View File

@@ -59,7 +59,7 @@ jobs:
env:
JULIA_DEPOT_PATH: /tmp/julia-depot
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Set cache-name
id: cache-name
shell: bash
@@ -117,7 +117,7 @@ jobs:
env:
JULIA_DEPOT_PATH: /tmp/julia-depot
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- uses: julia-actions/setup-julia@v2
with:
version: ${{ matrix.version }}
@@ -161,7 +161,7 @@ jobs:
outputs:
cache-name: ${{ steps.cache-name.outputs.cache-name }}
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Set cache-name
id: cache-name
run: |
@@ -193,7 +193,7 @@ jobs:
needs: test-save-nomatrix
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Restore cache
id: cache
uses: ./
@@ -233,7 +233,7 @@ jobs:
outputs:
cache-name: ${{ steps.cache-name.outputs.cache-name }}
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Set cache-name
id: cache-name
run: |
@@ -259,7 +259,7 @@ jobs:
needs: test-save-cloned-registry
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- name: Add General registry clone
shell: julia --color=yes {0}
run: |

79
.github/workflows/ReusableTest.yml vendored Normal file
View File

@@ -0,0 +1,79 @@
---
name: Reusable Test
on:
pull_request:
inputs: {}
jobs:
reusable:
uses: ./.github/workflows/ReusableWorkflow.yml
duplicate:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- uses: julia-actions/setup-julia@v2
with:
version: "1"
- name: Save cache
uses: ./
- name: Export Context
run: |
jq -c <<<"$github_json" >github.json
jq -c <<<"$env_json" >env.json
jq -c <<<"$job_json" >job.json
jq -c <<<"$steps_json" >steps.json
jq -c <<<"$runner_json" >runner.json
jq -c <<<"$inputs_json" >inputs.json
env:
github_json: ${{ toJSON(github) }}
env_json: ${{ toJSON(env) }}
job_json: ${{ toJSON(job) }}
steps_json: ${{ toJSON(steps) }}
runner_json: ${{ toJSON(runner) }}
inputs_json: ${{ toJSON(inputs) }}
- name: Export environmental variables
run: jq -n env >env_vars.json
- uses: actions/upload-artifact@v4
with:
name: trigger-context
path: "*.json"
compare:
needs:
- reusable
- duplicate
runs-on: ubuntu-latest
steps:
- uses: actions/download-artifact@v4
with:
name: trigger-context
path: trigger
- uses: actions/download-artifact@v4
with:
name: reusable-context
path: reusable
- run: |
find .
for p in trigger/*.json; do
context_file="$(basename "$p")"
echo "$context_file"
a="$(cat trigger/$context_file)"
b="$(cat reusable/$context_file)"
echo "::group::Raw A"
jq <<<"$a"
echo "::endgroup::"
echo "::group::Raw B"
jq <<<"$b"
echo "::endgroup::"
echo "::group::Diff"
same=0
diff <(jq <<<"$a") <(jq <<<"$b") || same=$?
echo "::endgroup::"
[[ $same -eq 0 ]] && echo "Same" || echo "Differ"
done

52
.github/workflows/ReusableWorkflow.yml vendored Normal file
View File

@@ -0,0 +1,52 @@
---
name: Reusable Workflow
on:
workflow_call:
inputs: {}
jobs:
duplicate:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
- uses: julia-actions/setup-julia@v2
with:
version: "1"
- name: Save cache
uses: ./
- name: Export Context
run: |
jq -c <<<"$github_json" >github.json
jq -c <<<"$env_json" >env.json
jq -c <<<"$job_json" >job.json
jq -c <<<"$steps_json" >steps.json
jq -c <<<"$runner_json" >runner.json
jq -c <<<"$inputs_json" >inputs.json
env:
github_json: ${{ toJSON(github) }}
env_json: ${{ toJSON(env) }}
job_json: ${{ toJSON(job) }}
steps_json: ${{ toJSON(steps) }}
runner_json: ${{ toJSON(runner) }}
inputs_json: ${{ toJSON(inputs) }}
- name: Export environmental variables
run: jq -n env >env_vars.json
- uses: actions/upload-artifact@v4
with:
name: reusable-context
path: "*.json"
- run: |
set -x
uuid="$(cat /proc/sys/kernel/random/uuid)"
echo "$uuid"
# sleep 60
# https://docs.github.com/en/rest/actions/workflow-runs?apiVersion=2022-11-28#download-workflow-run-logs
# gh api "/repos/{owner}/{repo}/actions/runs/${run_id:?}/logs" >logs.zip
# unzip -- logs.zip "*.txt"
# find .
# grep -rnH ReusableWorkflow.yml .
# grep -rnH "$uuid" .
gh run view "${run_id:?}" --log
env:
GH_TOKEN: ${{ github.token }}
run_id: ${{ github.run_id }}

View File

@@ -52,14 +52,14 @@ runs:
using: 'composite'
steps:
- name: Install jq
uses: dcarbone/install-jq-action@8867ddb4788346d7c22b72ea2e2ffe4d514c7bcb
uses: dcarbone/install-jq-action@e397bd87438d72198f81efd21f876461183d383a # v3.0.1
with:
force: false # Skip install when an existing `jq` is present
- id: paths
run: |
if [ -n '${{ inputs.depot }}' ]; then
depot='${{ inputs.depot }}'
if [ -n "${{ inputs.depot }}" ]; then
depot="${{ inputs.depot }}"
elif [ -n "$JULIA_DEPOT_PATH" ]; then
# Use the first depot path
depot=$(echo $JULIA_DEPOT_PATH | cut -d$PATH_DELIMITER -f1)
@@ -68,6 +68,7 @@ runs:
fi
if [[ "$OSTYPE" == "msys" || "$OSTYPE" == "cygwin" ]]; then
depot="${depot/#\~/$USERPROFILE}" # Windows paths
depot="${depot//\\//}" # Replace backslashes with forward slashes
else
depot="${depot/#\~/$HOME}" # Unix-like paths
fi
@@ -75,11 +76,11 @@ runs:
cache_paths=()
artifacts_path="${depot}/artifacts"
[ '${{ inputs.cache-artifacts }}' = "true" ] && cache_paths+=("$artifacts_path")
[ "${{ inputs.cache-artifacts }}" = "true" ] && cache_paths+=("$artifacts_path")
packages_path="${depot}/packages"
[ '${{ inputs.cache-packages }}' = "true" ] && cache_paths+=("$packages_path")
[ "${{ inputs.cache-packages }}" = "true" ] && cache_paths+=("$packages_path")
registries_path="${depot}/registries"
if [ '${{ inputs.cache-registries }}' = "true" ]; then
if [ "${{ inputs.cache-registries }}" = "true" ]; then
if [ ! -d "${registries_path}" ]; then
cache_paths+=("$registries_path")
else
@@ -87,11 +88,11 @@ runs:
fi
fi
compiled_path="${depot}/compiled"
[ '${{ inputs.cache-compiled }}' = "true" ] && cache_paths+=("$compiled_path")
[ "${{ inputs.cache-compiled }}" = "true" ] && cache_paths+=("$compiled_path")
scratchspaces_path="${depot}/scratchspaces"
[ '${{ inputs.cache-scratchspaces }}' = "true" ] && cache_paths+=("$scratchspaces_path")
[ "${{ inputs.cache-scratchspaces }}" = "true" ] && cache_paths+=("$scratchspaces_path")
logs_path="${depot}/logs"
[ '${{ inputs.cache-logs }}' = "true" ] && cache_paths+=("$logs_path")
[ "${{ inputs.cache-logs }}" = "true" ] && cache_paths+=("$logs_path")
{
echo "cache-paths<<EOF"
printf "%s\n" "${cache_paths[@]}"
@@ -106,10 +107,10 @@ runs:
run: |
# `matrix_key` joins all of matrix keys/values (including nested objects) to ensure that concurrent runs each use a unique cache key.
# When `matrix` isn't set for the job then `MATRIX_JSON=null`.
if [ '${{ inputs.include-matrix }}' == "true" ] && [ "$MATRIX_JSON" != "null" ]; then
if [ "${{ inputs.include-matrix }}" == "true" ] && [ "$MATRIX_JSON" != "null" ]; then
matrix_key=$(echo "$MATRIX_JSON" | jq 'paths(type != "object") as $p | ($p | join("-")) + "=" + (getpath($p) | tostring)' | jq -rs 'join(";") | . + ";"')
fi
restore_key='${{ inputs.cache-name }};os=${{ runner.os }};${matrix_key}'
restore_key="${{ inputs.cache-name }};os=${{ runner.os }};${matrix_key}"
# URL encode any restricted characters:
# https://github.com/actions/toolkit/blob/5430c5d84832076372990c7c27f900878ff66dc9/packages/cache/src/cache.ts#L38-L43
restore_key=$(sed 's/,/%2C/g' <<<"${restore_key}")
@@ -120,7 +121,7 @@ runs:
env:
MATRIX_JSON: ${{ toJSON(matrix) }}
- uses: actions/cache@0c45773b623bea8c8e75f6c82b208c3cf94ea4f9 # v4.0.2
- uses: actions/cache@1bd1e32a3bdc45362d1e726936510720a7c30a57 # v4.2.0
id: cache
with:
path: |
@@ -171,7 +172,7 @@ runs:
# - https://docs.github.com/en/actions/using-workflows/caching-dependencies-to-speed-up-workflows#usage-limits-and-eviction-policy
# Not windows
- uses: pyTooling/Actions/with-post-step@e9d0dc3dba9fda45f195946858708f60c0240caf # v1.0.5
- uses: pyTooling/Actions/with-post-step@9ceefdbf5dceae8c441fc393ed82344c7ca8bbdb # v3.1.1
if: ${{ inputs.delete-old-caches != 'false' &&
github.ref != format('refs/heads/{0}', github.event.repository.default_branch) &&
runner.OS != 'Windows' }}
@@ -179,18 +180,18 @@ runs:
# seems like there has to be a `main` step in this action. Could list caches for info if we wanted
# main: julia ${{ github.action_path }}/handle_caches.jl "${{ github.repository }}" "list"
main: echo ""
post: julia $GITHUB_ACTION_PATH/handle_caches.jl rm '${{ github.repository }}' '${{ steps.keys.outputs.restore-key }}' '${{ github.ref }}' "${{ inputs.delete-old-caches != 'required' }}"
post: julia $GITHUB_ACTION_PATH/handle_caches.jl rm "${{ github.repository }}" "${{ steps.keys.outputs.restore-key }}" "${{ github.ref }}" "${{ inputs.delete-old-caches != 'required' }}"
env:
GH_TOKEN: ${{ inputs.token }}
# Windows (because this action uses command prompt on windows)
- uses: pyTooling/Actions/with-post-step@e9d0dc3dba9fda45f195946858708f60c0240caf # v1.0.5
- uses: pyTooling/Actions/with-post-step@9ceefdbf5dceae8c441fc393ed82344c7ca8bbdb # v3.1.1
if: ${{ inputs.delete-old-caches != 'false' &&
github.ref != format('refs/heads/{0}', github.event.repository.default_branch) &&
runner.OS == 'Windows' }}
with:
main: echo ""
post: cd %GITHUB_ACTION_PATH% && julia handle_caches.jl rm '${{ github.repository }}' '${{ steps.keys.outputs.restore-key }}' '${{ github.ref }}' "${{ inputs.delete-old-caches != 'required' }}"
post: cd %GITHUB_ACTION_PATH% && julia handle_caches.jl rm "${{ github.repository }}" "${{ steps.keys.outputs.restore-key }}" "${{ github.ref }}" "${{ inputs.delete-old-caches != 'required' }}"
env:
GH_TOKEN: ${{ inputs.token }}