Run: https://github.com/githubnext/gh-aw-test/actions/runs/33145643407 · Generated: 2026-08-28T07:19:25Z
Performance history for copilot-create-issue.md
Run, job & step times (main, using inference)
68 successful runs. Regressions shown below are limited to the last six weeks.
| Run or job |
Samples |
Median |
P90 |
| Workflow complete |
68 |
335.0s |
441.6s |
| Workflow start to proxy step |
68 |
108.5s |
144.8s |
| Proxy step to first reasoning/sample |
68 |
20.5s |
27.3s |
Job activation |
68 |
45.5s |
74.3s |
Job agent |
68 |
89.0s |
172.3s |
Job detection |
68 |
72.0s |
96.3s |
Job safe_outputs |
68 |
38.0s |
64.9s |
Job conclusion |
68 |
41.5s |
58.6s |
Major step Execute GitHub Copilot CLI |
68 |
28.0s |
114.0s |
Major step Set up job |
68 |
17.0s |
21.3s |
Major step Install ripgrep |
6 |
14.0s |
19.0s |
Major step Download container images |
68 |
11.0s |
18.3s |
Major step Start MCP Gateway |
68 |
6.0s |
11.0s |
Major step Install GitHub Copilot CLI |
68 |
4.0s |
9.0s |
Major step Setup Scripts |
67 |
3.0s |
5.0s |
Major step Download activation artifact |
36 |
2.0s |
2.0s |
Major step Upload agent artifacts |
25 |
2.0s |
2.0s |
Major step Checkout repository |
15 |
2.0s |
2.0s |
Major step Install AWF binary |
4 |
2.0s |
2.0s |
Major step Stop MCP Gateway |
9 |
2.0s |
2.0s |
Major step Print firewall logs |
1 |
2.0s |
2.0s |
Major step Audit pre-agent workspace |
1 |
2.0s |
2.0s |
Major step times for job activation (main, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-25 to 2026-07-27 |
Set up job |
75.0s |
29.5s |
154% |
#325 |
v0.83.3-17-g11d9ea9de7 / 11d9ea9de729 |
| R2 |
2026-08-08 |
Set up job |
63.0s |
34.5s |
83% |
#341 |
v0.86.1-57-gba0a9f9589 / ba0a9f958976 |
| R3 |
2026-08-08 |
Setup Scripts |
18.0s |
3.0s |
500% |
#341 |
v0.86.1-57-gba0a9f9589 / ba0a9f958976 |
| R4 |
2026-08-17 |
Set up job |
48.0s |
31.5s |
52% |
#352 |
v0.87.0-133-g2b2cf3fb01 / 2b2cf3fb01ee |
Major step times for job agent (main, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-08-07 |
Download container images |
24.0s |
11.0s |
118% |
#340 |
v0.86.1-3-ge1e298d64b / e1e298d64bfa |
| R2 |
2026-08-07 |
Execute GitHub Copilot CLI |
38.0s |
22.5s |
69% |
#340 |
v0.86.1-3-ge1e298d64b / e1e298d64bfa |
| R3 |
2026-08-14 |
Execute GitHub Copilot CLI |
38.0s |
23.0s |
65% |
#349 |
v0.86.2-73-gc35faf436c / c35faf436c79 |
Major step times for job detection (main, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-16 to 2026-07-18 |
Execute GitHub Copilot CLI |
116.0s |
25.5s |
355% |
#317 |
v0.82.12-7-gc096ffebd2 / c096ffebd27f |
| R2 |
2026-07-21 |
Set up job |
30.0s |
16.0s |
88% |
#321 |
v0.82.15-23-g2a7ac3d34e / 2a7ac3d34e2d |
| R3 |
2026-08-18 |
Execute GitHub Copilot CLI |
50.0s |
31.5s |
59% |
#353 |
v0.87.1-4-g4845f00caf / 4845f00caf46 |
| R4 |
2026-08-24 |
Download container images |
12.0s |
1.0s |
1100% |
#437 |
5f0cc8dcc8 / 5f0cc8dcc819 |
Major step times for job safe_outputs (main, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-21 |
Set up job |
51.0s |
26.5s |
92% |
#321 |
v0.82.15-23-g2a7ac3d34e / 2a7ac3d34e2d |
| R2 |
2026-07-25 |
Set up job |
61.0s |
25.5s |
139% |
#325 |
v0.83.3-17-g11d9ea9de7 / 11d9ea9de729 |
| R3 |
2026-08-01 to 2026-08-03 |
Set up job |
89.0s |
34.5s |
158% |
#334 |
v0.84.3-58-g53baccde53 / 53baccde5390 |
| R4 |
2026-08-03 |
Setup Scripts |
41.0s |
4.5s |
811% |
#334 |
v0.84.3-58-g53baccde53 / 53baccde5390 |
| R5 |
2026-08-14 to 2026-08-16 |
Set up job |
69.0s |
29.0s |
138% |
#349 |
v0.86.2-73-gc35faf436c / c35faf436c79 |
| R6 |
2026-08-25 |
Download agent output artifact |
12.0s |
1.0s |
1100% |
#445 |
818e3a3863 / 818e3a386376 |
Major step times for job conclusion (main, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-15 to 2026-07-17 |
Set up job |
58.0s |
26.5s |
119% |
#317 |
v0.82.12-7-gc096ffebd2 / c096ffebd27f |
| R2 |
2026-07-30 to 2026-08-02 |
Set up job |
59.0s |
29.5s |
100% |
#333 |
v0.84.2-95-gf5bd99245e / f5bd99245e40 |
| R3 |
2026-08-03 |
Setup Scripts |
14.0s |
4.0s |
250% |
#334 |
v0.84.3-58-g53baccde53 / 53baccde5390 |
| R4 |
2026-08-17 |
Upload usage artifact |
11.0s |
1.0s |
1000% |
#352 |
v0.87.0-133-g2b2cf3fb01 / 2b2cf3fb01ee |
| R5 |
2026-08-19 |
Set up job |
48.0s |
28.0s |
71% |
#354 |
v0.87.1-44-g5d5e0af5c4 / 5d5e0af5c46c |
Run, job & step times (released, using inference)
36 successful runs. Regressions shown below are limited to the last six weeks.
| Run or job |
Samples |
Median |
P90 |
| Workflow complete |
36 |
217.0s |
309.5s |
| Workflow start to proxy step |
36 |
62.0s |
89.5s |
| Proxy step to first reasoning/sample |
33 |
21.2s |
27.8s |
Job activation |
36 |
17.0s |
35.0s |
Job agent |
36 |
73.0s |
157.0s |
Job detection |
36 |
53.5s |
72.5s |
Job safe_outputs |
36 |
12.0s |
14.0s |
Job conclusion |
36 |
14.5s |
20.5s |
Major step Execute GitHub Copilot CLI |
36 |
29.5s |
115.5s |
Major step Download container images |
36 |
12.0s |
17.0s |
Major step Install ripgrep |
3 |
12.0s |
14.4s |
Major step Start MCP Gateway |
36 |
6.0s |
8.5s |
Major step Install GitHub Copilot CLI |
36 |
4.0s |
8.5s |
Major step Set up job |
34 |
3.0s |
4.0s |
Major step Setup Scripts |
33 |
3.0s |
4.0s |
Major step Stop MCP Gateway |
5 |
2.0s |
2.0s |
Major step Install AWF binary |
3 |
2.0s |
2.0s |
Major step Download activation artifact |
10 |
2.0s |
2.0s |
Major step Upload agent artifacts |
7 |
2.0s |
2.0s |
Major step Checkout repository |
9 |
2.0s |
2.2s |
Major step times for job activation (released, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-23 to 2026-07-24 |
Set up job |
29.0s |
3.5s |
729% |
#421 |
v0.83.2 / 56a38be41a18 |
| R2 |
2026-07-23 |
Setup Scripts |
14.0s |
2.5s |
460% |
#420 |
v0.83.1 / 6268b9870d9f |
Major step times for job agent (released, using inference)
Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job detection (released, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-08-07 |
Install GitHub Copilot CLI |
15.0s |
4.0s |
275% |
#430 |
v0.86.1 / 475927dfc6d1 |
| R2 |
2026-08-15 |
Execute GitHub Copilot CLI |
36.0s |
23.5s |
53% |
#432 |
v0.86.3 / 6062cd2238b6 |
Major step times for job safe_outputs (released, using inference)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-08-07 |
Setup Scripts |
20.0s |
2.0s |
900% |
#430 |
v0.86.1 / 475927dfc6d1 |
Major step times for job conclusion (released, using inference)
Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Run, job & step times (main, using samples)
64 successful runs. Regressions shown below are limited to the last six weeks.
| Run or job |
Samples |
Median |
P90 |
| Workflow complete |
64 |
192.0s |
243.5s |
| Workflow start to proxy step |
64 |
98.0s |
120.4s |
| Proxy step to first reasoning/sample |
64 |
0.0s |
0.0s |
Job activation |
64 |
45.0s |
63.1s |
Job agent |
64 |
44.0s |
56.7s |
Job detection |
0 |
n/a |
n/a |
Job safe_outputs |
64 |
31.0s |
42.7s |
Job conclusion |
64 |
34.5s |
58.2s |
Major step Download container images |
64 |
9.0s |
12.7s |
Major step Set up job |
64 |
7.0s |
12.0s |
Major step Start MCP Gateway |
64 |
6.5s |
11.0s |
Major step Install GitHub Copilot CLI |
64 |
4.0s |
5.0s |
Major step Setup Scripts |
63 |
2.0s |
4.0s |
Major step Checkout repository |
9 |
2.0s |
2.0s |
Major step Install AWF binary |
3 |
2.0s |
2.0s |
Major step Download activation artifact |
18 |
2.0s |
2.0s |
Major step Upload agent artifacts |
11 |
2.0s |
2.0s |
Major step Stop MCP Gateway |
6 |
2.0s |
2.0s |
Major step times for job activation (main, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-20 |
Set up job |
94.0s |
33.5s |
181% |
#239 |
7bdc455764 / 7bdc455764ae |
| R2 |
2026-07-27 |
Set up job |
46.0s |
28.0s |
64% |
#266 |
55b5181bb8 / 55b5181bb855 |
Major step times for job agent (main, using samples)
Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job detection (main, using samples)
Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job safe_outputs (main, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-29 to 2026-08-02 |
Set up job |
37.0s |
20.5s |
80% |
#279 |
a9137e1445 / a9137e144504 |
| R2 |
2026-08-24 |
Set up job |
54.0s |
27.5s |
96% |
#438 |
5f0cc8dcc8 / 5f0cc8dcc819 |
Major step times for job conclusion (main, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-27 to 2026-07-29 |
Set up job |
49.0s |
17.0s |
188% |
#270 |
acc797bbab / acc797bbab36 |
| R2 |
2026-08-28 |
Setup Scripts |
15.0s |
3.0s |
400% |
#454 |
76f6ea7c22 / 76f6ea7c2220 |
Run, job & step times (released, using samples)
100 successful runs. Regressions shown below are limited to the last six weeks.
| Run or job |
Samples |
Median |
P90 |
| Workflow complete |
100 |
117.0s |
160.1s |
| Workflow start to proxy step |
100 |
61.0s |
92.1s |
| Proxy step to first reasoning/sample |
100 |
0.0s |
1.0s |
Job activation |
100 |
17.0s |
32.4s |
Job agent |
100 |
40.0s |
52.2s |
Job detection |
0 |
n/a |
n/a |
Job safe_outputs |
100 |
12.0s |
20.1s |
Job conclusion |
100 |
16.0s |
20.1s |
Major step Install ripgrep |
6 |
9.5s |
20.0s |
Major step Download container images |
100 |
9.0s |
14.1s |
Major step Start MCP Gateway |
100 |
7.0s |
12.0s |
Major step Install GitHub Copilot CLI |
100 |
4.0s |
8.0s |
Major step Set up job |
84 |
2.0s |
4.7s |
Major step Setup Scripts |
89 |
2.0s |
4.0s |
Major step Install AWF binary |
7 |
2.0s |
2.4s |
Major step Download activation artifact |
33 |
2.0s |
2.0s |
Major step Upload agent artifacts |
22 |
2.0s |
2.0s |
Major step Stop MCP Gateway |
11 |
2.0s |
2.0s |
Major step Checkout repository |
4 |
2.0s |
2.0s |
Major step times for job activation (released, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-18 to 2026-07-20 |
Setup Scripts |
33.0s |
2.0s |
1550% |
#241 |
v0.82.13 / 017cdbc1b474 |
| R2 |
2026-07-23 to 2026-07-27 |
Set up job |
21.0s |
3.0s |
600% |
#264 |
v0.83.4 / bbb804287845 |
| R3 |
2026-07-25 |
Setup Scripts |
18.0s |
2.5s |
620% |
#268 |
v0.83.3 / 7e728ffd6fc9 |
| R4 |
2026-08-25 |
Setup Scripts |
14.0s |
2.5s |
460% |
#452 |
v0.87.5 / 654cf351a595 |
Major step times for job agent (released, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-24 to 2026-07-25 |
Download container images |
24.0s |
8.0s |
200% |
#263 |
v0.83.3 / 7e728ffd6fc9 |
| R2 |
2026-07-27 |
Set up job |
28.0s |
3.0s |
833% |
#269 |
v0.83.4 / bbb804287845 |
| R3 |
2026-08-11 |
Download container images |
27.0s |
12.0s |
125% |
#398 |
v0.86.2 / 48e5fa3ff522 |
| R4 |
2026-08-11 |
Install GitHub Copilot CLI |
15.0s |
4.0s |
275% |
#398 |
v0.86.2 / 48e5fa3ff522 |
| R5 |
2026-08-22 |
Install GitHub Copilot CLI |
20.0s |
7.0s |
186% |
#399 |
v0.87.4 / 83d6315352f7 |
Major step times for job detection (released, using samples)
Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job safe_outputs (released, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-23 |
Set up job |
14.0s |
2.5s |
460% |
#251 |
v0.83.1 / 6268b9870d9f |
| R2 |
2026-07-25 |
Setup Scripts |
20.0s |
2.0s |
900% |
#268 |
v0.83.3 / 7e728ffd6fc9 |
| R3 |
2026-07-27 |
Set up job |
29.0s |
3.0s |
867% |
#264 |
v0.83.4 / bbb804287845 |
Major step times for job conclusion (released, using samples)
Candidate regressions (last six weeks)
| Label |
Episode |
Step |
Peak |
Prior median |
Increase |
Run |
gh-aw version / commit |
| R1 |
2026-07-23 |
Set up job |
23.0s |
3.0s |
667% |
#251 |
v0.83.1 / 6268b9870d9f |
| R2 |
2026-07-27 |
Set up job |
16.0s |
2.5s |
540% |
#264 |
v0.83.4 / bbb804287845 |
Method
Each section fixes both independent dimensions: gh-aw source (main or combined stable/pre-release released) and execution mode (inference or samples). Only overall-successful workflow_dispatch runs with a successful agent job are included. Candidate regression baselines use up to ten preceding observations from the same section and step; displayed regression episodes are limited to the six weeks before report generation. A step is graphed when it has a sustained cost, recent slowdown, or recent regression. Runs with missing compiler metadata remain in CSV/JSON but are excluded from graphs.
Previous performance reports (closed by this run)
Run: https://github.com/githubnext/gh-aw-test/actions/runs/33145643407 · Generated:
2026-08-28T07:19:25ZPerformance history for
copilot-create-issue.mdRun, job & step times (
main, using inference)68 successful runs. Regressions shown below are limited to the last six weeks.
activationagentdetectionsafe_outputsconclusionExecute GitHub Copilot CLISet up jobInstall ripgrepDownload container imagesStart MCP GatewayInstall GitHub Copilot CLISetup ScriptsDownload activation artifactUpload agent artifactsCheckout repositoryInstall AWF binaryStop MCP GatewayPrint firewall logsAudit pre-agent workspaceMajor step times for job
activation(main, using inference)Candidate regressions (last six weeks)
v0.83.3-17-g11d9ea9de7/11d9ea9de729v0.86.1-57-gba0a9f9589/ba0a9f958976v0.86.1-57-gba0a9f9589/ba0a9f958976v0.87.0-133-g2b2cf3fb01/2b2cf3fb01eeMajor step times for job
agent(main, using inference)Candidate regressions (last six weeks)
v0.86.1-3-ge1e298d64b/e1e298d64bfav0.86.1-3-ge1e298d64b/e1e298d64bfav0.86.2-73-gc35faf436c/c35faf436c79Major step times for job
detection(main, using inference)Candidate regressions (last six weeks)
v0.82.12-7-gc096ffebd2/c096ffebd27fv0.82.15-23-g2a7ac3d34e/2a7ac3d34e2dv0.87.1-4-g4845f00caf/4845f00caf465f0cc8dcc8/5f0cc8dcc819Major step times for job
safe_outputs(main, using inference)Candidate regressions (last six weeks)
v0.82.15-23-g2a7ac3d34e/2a7ac3d34e2dv0.83.3-17-g11d9ea9de7/11d9ea9de729v0.84.3-58-g53baccde53/53baccde5390v0.84.3-58-g53baccde53/53baccde5390v0.86.2-73-gc35faf436c/c35faf436c79818e3a3863/818e3a386376Major step times for job
conclusion(main, using inference)Candidate regressions (last six weeks)
v0.82.12-7-gc096ffebd2/c096ffebd27fv0.84.2-95-gf5bd99245e/f5bd99245e40v0.84.3-58-g53baccde53/53baccde5390v0.87.0-133-g2b2cf3fb01/2b2cf3fb01eev0.87.1-44-g5d5e0af5c4/5d5e0af5c46cRun, job & step times (
released, using inference)36 successful runs. Regressions shown below are limited to the last six weeks.
activationagentdetectionsafe_outputsconclusionExecute GitHub Copilot CLIDownload container imagesInstall ripgrepStart MCP GatewayInstall GitHub Copilot CLISet up jobSetup ScriptsStop MCP GatewayInstall AWF binaryDownload activation artifactUpload agent artifactsCheckout repositoryMajor step times for job
activation(released, using inference)Candidate regressions (last six weeks)
v0.83.2/56a38be41a18v0.83.1/6268b9870d9fMajor step times for job
agent(released, using inference)Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job
detection(released, using inference)Candidate regressions (last six weeks)
v0.86.1/475927dfc6d1v0.86.3/6062cd2238b6Major step times for job
safe_outputs(released, using inference)Candidate regressions (last six weeks)
v0.86.1/475927dfc6d1Major step times for job
conclusion(released, using inference)Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Run, job & step times (
main, using samples)64 successful runs. Regressions shown below are limited to the last six weeks.
activationagentdetectionsafe_outputsconclusionDownload container imagesSet up jobStart MCP GatewayInstall GitHub Copilot CLISetup ScriptsCheckout repositoryInstall AWF binaryDownload activation artifactUpload agent artifactsStop MCP GatewayMajor step times for job
activation(main, using samples)Candidate regressions (last six weeks)
7bdc455764/7bdc455764ae55b5181bb8/55b5181bb855Major step times for job
agent(main, using samples)Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job
detection(main, using samples)Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job
safe_outputs(main, using samples)Candidate regressions (last six weeks)
a9137e1445/a9137e1445045f0cc8dcc8/5f0cc8dcc819Major step times for job
conclusion(main, using samples)Candidate regressions (last six weeks)
acc797bbab/acc797bbab3676f6ea7c22/76f6ea7c2220Run, job & step times (
released, using samples)100 successful runs. Regressions shown below are limited to the last six weeks.
activationagentdetectionsafe_outputsconclusionInstall ripgrepDownload container imagesStart MCP GatewayInstall GitHub Copilot CLISet up jobSetup ScriptsInstall AWF binaryDownload activation artifactUpload agent artifactsStop MCP GatewayCheckout repositoryMajor step times for job
activation(released, using samples)Candidate regressions (last six weeks)
v0.82.13/017cdbc1b474v0.83.4/bbb804287845v0.83.3/7e728ffd6fc9v0.87.5/654cf351a595Major step times for job
agent(released, using samples)Candidate regressions (last six weeks)
v0.83.3/7e728ffd6fc9v0.83.4/bbb804287845v0.86.2/48e5fa3ff522v0.86.2/48e5fa3ff522v0.87.4/83d6315352f7Major step times for job
detection(released, using samples)Candidate regressions (last six weeks)
No candidate regressions in the last six weeks.
Major step times for job
safe_outputs(released, using samples)Candidate regressions (last six weeks)
v0.83.1/6268b9870d9fv0.83.3/7e728ffd6fc9v0.83.4/bbb804287845Major step times for job
conclusion(released, using samples)Candidate regressions (last six weeks)
v0.83.1/6268b9870d9fv0.83.4/bbb804287845Method
Each section fixes both independent dimensions: gh-aw source (
mainor combined stable/pre-releasereleased) and execution mode (inferenceorsamples). Only overall-successfulworkflow_dispatchruns with a successfulagentjob are included. Candidate regression baselines use up to ten preceding observations from the same section and step; displayed regression episodes are limited to the six weeks before report generation. A step is graphed when it has a sustained cost, recent slowdown, or recent regression. Runs with missing compiler metadata remain in CSV/JSON but are excluded from graphs.Previous performance reports (closed by this run)