Skip to content

Use aiohttp-retry for requests towards github #131

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Eijebong merged 2 commits into from
Mar 10, 2026

Add auto retry logic for the sync github client

6c456b0
Select commit
Loading
Failed to load commit list.
Merged

Use aiohttp-retry for requests towards github #131

Add auto retry logic for the sync github client
6c456b0
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task succeeded Mar 10, 2026 in 20s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-03-10T15:21:26.648Z
Resolved: 2026-03-10T15:21:42.715Z
Task Execution Time: 16 seconds, 67 milliseconds
Task Status: completed
Reason Resolved: completed
TaskId: do6WUwPBQAatd_AAnx_eew
RunId: 0

Artifacts

- public/actions.json
- public/docker-contexts/fetch.tar.gz
- public/docker-contexts/python.tar.gz
- public/fetch-content
- public/full-task-graph.json
- public/label-to-taskid.json
- public/logs/live_backing.log
- public/logs/live.log
- public/optimizations.log
- public/parameters.yml
- public/runnable-jobs.json
- public/run-task
- public/target-tasks.json
- public/task-graph.json

[taskcluster 2026-03-10T15:21:26.709Z] Worker Type (mozilla-1/decision) settings:
[taskcluster 2026-03-10T15:21:26.709Z]   {
[taskcluster 2026-03-10T15:21:26.709Z]     "config": {
[taskcluster 2026-03-10T15:21:26.709Z]       "deploymentId": ""
[taskcluster 2026-03-10T15:21:26.709Z]     },
[taskcluster 2026-03-10T15:21:26.709Z]     "generic-worker": {
[taskcluster 2026-03-10T15:21:26.709Z]       "config": {
[taskcluster 2026-03-10T15:21:26.709Z]         "headlessTasks": true
[taskcluster 2026-03-10T15:21:26.709Z]       },
[taskcluster 2026-03-10T15:21:26.709Z]       "engine": "multiuser",
[taskcluster 2026-03-10T15:21:26.709Z]       "go-arch": "amd64",
[taskcluster 2026-03-10T15:21:26.709Z]       "go-os": "linux",
[taskcluster 2026-03-10T15:21:26.709Z]       "go-version": "go1.25.5",
[taskcluster 2026-03-10T15:21:26.709Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v95.1.3",
[taskcluster 2026-03-10T15:21:26.709Z]       "revision": "300ac23a15bb11e577f3a3d116a570fde948337e",
[taskcluster 2026-03-10T15:21:26.709Z]       "source": "https://github.com/taskcluster/taskcluster/commits/300ac23a15bb11e577f3a3d116a570fde948337e",
[taskcluster 2026-03-10T15:21:26.709Z]       "version": "95.1.3"
[taskcluster 2026-03-10T15:21:26.709Z]     },
[taskcluster 2026-03-10T15:21:26.709Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2026-01-14",
[taskcluster 2026-03-10T15:21:26.709Z]     "instance-id": "598817799613024325",
[taskcluster 2026-03-10T15:21:26.709Z]     "instance-type": "projects/887720501152/machineTypes/n2-standard-2",
[taskcluster 2026-03-10T15:21:26.709Z]     "local-ipv4": "10.142.0.106",
[taskcluster 2026-03-10T15:21:26.709Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2026-03-10T15:21:26.709Z]     "public-hostname": "mozilla-1-decision-cgryuceerbcp2-zkiime3g.c.fxci-production-level1-workers.internal",
[taskcluster 2026-03-10T15:21:26.709Z]     "public-ipv4": "104.196.0.238",
[taskcluster 2026-03-10T15:21:26.709Z]     "region": "us-east1",
[taskcluster 2026-03-10T15:21:26.709Z]     "zone": "us-east1-d"
[taskcluster 2026-03-10T15:21:26.709Z]   }
[taskcluster 2026-03-10T15:21:26.709Z] Task ID: do6WUwPBQAatd_AAnx_eew
[taskcluster 2026-03-10T15:21:26.709Z] === Task Starting ===
[taskcluster 2026-03-10T15:21:28.497Z] [mounts] No existing writable directory cache 'mozilla-project-simple-github-level-1-checkouts-sparse-v3' - creating /home/generic-worker/caches/R6oK1OPCQXKv9dxifa9LDA
[taskcluster 2026-03-10T15:21:28.497Z] [mounts] Creating directory /home/task_177315608607273/cache0
[taskcluster 2026-03-10T15:21:28.512Z] [mounts] Successfully mounted writable directory cache '/home/task_177315608607273/cache0'
[taskcluster 2026-03-10T15:21:28.512Z] [d2g] Loading docker image
[taskcluster 2026-03-10T15:21:37.352Z] [d2g] Loaded docker image "docker.io/mozillareleases/taskgraph:decision-v19.2.1@sha256:6cf28e0019ac35234e3ad4dc42586161fb77e6791fd593b8440a53f2f8aff8db"
[taskcluster 2026-03-10T15:21:37.352Z] Executing command 0: docker run -t --name taskcontainer_dGsi6jyZT9CLmp-4Crnjyw --memory-swap -1 --pids-limit -1 '--add-host=localhost.localdomain:127.0.0.1' -v /home/task_177315608607273/cache0:/builds/worker/checkouts --add-host=taskcluster:host-gateway --env-file 'env.list' 'mozillareleases/taskgraph:decision-v19.2.1@sha256:6cf28e0019ac35234e3ad4dc42586161fb77e6791fd593b8440a53f2f8aff8db' run-task --simple_github-checkout=/builds/worker/checkouts/src -- bash -cx 'cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='\''0'\'' --pushdate='\''0'\'' --project='\''simple-github'\'' --owner='\''Eijebong@users.noreply.github.com'\'' --level='\''1'\'' --repository-type=git --tasks-for='\''github-pull-request'\'' --base-repository='\''https://github.com/mozilla-releng/simple-github'\'' --base-ref='\''main'\'' --base-rev='\''987215be6e2cadd0459ea6e40ce1ff69527a3db4'\'' --head-repository='\''https://github.com/Eijebong/simple-github'\'' --head-ref='\''retry-5xx'\'' --head-rev='\''6c456b01d1e05460a36963ee89d50cbb98adf11d'\'' 
[taskcluster 2026-03-10T15:21:37.352Z] '
[setup 2026-03-10T15:21:38.761+00:00] run-task started in /
[setup 2026-03-10T15:21:38.761+00:00] Invoked by command: --simple_github-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='simple-github' --owner='Eijebong@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla-releng/simple-github' --base-ref='main' --base-rev='987215be6e2cadd0459ea6e40ce1ff69527a3db4' --head-repository='https://github.com/Eijebong/simple-github' --head-ref='retry-5xx' --head-rev='6c456b01d1e05460a36963ee89d50cbb98adf11d' 

[setup 2026-03-10T15:21:38.761+00:00] Python version: 3.11.2
[setup 2026-03-10T15:21:38.761+00:00] Subprocess python version: 
cpython-3.11.2-linux-x86_64-gnu    /usr/bin/python3.11
cpython-3.11.2-linux-x86_64-gnu    /usr/bin/python3 -> python3.11
[vcs 2026-03-10T15:21:38.872+00:00] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2026-03-10T15:21:38.872+00:00] running as worker:worker
[vcs 2026-03-10T15:21:38.872+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2026-03-10T15:21:38.875+00:00] executing ['git', 'clone', 'https://github.com/mozilla-releng/simple-github', '/builds/worker/checkouts/src']
[vcs 2026-03-10T15:21:38.877+00:00] Cloning into '/builds/worker/checkouts/src'...
[vcs 2026-03-10T15:21:39.331+00:00] executing ['git', 'fetch', 'origin', '987215be6e2cadd0459ea6e40ce1ff69527a3db4']
[vcs 2026-03-10T15:21:39.483+00:00] From https://github.com/mozilla-releng/simple-github
[vcs 2026-03-10T15:21:39.483+00:00]  * branch            987215be6e2cadd0459ea6e40ce1ff69527a3db4 -> FETCH_HEAD
[vcs 2026-03-10T15:21:39.490+00:00] executing ['git', 'fetch', 'https://github.com/Eijebong/simple-github', 'retry-5xx']
[vcs 2026-03-10T15:21:39.713+00:00] From https://github.com/Eijebong/simple-github
[vcs 2026-03-10T15:21:39.713+00:00]  * branch            retry-5xx  -> FETCH_HEAD
[vcs 2026-03-10T15:21:39.715+00:00] executing ['git', 'checkout', '-f', '-B', 'retry-5xx', '6c456b01d1e05460a36963ee89d50cbb98adf11d']
[vcs 2026-03-10T15:21:39.722+00:00] Switched to a new branch 'retry-5xx'
[vcs 2026-03-10T15:21:39.723+00:00] cleaning git checkout...
[vcs 2026-03-10T15:21:39.723+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2026-03-10T15:21:39.725+00:00] removing []
[vcs 2026-03-10T15:21:39.725+00:00] successfully cleaned git checkout!
[vcs 2026-03-10T15:21:39.727+00:00] TinderboxPrint:<a href='https://github.com/Eijebong/simple-github/commit/6c456b01d1e05460a36963ee89d50cbb98adf11d' title='Built from simple-github commit 6c456b01d1e05460a36963ee89d50cbb98adf11d'>6c456b01d1e05460a36963ee89d50cbb98adf11d</a>
[task 2026-03-10T15:21:39.727+00:00] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='simple-github' --owner='Eijebong@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla-releng/simple-github' --base-ref='main' --base-rev='987215be6e2cadd0459ea6e40ce1ff69527a3db4' --head-repository='https://github.com/Eijebong/simple-github' --head-ref='retry-5xx' --head-rev='6c456b01d1e05460a36963ee89d50cbb98adf11d' \n"]
[task 2026-03-10T15:21:39.729+00:00] + cd /builds/worker/checkouts/src
[task 2026-03-10T15:21:39.730+00:00] + ln -s /builds/worker/artifacts artifacts
[task 2026-03-10T15:21:39.731+00:00] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=simple-github --owner=Eijebong@users.noreply.github.com --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla-releng/simple-github --base-ref=main --base-rev=987215be6e2cadd0459ea6e40ce1ff69527a3db4 --head-repository=https://github.com/Eijebong/simple-github --head-ref=retry-5xx --head-rev=6c456b01d1e05460a36963ee89d50cbb98adf11d
[task 2026-03-10T15:21:40.346+00:00] 2026-03-10 15:21:40,346 - INFO - Loading graph configuration.
[task 2026-03-10T15:21:40.355+00:00] 2026-03-10 15:21:40,354 - WARNING - using default project parameters; add simple-github to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2026-03-10T15:21:40.355+00:00] 2026-03-10 15:21:40,355 - INFO - Using Parameters(id=1dba80d17857) (from defaults)
[task 2026-03-10T15:21:40.356+00:00] 2026-03-10 15:21:40,355 - INFO - writing artifact file `parameters.yml`
[task 2026-03-10T15:21:40.365+00:00] 2026-03-10 15:21:40,365 - INFO - writing artifact file `actions.json`
[task 2026-03-10T15:21:40.366+00:00] 2026-03-10 15:21:40,366 - INFO - Loading kinds
[task 2026-03-10T15:21:40.367+00:00] 2026-03-10 15:21:40,367 - INFO - Generating full task set
[task 2026-03-10T15:21:40.416+00:00] 2026-03-10 15:21:40,415 - INFO - Generated 2 tasks for kind test
[task 2026-03-10T15:21:40.421+00:00] 2026-03-10 15:21:40,421 - INFO - Generated 1 tasks for kind fetch
[task 2026-03-10T15:21:40.423+00:00] 2026-03-10 15:21:40,423 - INFO - Writing docker-contexts/fetch.tar.gz for docker image fetch
[task 2026-03-10T15:21:40.427+00:00] 2026-03-10 15:21:40,426 - INFO - Generated 1 tasks for kind codecov
[task 2026-03-10T15:21:40.442+00:00] 2026-03-10 15:21:40,442 - INFO - Writing docker-contexts/python.tar.gz for docker image python
[task 2026-03-10T15:21:40.460+00:00] 2026-03-10 15:21:40,460 - INFO - Generated 2 tasks for kind docker-image
[task 2026-03-10T15:21:40.464+00:00] 2026-03-10 15:21:40,464 - INFO - Generating full task graph
[task 2026-03-10T15:21:40.464+00:00] 2026-03-10 15:21:40,464 - INFO - Full task graph contains 6 tasks and 6 dependencies
[task 2026-03-10T15:21:40.465+00:00] 2026-03-10 15:21:40,465 - INFO - writing artifact file `full-task-graph.json`
[task 2026-03-10T15:21:40.466+00:00] 2026-03-10 15:21:40,466 - INFO - writing artifact file `runnable-jobs.json`
[task 2026-03-10T15:21:40.466+00:00] 2026-03-10 15:21:40,466 - INFO - Generating target task set
[task 2026-03-10T15:21:40.467+00:00] 2026-03-10 15:21:40,466 - INFO - Filter filter_target_tasks pruned 3 tasks (3 remain)
[task 2026-03-10T15:21:40.467+00:00] 2026-03-10 15:21:40,466 - INFO - writing artifact file `target-tasks.json`
[task 2026-03-10T15:21:40.467+00:00] 2026-03-10 15:21:40,467 - INFO - Generating target task graph
[task 2026-03-10T15:21:40.467+00:00] 2026-03-10 15:21:40,467 - INFO - Adding 2 tasks with `always_target` attribute
[task 2026-03-10T15:21:40.467+00:00] 2026-03-10 15:21:40,467 - INFO - Generating optimized task graph
[task 2026-03-10T15:21:40.468+00:00] 2026-03-10 15:21:40,467 - INFO - No tasks removed during optimization
[task 2026-03-10T15:21:40.781+00:00] 2026-03-10 15:21:40,781 - INFO - Replaced 3 tasks by index-search (index-search) during optimization.
[task 2026-03-10T15:21:40.782+00:00] 2026-03-10 15:21:40,782 - INFO - writing artifact file `task-graph.json`
[task 2026-03-10T15:21:40.783+00:00] 2026-03-10 15:21:40,783 - INFO - writing artifact file `label-to-taskid.json`
[task 2026-03-10T15:21:40.785+00:00] 2026-03-10 15:21:40,785 - INFO - Creating task with taskId ZQpdnizDSIeR2h3umcmLuA for test-type-check
[task 2026-03-10T15:21:40.787+00:00] 2026-03-10 15:21:40,787 - INFO - Creating task with taskId MgVhXzKcSJCs2cfTi4529A for test-unit
[task 2026-03-10T15:21:40.962+00:00] 2026-03-10 15:21:40,962 - INFO - Creating task with taskId PqgLMPCkQIWw0sYzYze_bA for codecov-upload
[taskcluster 2026-03-10T15:21:41.313Z]                        Exit Code: 0
[taskcluster 2026-03-10T15:21:41.313Z]                        User Time: 11.914ms
[taskcluster 2026-03-10T15:21:41.313Z]                      Kernel Time: 18.413ms
[taskcluster 2026-03-10T15:21:41.313Z]                        Wall Time: 3.960825883s
[taskcluster 2026-03-10T15:21:41.313Z]  Average Available System Memory: 7.13 GiB
[taskcluster 2026-03-10T15:21:41.313Z]       Average System Memory Used: 637.87 MiB
[taskcluster 2026-03-10T15:21:41.313Z]          Peak System Memory Used: 674.95 MiB
[taskcluster 2026-03-10T15:21:41.313Z]              Total System Memory: 7.75 GiB
[taskcluster 2026-03-10T15:21:41.313Z]                           Result: SUCCEEDED
[taskcluster 2026-03-10T15:21:41.314Z] === Task Finished ===
[taskcluster 2026-03-10T15:21:41.314Z] Task Duration: 3.961857298s
[taskcluster 2026-03-10T15:21:42.204Z] [mounts] Preserving cache: Moving "/home/task_177315608607273/cache0" to "/home/generic-worker/caches/R6oK1OPCQXKv9dxifa9LDA"
View more details on firefoxci-taskcluster