Hi all SIGs!
As we all switched (for SIGs) to gitlab.com in the last months (and final archive was done for all /rpms/* and other projects still on pagure/git.centos.org) some SIGs started to explore other gitlab features, like CI/CD.
We got this week a warning from Gitlab about our CentOS project almost reaching the allocated quota in our sponsored account there, but it should be reset on monthly basis and it shouldn't be blocking any of your CI/CD pipelines for this week.
But we still need to verify about which SIGs are (ab)using the "compute minutes" allocated for our account and find a better/optimized way to let you still use CI/CD features, but maybe by offloading to some dedicated runners we'd spin up in our own infra . I just created yesterday ticket https://gitlab.com/CentOS/infra/tracker/-/issues/1743 to track this (but need some investigation and time which I had not planned to spent on gitlab for now)
Actually the top 3 projects/groups under CentOS org on gitlab using computes minutes for August are :
- https://gitlab.com/CentOS/automotive/src/automotive-image-builder (~17200 minutes so far) - https://gitlab.com/CentOS/Hyperscale/rpms/systemd (~5400 minutes so far) - https://gitlab.com/CentOS/kmods/rpms/kernel (~1300 minutes so far)
We clearly see an exponential growth for compute minutes usage, but we'd also remind each SIG/project hosted there to be "good citizen" and so think that they are quotas in place that would eventually impact other hosted projects.
Hi,
While one of the three projects mentioned with the most used compute minutes is from the Kmods SIG, I suspect that the smaller kmod-* packages also contribute significantly due to their number. Is it possible to get the total number of compute minutes used by the CentOS/kmods group in August? Or even a detailed list of the compute minutes used per project in August? I couldn't find this data in GitLab. This would be very helpful for knowing which projects to look at more closely and trying to reduce the compute minutes used.
Concerning CentOS/kmods/rpms/kernel: I have implemented a change which will hopefully significantly reduce the compute minutes used by this project. Let's see what the numbers look like next month.
On 28/08/2025 09.54, Fabian Arrotin wrote:
Hi all SIGs!
As we all switched (for SIGs) to gitlab.com in the last months (and final archive was done for all /rpms/* and other projects still on pagure/git.centos.org) some SIGs started to explore other gitlab features, like CI/CD.
We got this week a warning from Gitlab about our CentOS project almost reaching the allocated quota in our sponsored account there, but it should be reset on monthly basis and it shouldn't be blocking any of your CI/CD pipelines for this week.
But we still need to verify about which SIGs are (ab)using the "compute minutes" allocated for our account and find a better/optimized way to let you still use CI/CD features, but maybe by offloading to some dedicated runners we'd spin up in our own infra . I just created yesterday ticket https://gitlab.com/CentOS/infra/ tracker/-/issues/1743 to track this (but need some investigation and time which I had not planned to spent on gitlab for now)
Actually the top 3 projects/groups under CentOS org on gitlab using computes minutes for August are :
(~17200 minutes so far)
- https://gitlab.com/CentOS/Hyperscale/rpms/systemd (~5400 minutes so far)
- https://gitlab.com/CentOS/kmods/rpms/kernel (~1300 minutes so far)
We clearly see an exponential growth for compute minutes usage, but we'd also remind each SIG/project hosted there to be "good citizen" and so think that they are quotas in place that would eventually impact other hosted projects.
devel mailing list -- devel@lists.centos.org To unsubscribe send an email to devel-leave@lists.centos.org
On 29/08/2025 14:57, Peter Georg wrote:
Hi,
While one of the three projects mentioned with the most used compute minutes is from the Kmods SIG, I suspect that the smaller kmod-* packages also contribute significantly due to their number. Is it possible to get the total number of compute minutes used by the CentOS/ kmods group in August? Or even a detailed list of the compute minutes used per project in August? I couldn't find this data in GitLab. This would be very helpful for knowing which projects to look at more closely and trying to reduce the compute minutes used.
Concerning CentOS/kmods/rpms/kernel: I have implemented a change which will hopefully significantly reduce the compute minutes used by this project. Let's see what the numbers look like next month.
I initially didn't want to send all details (don't want to give impression to do "finger pointing") but otoh, it's good for awareness and visibility so you'll find the list below , with statistics for August. Worth knowing that there was a reset on September 1st (yesterday) so no CI/CD pipeline/job was affected, but still something to investigate and worth adding docs about shared runners and (ab)using duffy ci machines (https://docs.centos.org/centos-sig-guide/ci/#duffy-ephemeral-bare-metalvirtu...)
So something like : gitlab runner, spinning ephemeral container for each job and depending on the job, people can then also request duffy ci ephemeral machines to cover multiple versions/architectures. I'll hope to have time to design a simple PoC around this, but have currently priority elsewhere :)
Here is the list for August :
Project Instance runner duration (in min) / Compute usage
CentOS / automotive / src / automotive-image-builder 36737.88 18385
CentOS / Hyperscale SIG / RPMs / systemd 11773.77 5890
CentOS / kmods / rpms / kernel 2653.75 1329
CentOS / automotive / sig-docs 2156.12 1080
CentOS / Docs / docs.centos.org 1147.48 577
CentOS / kmods / src / kmod-qla2xxx 863.78 434
CentOS / kmods / src / kmod-afs 848.65 426
CentOS / kmods / rpms / kmod-nvidia-open 812.20 408
CentOS / kmods / src / kmod-hpsa 807.82 406
CentOS / kmods / src / kmod-mpt3sas 789.80 397
CentOS / kmods / src / kmod-ecryptfs 769.18 386
CentOS / kmods / src / kmod-lpfc 739.52 371
CentOS / kmods / src / kmod-mptsas 738.33 371
CentOS / kmods / src / kmod-megaraid_sas 736.65 370
CentOS / kmods / src / kmod-mptspi 709.90 356
CentOS / kmods / src / kmod-vbox-guest-additions 697.95 350
CentOS / kmods / src / kmod-mptfc 688.50 346
CentOS / kmods / src / kmod-be2iscsi 677.25 340
CentOS / kmods / rpms / kmod-nvidia-open-570 648.95 326
CentOS / kmods / src / kmod-be2net 647.53 325 C CentOS / kmods / src / kmod-stex 622.63 312
CentOS / kmods / src / kmod-aacraid 613.72 308
CentOS / kmods / src / kmod-ntfs3 572.57 287
CentOS / kmods / src / kmod-arcmsr 557.30 280
CentOS / kmods / src / kmod-mlx4 552.25 277
CentOS / kmods / src / kmod-qla4xxx 525.08 264
CentOS / kmods / src / kmod-jme 494.67 248
CentOS / kmods / src / kmod-3w-sas 489.58 246
CentOS / kmods / src / kmod-via-rhine 484.42 243
CentOS / kmods / src / kmod-megaraid_mbox 480.02 241
CentOS / kmods / src / kmod-mvsas 476.63 239
CentOS / kmods / src / kmod-via-velocity 459.02 231
CentOS / kmods / src / kmod-3w-xxxx 449.58 226
CentOS / kmods / src / kmod-3w-9xxx 434.75 218
CentOS / kmods / src / kmod-isci 421.17 211
CentOS / kmods / rpms / kmod-nvidia-open-535 345.58 174
CentOS / kmods / src / kmod-btrfs 339.52 170
CentOS / automotive / container-images / autosd-buildbox 317.35 158
CentOS / kmods / src / kmod-spi-altera 289.83 145
CentOS / kmods / sig 283.57 141 C CentOS / kmods / ci-image 273.05 137
CentOS / kmods / rpms / CentOS-repos-kmods 253.58 126
CentOS / kmods / rpms / btrfs-progs 244.32 123
CentOS / kmods / kabi 243.45 122
CentOS / kmods / src / kmod-i2c-ocores 238.43 119
CentOS / kmods / src / kmod-esas2r 221.23 111
CentOS / kmods / src / kmod-i2c-xiic 212.18 106
CentOS / kmods / src / kmod-spi-xilinx 206.68 103
CentOS / kmods / src / kmod-sky2 192.07 96
CentOS / kmods / src / kmod-e100 179.95 90
CentOS / kmods / src / kmod-sata_mv 176.68 88
CentOS / kmods / rpms / kmod-afs 176.30 88
CentOS / kmods / src / kmod-typhoon 170.93 85
CentOS / kmods / src / kmod-pata_amd 167.50 84
CentOS / kmods / src / kmod-sata_via 165.42 83
CentOS / kmods / kernel 81.32 82
CentOS / kmods / src / kmod-iwlegacy 162.58 81
CentOS / kmods / src / kmod-skge 160.15 80
CentOS / kmods / src / kmod-forcedeth 156.20 78
CentOS / kmods / src / kmod-xt_time 154.27 77 C CentOS / kmods / src / kmod-qlcnic 154.27 77
CentOS / kmods / src / kmod-sata_sil24 149.57 75
CentOS / kmods / src / kmod-sata_sis 147.53 74
CentOS / kmods / src / kmod-pata_atiixp 142.68 71
CentOS / kmods / src / kmod-3c59x 139.20 70
CentOS / kmods / src / kmod-sata_nv 135.73 68
CentOS / kmods / src / kmod-sata_uli 133.78 67
CentOS / kmods / src / kmod-sata_sil 132.65 66
CentOS / kmods / src / kmod-exfat 132.07 66
CentOS / kmods / rpms / kmod-ecryptfs 132.18 66
CentOS / kmods / rpms / kmod-mptfc 129.45 64
CentOS / kmods / src / kmod-floppy 128.58 64
CentOS / kmods / src / kmod-pata_jmicron 126.58 63
CentOS / kmods / rpms / kmod-mptspi 122.48 61
CentOS / kmods / rpms / kmod-be2iscsi 122.30 61
CentOS / kmods / src / kmod-pata_pdc2027x 121.88 61
CentOS / kmods / rpms / kmod-ntfs3 121.75 61
CentOS / kmods / rpms / ecryptfs-utils 120.20 60
CentOS / kmods / rpms / kmod-lpfc 117.38 58
CentOS / kmods / rpms / kmod-megaraid_sas 115.70 58 C CentOS / kmods / rpms / kmod-wireguard 114.57 57
CentOS / kmods / rpms / kmod-mptsas 113.33 56
CentOS / kmods / rpms / kmod-hpsa 110.47 55
CentOS / kmods / rpms / kmod-qla2xxx 109.17 54
CentOS / kmods / src / kmod-sata_promise 108.88 54
CentOS / kmods / rpms / kmod-mpt3sas 108.93 54
CentOS / kmods / rpms / kmod-aacraid 106.65 53
CentOS / kmods / src / kmod-ptp_ocp 101.67 51
CentOS / kmods / src / kmod-pata_via 98.37 49
CentOS / kmods / rpms / kmod-vbox-guest-additions 82.57 41
CentOS / kmods / rpms / kmod-esas2r 80.08 40
CentOS / kmods / rpms / kmod-megaraid_mbox 77.20 38
CentOS / kmods / rpms / kmod-be2net 74.78 37
CentOS / kmods / rpms / kmod-spi-altera 74.25 37
CentOS / kmods / rpms / kmod-mvsas 73.68 36
CentOS / kmods / rpms / kmod-stex 73.57 36
CentOS / kmods / rpms / kmod-via-rhine 73.43 36
CentOS / kmods / rpms / kmod-jme 72.12 36
CentOS / kmods / rpms / kmod-qla4xxx 71.75 35
CentOS / kmods / rpms / kmod-i2c-ocores 71.00 35 C CentOS / kmods / rpms / kmod-spi-xilinx 70.68 35
CentOS / kmods / rpms / pkcs11-helper 69.67 35
CentOS / kmods / rpms / kmod-3w-9xxx 69.70 34
CentOS / kmods / rpms / kmod-3w-sas 69.65 34
CentOS / kmods / rpms / kmod-arcmsr 69.15 34
CentOS / Hyperscale SIG / RPMs / qemu 69.28 34
CentOS / kmods / rpms / kmod-3w-xxxx 69.07 34
CentOS / kmods / rpms / kafs-client 68.53 34
CentOS / kmods / rpms / kmod-mlx4 67.35 33
CentOS / kmods / rpms / kmod-i2c-xiic 67.32 33
CentOS / kmods / rpms / kBuild 67.07 33
CentOS / kmods / rpms / kmod-via-velocity 64.30 32
CentOS / automotive / rpms / kmod-qcom-scmi 60.33 30
CentOS / kmods / rpms / makeself 53.75 27
CentOS / kmods / rpms / kmod-btrfs 53.62 26
CentOS / kmods / rpms / exfatprogs 52.40 26
CentOS / kmods / rpms / virtualbox-guest-additions 42.52 21
CentOS / kmods / rpms / kmod-isci 41.95 21
CentOS / kmods / rpms / CentOS-release-kmods 40.10 20
CentOS / kmods / rpms / yasm 39.35 19 C CentOS / automotive / src / automotive-prototyper 38.97 19
CentOS / automotive / rpms / downstream-dtbs 37.87 19
CentOS / kmods / rpms / trousers 28.10 14
CentOS / kmods / rpms / wireguard-tools 27.43 13
CentOS / automotive / rpms / kmod-memscav 25.33 12
CentOS / automotive / src / ukiboot 17.12 8
CentOS / kmods / rpms / cCentOS-release-kmods-kernel-6.1 6.05 3
CentOS / kmods / rpms / cCentOS-release-kmods-kernel-6.6 6.07 3
CentOS / kmods / rpms / CentOS-release-kmods-kernel 5.58 2
CentOS / kmods / rpms / CentOS-release-kmods-kernel-6.12 4.22 2
CentOS / Integration SIG / containers / tmt 3.07 1
CentOS / storage / rpms / glusterfs 0.12 0