So, while working on the LV for the exported dir for rdo-store, I noticed (and Zabbix complained a lot about this in the last weeks) that the artifacts LV is getting bigger and bigger. Actually, the rdo project is more and more using disk space : 760G rdo
It would be good to do some clean-up there, and only keep what's need to be publicly available (behind http://artifacts.ci.centos.org/rdo/ | https://ci.centos.org/artifacts/rdo/ )
Happy to implement that at the server itself (through a cron job) as long as we agree on the criteria (so for example delete everything older than 30 days) OTOH, keep in mind that I see multiple .qcow2 images (for undercloud ?) so those would be also deleted.
Or would you want to delete yourself the unneeded files on your side ?
Fabian, any chance you could provide a du -sh of the folders inside the rdo tree ?
I'd like to see what jobs are the worst offenders to see if can improve on the individual size of each job. I'm okay with the clean up happening after 31 days (not 30 due to requirements) but please note that the hierarchy is different for some jobs.
For example, some jobs are <name>-<build>: https://ci.centos.org/artifacts/rdo/jenkins-packstack-gate_khaleesi-rdo-libe...
Other jobs are <name>/<build>: https://ci.centos.org/artifacts/rdo/weirdo-mitaka-promote-packstack-scenario...
David Moreau Simard Senior Software Engineer | Openstack RDO
dmsimard = [irc, github, twitter]
On Mon, Apr 4, 2016 at 11:18 AM, Fabian Arrotin arrfab@centos.org wrote:
So, while working on the LV for the exported dir for rdo-store, I noticed (and Zabbix complained a lot about this in the last weeks) that the artifacts LV is getting bigger and bigger. Actually, the rdo project is more and more using disk space : 760G rdo
It would be good to do some clean-up there, and only keep what's need to be publicly available (behind http://artifacts.ci.centos.org/rdo/ | https://ci.centos.org/artifacts/rdo/ )
Happy to implement that at the server itself (through a cron job) as long as we agree on the criteria (so for example delete everything older than 30 days) OTOH, keep in mind that I see multiple .qcow2 images (for undercloud ?) so those would be also deleted.
Or would you want to delete yourself the unneeded files on your side ?
-- Fabian Arrotin The CentOS Project | http://www.centos.org gpg key: 56BEC54E | twitter: @arrfab
Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 04/04/2016 11:18 AM, Fabian Arrotin wrote:
So, while working on the LV for the exported dir for rdo-store, I noticed (and Zabbix complained a lot about this in the last weeks) that the artifacts LV is getting bigger and bigger. Actually, the rdo project is more and more using disk space : 760G rdo
It would be good to do some clean-up there, and only keep what's need to be publicly available (behind http://artifacts.ci.centos.org/rdo/ | https://ci.centos.org/artifacts/rdo/ )
Happy to implement that at the server itself (through a cron job) as long as we agree on the criteria (so for example delete everything older than 30 days) OTOH, keep in mind that I see multiple .qcow2 images (for undercloud ?) so those would be also deleted.
Any .qcow2 images older than 30 days can be safely deleted. We were originally publishing some intermediary artifacts that could be used to produce the final undercloud.qcow2. This was a bit of a pre-optimization though that turned out to not really be all that useful.
Or would you want to delete yourself the unneeded files on your side ?
Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 04/04/2016 06:54 PM, John Trowbridge wrote:
On 04/04/2016 11:18 AM, Fabian Arrotin wrote:
So, while working on the LV for the exported dir for rdo-store, I noticed (and Zabbix complained a lot about this in the last weeks) that the artifacts LV is getting bigger and bigger. Actually, the rdo project is more and more using disk space : 760G rdo
It would be good to do some clean-up there, and only keep what's need to be publicly available (behind http://artifacts.ci.centos.org/rdo/ | https://ci.centos.org/artifacts/rdo/ )
Happy to implement that at the server itself (through a cron job) as long as we agree on the criteria (so for example delete everything older than 30 days) OTOH, keep in mind that I see multiple .qcow2 images (for undercloud ?) so those would be also deleted.
Any .qcow2 images older than 30 days can be safely deleted. We were originally publishing some intermediary artifacts that could be used to produce the final undercloud.qcow2. This was a bit of a pre-optimization though that turned out to not really be all that useful.
Fabian,
It seems we got to an agreement that anything older than 31 days can be purged from https://ci.centos.org/artifacts/rdo/
Feel free proceed and put there a cronjob to do it periodically, if that solution suits you.
Thank you, Attila
Or would you want to delete yourself the unneeded files on your side ?
Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-
Attila Darazs -
David Moreau Simard -
Fabian Arrotin -
John Trowbridge