Hello guys,
our tests failed on `No space left on device` [1]. Could you please take a look at that?
Thank you for your effort. Have a nice day, Katka
[1] https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r...
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please take a look at that?
Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people" mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1] https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r... _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
This has been resolved with the help of Vipul!
Thanks!
On Wed, Feb 26, 2020 at 4:24 PM Vipul Siddharth vipul@redhat.com wrote:
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please take
a look at that? Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people" mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1]
https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r...
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
Devtools slave (slave04) is again on the verge of getting full again, Please take a look to clean up the workspace. Apart from this, I would also recommend you all (other projects included) to recheck the clean up scripts to make sure that what's left behind is not a lot of unimportant data. Thank you
On Wed, Feb 26, 2020 at 10:05 PM Maor Friedman mafriedm@redhat.com wrote:
This has been resolved with the help of Vipul!
Thanks!
On Wed, Feb 26, 2020 at 4:24 PM Vipul Siddharth vipul@redhat.com wrote:
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please take a look at that?
Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people" mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1] https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r... _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Maor Friedman Senior Software Engineer, Application SRE team, Service Delivery Red Hat maor@redhat.com _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On Wed, Mar 4, 2020, 08:59 Vipul Siddharth vipul@redhat.com wrote:
Devtools slave (slave04) is again on the verge of getting full again, Please take a look to clean up the workspace. Apart from this, I would also recommend you all (other projects included) to recheck the clean up scripts to make sure that what's left behind is not a lot of unimportant data. Thank you
Is there a best practices guide or an FAQ that folks could follow to help with the knowledge sharing of best practices approaches to cleaning up?
On Wed, Feb 26, 2020 at 10:05 PM Maor Friedman mafriedm@redhat.com wrote:
This has been resolved with the help of Vipul!
Thanks!
On Wed, Feb 26, 2020 at 4:24 PM Vipul Siddharth vipul@redhat.com
wrote:
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com
wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please
take a look at that?
Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people"
mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1]
https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r...
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Maor Friedman Senior Software Engineer, Application SRE team, Service Delivery Red Hat maor@redhat.com _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On Wed, Mar 4, 2020 at 3:01 PM Leigh Griffin lgriffin@redhat.com wrote:
On Wed, Mar 4, 2020, 08:59 Vipul Siddharth vipul@redhat.com wrote:
Devtools slave (slave04) is again on the verge of getting full again, Please take a look to clean up the workspace. Apart from this, I would also recommend you all (other projects included) to recheck the clean up scripts to make sure that what's left behind is not a lot of unimportant data. Thank you
Is there a best practices guide or an FAQ that folks could follow to help with the knowledge sharing of best practices approaches to cleaning up?
Hi Leigh, the cleanup depends on projects to projects (which is why I can't clean up the data by myself and need someone from the project to either clean or work with me to clean them). The best way would be to remove everything that is not a frequent need for the jobs to run. I need to think a bit more on coming up with exact FAQ or best practices for this purposes, but I can come up with a wiki that fixes this (to some extent). If anyone on the ci-user list has any FAQ recommendations, please do send them.
On Wed, Feb 26, 2020 at 10:05 PM Maor Friedman mafriedm@redhat.com wrote:
This has been resolved with the help of Vipul!
Thanks!
On Wed, Feb 26, 2020 at 4:24 PM Vipul Siddharth vipul@redhat.com wrote:
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please take a look at that?
Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people" mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1] https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r... _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Maor Friedman Senior Software Engineer, Application SRE team, Service Delivery Red Hat maor@redhat.com _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
On 3/4/20 10:47 AM, Vipul Siddharth wrote:
On Wed, Mar 4, 2020 at 3:01 PM Leigh Griffin lgriffin@redhat.com wrote:
On Wed, Mar 4, 2020, 08:59 Vipul Siddharth vipul@redhat.com wrote:
Devtools slave (slave04) is again on the verge of getting full again, Please take a look to clean up the workspace. Apart from this, I would also recommend you all (other projects included) to recheck the clean up scripts to make sure that what's left behind is not a lot of unimportant data. Thank you
Is there a best practices guide or an FAQ that folks could follow to help with the knowledge sharing of best practices approaches to cleaning up?
Hi Leigh, the cleanup depends on projects to projects (which is why I can't clean up the data by myself and need someone from the project to either clean or work with me to clean them). The best way would be to remove everything that is not a frequent need for the jobs to run. I need to think a bit more on coming up with exact FAQ or best practices for this purposes, but I can come up with a wiki that fixes this (to some extent). If anyone on the ci-user list has any FAQ recommendations, please do send them.
I'd like to chime in with a suggestion, or more like a question, at least related to our systemd jobs - is it possible to make the retention policy in Jenkins a bit more sophisticated?
For example, each successful job in either of the systemd jobs takes around 20 - 60 MB and we manage to produce several dozens of them per day. But in case of successful jobs we usually need only the last result, so all the others for the same job are useless. However, I can't adjust the retention policy to more frequent cleanups, since that would include failed jobs as well, which we'd like to keep for at least a month, sometimes even longer, for various reasons.
Taking into account that the retention policy is now set to 30 days, which means several hundreds of successful (therefore not useful) builds lying around taking space, having such options available for a better cleanup would, in my opinion, help greatly with the space-related issues.
On Wed, Feb 26, 2020 at 10:05 PM Maor Friedman mafriedm@redhat.com wrote:
This has been resolved with the help of Vipul!
Thanks!
On Wed, Feb 26, 2020 at 4:24 PM Vipul Siddharth vipul@redhat.com wrote:
On Wed, Feb 26, 2020 at 7:23 PM Katerina Foniok kkanova@redhat.com wrote:
Hello guys,
our tests failed on `No space left on device` [1]. Could you please take a look at that?
Hi Katerina, I have been cleaning slave04 around twice a day and now it has come to a point where just parallel cleaning is not working. You (or someone who has access to slave04) can either clean /home/devtools/workspace or work with me to tell me what can be deleted and I will do it. Sadly I didn't know whom to reach out to ask for this, so this has to come to this :) I have written your name in my self maintained "project to people" mapping :)
Please let me know which one works for you and I am just a ping away to clean things for you
Thank you for your effort. Have a nice day, Katka
[1] https://ci.centos.org/view/Devtools/job/devtools-rh-che-rh-che-prcheck-dev.r... _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Maor Friedman Senior Software Engineer, Application SRE team, Service Delivery Red Hat maor@redhat.com _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Vipul Siddharth He/His/Him Fedora | CentOS CI Infrastructure Team Red Hat w: vipul.dev
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-
František Šumšal -
Katerina Foniok -
Leigh Griffin -
Maor Friedman -
Vipul Siddharth