CI-users January 2023

ci-users@lists.centos.org

3 participants
6 discussions

[Action Required] : Decommissioning (on premises) OpenShift CI cluster
by Fabian Arrotin 03 Apr '23

03 Apr '23

Hi all, Camilla announced this in december already (https://lists.centos.org/pipermail/ci-users/2022-December/thread.html) and we sent multiple reminders about that. The plan was already knew since it was decided to move the whole CI infra to AWS (announced in June 2022) but the last bit that had to move was the openshift CI cluster (aka *.apps.ocp.ci.centos.org) to AWS (https://console-openshift-console.apps.ocp.cloud.ci.centos.org/) As the new cluster in AWS is deployed since end of November you still have to migrate your workload from old to new cluster, and that *before* end of March 2023 (see https://sigs.centos.org/guide/ci/#migration-to-new-ci-instance) We'll continue to send such reminders as long as we see tenants who haven't migrated (yet) We prefer announce it multiple times so that nobody will ask "where is my app gone ?" when the whole cluster will be powered down end of March. PS: if you have already migrated, please confirm to us so that we can already delete your project/namespace/storage PV in the previous cluster. Kind Regards, -- Fabian Arrotin The CentOS Project | https://www.centos.org gpg key: 17F3B7A1 | twitter: @arrfab

6 11

[infra] : Planned outage : RDU2 network maintenance (please read)
by Fabian Arrotin 31 Jan '23

31 Jan '23

Due to a mandatory network maintenance at the RDU2 (Community Cage) facility/DC, we'll have to power off some CentOS infrastructure components hosted in that DC. Impacted services: - https://cbs.centos.org (impossible to submit any build, nor push to delivery network) - https://bugs.centos.org - ns1.centos.org - https://wiki.centos.org - all centos linux / stream 8 / stream 9 release engineering workflow (stream 9 can be built but not pushed out, while for the rest, all will be down) - https://git.centos.org - CI infra: - while openshift in aws is self-contained, there will be no way to request duffy nodes for tests - tenants still on legacy openshift (hosted in that DC) will see the whole cluster being powered down (because of Persistent Volumes hosted in a NFS server that itself will be unavailable) - various other services Migration is scheduled for """"Tuesday January 31th, 1:00 pm UTC time"""". You can convert to local time with $(date -d '2023-01-31 13:00 UTC') The scheduled maintenance window (communicated to us) is estimated to 4h, but we'll restart infra services as soon as possible, following ourselves the current status internally. Thanks for your understanding and patience. on behalf of the Infra team, -- Fabian Arrotin The CentOS Project | https://www.centos.org gpg key: 17F3B7A1 | @arrfab[@fosstodon.org]

2 1

Scheduled UPGRADE Notification: CentOS CI PROD Openshift Cluster
by Pedro Moura 16 Jan '23

16 Jan '23

Dear CentOS CI User, Please be advised that the CentOS CI PROD Openshift cluster is due for scheduled maintenance from 12pm to 2pm UTC on Jan 16th. During this period necessary updates will be applied to the cluster, and will be upgraded from version 4.11.18 to 4.11.21 Every service under **apps.ocp.cloud.ci.centos.org <http://apps.ocp.cloud.ci.centos.org>* might be affected. Pods will be restarted, so it's suggested to pause your Jenkins jobs, and there might be periods of slight performance degradation during this maintenance period. We apologise for any inconvenience that this may cause. Kind regards, CentOS CI Infrastructure.

1 1

OCP upgrade
by Pedro Moura 13 Jan '23

13 Jan '23

Hello everyone, Today Fabian upgraded our OCP in stg and I'll upgrade the prod one on Monday Regards, Pedro Moura he/him/his Software Engineer Red Hat <https://www.redhat.com> pmoura(a)redhat.com <https://www.redhat.com>

1 0

https://jenkins-networkmanager.apps.ocp.ci.centos.org down
by Vladimir Benes 04 Jan '23

04 Jan '23

Heya, any idea what's going on? I saw it down yesterday evening and whoa! it's still down 12 hours later. Any idea? Thanks! Vladimir

2 1

Changes to CentOS CI: New OpenShift instance and Updates
by Camila Granella 02 Jan '23

02 Jan '23

*TL;DR: new OpenShift instance is up and running for CentOS CI, migrate your workloads by March 31st, 2023. Test your access to both the Duffy API and the new OpenShift instance by the end of 2022. CentOS CI changes approaching the end of Phase 3. * Hello everyone, We are happy to announce that the new OpenShift instance is up and running (ticket [0]). For the tenants that opted in to continue using CentOS CI, you are being required to *migrate your workload to the new OpenShift instance by the end of Q1CY23*, with the final deadline being *March 31st, 2023*. In order to support you through the migration process, the team has created a quick guide that can be found in [1]. We would also like to request you test your access to both the Duffy API and the new OpenShift instance by the *end of 2022*. Please reach out to us in case it is not working. Here is the link to the new OCP cluster [2]. As a reminder, this new OCP cluster is running in AWS, on top of EC2 instances, so coming with different limitations when compared with “on-premises bare-metal OCP deployments”. One notable change is that it is not possible to expose /dev/kvm and so there is no way for tenants to deploy VMs through OpenShift (like with the kubevirt operator or else). Tenants having a need to use VMs can then request some through Duffy API. Finally, here's a friendly reminder of the CentOS CI changes' current status. According to our previous communications [3], we are approaching the end of the last phase of the changes that have been implemented to CentOS CI. *Phase 3 - Decommission* - Legacy/compatibility API deprecated and requests (even for EC2 instances) will no longer be accepted - All tenants that opted in will be using only EC2 for aarch64/x86_64 and on-premise cloud for ppc64le For a full description of the project phases, you can check [3]. Please, feel free to reach out to us in case you have any questions or concerns. Regards, [0] https://pagure.io/centos-infra/issue/969 [1] https://sigs.centos.org/guide/ci/#migration-to-new-ci-instance [2] https://console-openshift-console.apps.ocp.cloud.ci.centos.org/ [3] https://lists.centos.org/pipermail/ci-users/2022-June/004547.html -- Camila Granella Associate Manager, Software Engineering Red Hat <https://www.redhat.com/> @Red Hat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com/>

3 3

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

CI-users January 2023