Due to a mandatory core switches upgrade in the DC where some services are hosted, we'll lose connectivity between some services/storage servers and some publicly available services will be impacted.
Impacted services:
- https://git.centos.org - https://cbs.centos.org (builders will be put on hold during maintenance window) - https://lists.centos.org - CentOS mailing lists - CentOS CI env (https://duffy.ci.centos.org api endpoint)
Maintenance is scheduled for """"Tuesday September 22nd, 6:00 am UTC time"""". You can convert to local time with $(date -d '2020-09-22 06:00 UTC')
The expected/communicated "downtime" was estimated to be 4h, but we'll just announce when all services will be available again.
Thanks for your understanding and patience.
on behalf of the Infra team,
On 27/09/2024 17:12, Fabian Arrotin wrote:
Due to a mandatory core switches upgrade in the DC where some services are hosted, we'll lose connectivity between some services/storage servers and some publicly available services will be impacted.
Impacted services:
- https://git.centos.org
- https://cbs.centos.org (builders will be put on hold during
maintenance window)
- https://lists.centos.org - CentOS mailing lists
- CentOS CI env (https://duffy.ci.centos.org api endpoint)
Maintenance is scheduled for """"Tuesday September 22nd, 6:00 am UTC time"""". You can convert to local time with $(date -d '2020-09-22 06:00 UTC')
The expected/communicated "downtime" was estimated to be 4h, but we'll just announce when all services will be available again.
Thanks for your understanding and patience.
on behalf of the Infra team,
And you know it's end of Friday afternoon for me when I just pressed "send" and forgot to update the date in my template ....
here are the correct info :
Migration is scheduled for """"Tuesday October 8th, 6:00 am UTC time"""". You can convert to local time with $(date -d '2024-10-08 06:00 UTC')
On 27/09/2024 17:15, Fabian Arrotin wrote:
On 27/09/2024 17:12, Fabian Arrotin wrote:
Due to a mandatory core switches upgrade in the DC where some services are hosted, we'll lose connectivity between some services/storage servers and some publicly available services will be impacted.
Impacted services:
- https://git.centos.org
- https://cbs.centos.org (builders will be put on hold during
maintenance window)
- https://lists.centos.org - CentOS mailing lists
- CentOS CI env (https://duffy.ci.centos.org api endpoint)
Maintenance is scheduled for """"Tuesday September 22nd, 6:00 am UTC time"""". You can convert to local time with $(date -d '2020-09-22 06:00 UTC')
The expected/communicated "downtime" was estimated to be 4h, but we'll just announce when all services will be available again.
Thanks for your understanding and patience.
on behalf of the Infra team,
And you know it's end of Friday afternoon for me when I just pressed "send" and forgot to update the date in my template ....
here are the correct info :
Migration is scheduled for """"Tuesday October 8th, 6:00 am UTC time"""". You can convert to local time with $(date -d '2024-10-08 06:00 UTC')
IT confirmed that network maintenance is now over, but we lost access to some machines, especially in the CI vlan, so duffy itself is still unreachable
I'll update this thread when we'll have a solution (hopefully)
On 08/10/2024 11:43, Fabian Arrotin wrote:
On 27/09/2024 17:15, Fabian Arrotin wrote:
On 27/09/2024 17:12, Fabian Arrotin wrote:
Due to a mandatory core switches upgrade in the DC where some services are hosted, we'll lose connectivity between some services/storage servers and some publicly available services will be impacted.
Impacted services:
- https://git.centos.org
- https://cbs.centos.org (builders will be put on hold during
maintenance window)
- https://lists.centos.org - CentOS mailing lists
- CentOS CI env (https://duffy.ci.centos.org api endpoint)
Maintenance is scheduled for """"Tuesday September 22nd, 6:00 am UTC time"""". You can convert to local time with $(date -d '2020-09-22 06:00 UTC')
The expected/communicated "downtime" was estimated to be 4h, but we'll just announce when all services will be available again.
Thanks for your understanding and patience.
on behalf of the Infra team,
And you know it's end of Friday afternoon for me when I just pressed "send" and forgot to update the date in my template ....
here are the correct info :
Migration is scheduled for """"Tuesday October 8th, 6:00 am UTC time"""". You can convert to local time with $(date -d '2024-10-08 06:00 UTC')
IT confirmed that network maintenance is now over, but we lost access to some machines, especially in the CI vlan, so duffy itself is still unreachable
I'll update this thread when we'll have a solution (hopefully)
In case people weren't seeing discussion in #centos-ci (on irc.libera.chat) , all services were finally restored, including duffy.ci.centos.org Long story short : it seems interop STP settings between multiple switches OS versions caused some ports to discard traffic
PS: I'll probably reconsider hosting duffy.ci.centos.org itself next to our openshift cluster, so in same AWS VPC, and not in the DC where it is located now.
-
Fabian Arrotin