lanned Outage - IAD2 Outage - 2022-12-08 19:00 UTC
There will be an outage starting at 2022-12-08 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-08 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/NNNN
Please join #fedora-admin or #fedora-noc on irc.libera.chat or add comments to the ticket for this outage above.
On 05/12/2022 16:14, Stephen Smoogen wrote:
lanned Outage - IAD2 Outage - 2022-12-08 19:00 UTC
There will be an outage starting at 2022-12-08 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-08 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Just to add that if connectivity to that DC is down, that means also that all apps/services using IPA/FAS/ACO auth (through oauth/openid/etc) will also be not working. So if you notice issue authenticating against a service/infra (openshift, cbs/koji, git.centos.org, etc), that will be related to that DC being unreachable (FYI)
On 05/12/2022 16:25, Fabian Arrotin wrote:
On 05/12/2022 16:14, Stephen Smoogen wrote:
lanned Outage - IAD2 Outage - 2022-12-08 19:00 UTC
There will be an outage starting at 2022-12-08 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-08 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Just to add that if connectivity to that DC is down, that means also that all apps/services using IPA/FAS/ACO auth (through oauth/openid/etc) will also be not working. So if you notice issue authenticating against a service/infra (openshift, cbs/koji, git.centos.org, etc), that will be related to that DC being unreachable (FYI)
It seems that such maintenance was postponed to '2022-12-13 1900 UTC' (FYI)
On 13/12/2022 13:09, Fabian Arrotin wrote:
On 05/12/2022 16:25, Fabian Arrotin wrote:
On 05/12/2022 16:14, Stephen Smoogen wrote:
lanned Outage - IAD2 Outage - 2022-12-08 19:00 UTC
There will be an outage starting at 2022-12-08 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-08 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Just to add that if connectivity to that DC is down, that means also that all apps/services using IPA/FAS/ACO auth (through oauth/openid/etc) will also be not working. So if you notice issue authenticating against a service/infra (openshift, cbs/koji, git.centos.org, etc), that will be related to that DC being unreachable (FYI)
It seems that such maintenance was postponed to '2022-12-13 1900 UTC' (FYI)
and it was just decided to postpone this to '2023-01-10 1900 UTC' (FYI)
On 13/12/2022 15:00, Fabian Arrotin wrote:
On 13/12/2022 13:09, Fabian Arrotin wrote:
On 05/12/2022 16:25, Fabian Arrotin wrote:
On 05/12/2022 16:14, Stephen Smoogen wrote:
lanned Outage - IAD2 Outage - 2022-12-08 19:00 UTC
There will be an outage starting at 2022-12-08 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-08 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Just to add that if connectivity to that DC is down, that means also that all apps/services using IPA/FAS/ACO auth (through oauth/openid/etc) will also be not working. So if you notice issue authenticating against a service/infra (openshift, cbs/koji, git.centos.org, etc), that will be related to that DC being unreachable (FYI)
It seems that such maintenance was postponed to '2022-12-13 1900 UTC' (FYI)
and it was just decided to postpone this to '2023-01-10 1900 UTC' (FYI)
reminder (in case of)
Due to some issues, this "lanned" outage has to be delayed to 2022-12-13 at the same time.
On Mon, 5 Dec 2022 at 10:14, Stephen Smoogen ssmoogen@redhat.com wrote:
lanned Outage - IAD2 Outage - 2022-12-13 19:00 UTC
There will be an outage starting at 2022-12-13 19:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2022-12-13 19:00 UTC'
Reason for outage:
There will be a multi hour outage as a hardware firewall is changed out of the IAD2 data center where most Fedora systems are housed. Outages should be in short cycles as the firewall is changed over to new hardware and rules are tested and confirmed.
Affected Services:
Most Fedora and CentOS Services will be affected Build systems for s390x will need to be restarted as NFS will break Builds in CentOS Stream and other infrastructure will be blocked during this time.
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/11031
Please join #fedora-admin or #fedora-noc on irc.libera.chat or add comments to the ticket for this outage above.
-- Stephen Smoogen, Red Hat Automotive Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren