Due to a previous hardware issue
(https://lists.centos.org/pipermail/ci-users/2020-October/002124.html),
we had a workaround in place that is still in place but is actually
blocking a reorg of the infra used behind ci.centos.org.
We are announcing a maintenance window that will permit us to move
network switches, and reconfigure the network properly , allowing also
us to redeploy/load balance our workload across remaining available
infrastructure.
Migration is scheduled for """"Tuesday August 17th, 1:00 pm UTC time"""".
You can convert to local time with $(date -d '2021-08-17 13:00 UTC')
The expected "downtime" is estimated to ~60 minutes , time needed to
migrate services, reconfigure network switch and restart the nodes
connected to new network switch.
Impacted services in CI env:
- duffy API (unavailable during the move to other hypervisor, so
normally unavailable for ~10min) : no way to request a duffy node for
bare-metal tests
- jenkins (aka ci.centos.org) and all agents connected to it
- cloud.cico (opennebula infra used to provide Virtual Machines for CI
tenants)
Thanks for your comprehending and patience.
on behalf of the Infra team,
--
Fabian Arrotin
The CentOS Project | https://www.centos.org
gpg key: 17F3B7A1 | twitter: @arrfab
On Tue, Aug 17, 2021 at 7:27 PM Jonathan Beakley <jbeakley(a)redhat.com>
wrote:
> +Ant and Stefan, because Leigh is on PTO.
>
Please see Fabian's previous announcement of scheduled outage [0]
https://lists.centos.org/pipermail/ci-users/2021-August/002177.html
>
> -JB
>
> On Tue, Aug 17, 2021 at 9:54 AM Jonathan Beakley <jbeakley(a)redhat.com>
> wrote:
>
>> +Leigh and Aoife
>>
>> Leigh and Aoife,
>>
>> Can you help get some attention on this issue? Thank you,
>>
>> -JB
>>
>>
>> On Tue, Aug 17, 2021 at 9:35 AM Serhii Kryzhnii <skryzhni(a)redhat.com>
>> wrote:
>>
>>> Hello,
>>>
>>> https://ci.centos.org/ returning 503 Service Unaviable
>>>
>>> Is there anyone that can look into this?
>>>
>>> Thanks,
>>>
>>> --
>>> Serhii Kryzhnii
>>> Application SRE team, Service Delivery
>>> Red Hat
>>> skryzhni(a)redhat.com
>>>
>>
>>
>> --
>>
>> Jonathan Beakley
>>
>> Senior Engineering Manager, Site Reliability Engineering Services
>>
>> Red Hat <https://www.redhat.com/>, 314 Littleton Road, Westford, MA
>> 01886
>>
>> jbeakley(a)redhat.com | Mobile: 617-529-2828
>>
>> I respect your work-life balance. There is no need to answer this email
>> outside of your office hours.
>> <https://www.redhat.com/>
>>
>
>
> --
>
> Jonathan Beakley
>
> Senior Engineering Manager, Site Reliability Engineering Services
>
> Red Hat <https://www.redhat.com/>, 314 Littleton Road, Westford, MA 01886
>
> jbeakley(a)redhat.com | Mobile: 617-529-2828
>
> I respect your work-life balance. There is no need to answer this email
> outside of your office hours.
> <https://www.redhat.com/>
>
--
Vipul Siddharth
He/His/Him
Infrastructure @ Fedora and CentOS
<http://vipul.dev>