[CentOS-devel] CPE Weekly Update - Week of Sept 27th

Fri Oct 1 11:16:08 UTC 2021
Vipul Siddharth <siddharthvipul1 at gmail.com>

Hi everyone,

This is a weekly report from the CPE (Community Platform Engineering)
Team. If you have any questions or feedback, please respond to this
report or contact us on #redhat-cpe channel on libera.chat
(https://libera.chat/).
There was a hiatus for some time, expect this weekly from now on!

If you wish to read this in rendered markdown, check the post on
discussion.fedoraproject.org:
https://discussion.fedoraproject.org/t/cpe-weekly-update-week-of-sept-27th-2021/33418?u=siddharthvipul1

# Highlights of the week

## Infrastructure & Release Engineering
Goal of this Initiative
-----------------------
Purpose of this team is to take care of day to day business regarding
CentOS and Fedora Infrastructure and Fedora release engineering work.
It’s responsible for services running in Fedora and CentOS
infrastructure and preparing things for the new Fedora release
(mirrors, mass branching, new namespaces etc.). The ARC (which is a
subset of the team) investigates possible initiatives that CPE might
take on.

Update
------
### Hardware Updates
* Warranty renewal season for both Fedora and CentOS Infra, which
means we are looking at the hardware that needs attention.

### Fedora Infra
* Infra and Releng team is working with other initiatives team members
to handover maintenance tasks
* Started moving forward again on updating our dnssec keys
* Issues with openqa-x86-worker04 machine ongoing
* Planning a mass update/reboot cycle next week tentatively
* 66 issues open (many to close as the freeze lifted)

### CentOS Infra
* https://sigs.centos.org announced on the centos-devel list
* Updated ci.centos.org Jenkins to comply with security compliance
* Collaboration with Stream team for infra tasks (including for beaker/ftp)
* Business as usual
    * New tags in cbs/koji (automotive, cloud)
    * New projects on git.centos.org

### Release Engineering
* Fedora 35 Beta out the door! Freeze ended

## CentOS Stream
Goal of this Initiative
-----------------------
This initiative is working on CentOS Stream/Emerging RHEL to make this
new distribution a reality. The goal of this initiative is to prepare
the ecosystem for the new CentOS Stream.

Updates
-------
* Working on Content Resolver buildroot logic integration
* Metalinks for CentOS Stream 9 mirrors works now
* An updated centos-release package exercising the new mirror infra is
built, we expect it to be composed in the next couple of days
* Starting some investigations to help maintainers work with GitLab
* Reworking some of the protocols that we announce internally for our
composes (Beaker needs to pull the composes via FTP or tftp)


## Datanommer/Datagrepper
Goal of this Initiative
-----------------------
These apps are currently used to retrieve historical information about
messages on the fedmsg bus and add them to a Postgres database.
Datanommer reads-in messages from the bus and stores them in the
database and Datagrepper exposes the messages in the database via an
API with different filtering capacities. We want to upgrade these
applications to use fedora-messaging and increase the performance of
the applications for users.

Updates
-------
* Import script is still running, the ETA of ~2 months seems to be confirmed
* We’re doing the finishing touches to code


## Metrics for Apps on OpenShift
Goal of this Initiative
-----------------------
The project team will deliver on the installation of newest OpenShift
in Fedora infra to be then configured with prometheus so applications
can be hooked into this service and can be monitored and metricized
through this tech stack for more comprehensive understanding of app
behaviour, performance and troubleshooting.

Updates
-------
* A lot of work in docs - SOP docs merged
https://pagure.io/infra-docs-fpo/pull-request/8
* We’ve enabled the user-workload-monitoring stack on the staging
cluster, and began documenting it
* We’ve disabled the default permissions that users get when they
login on the staging cluster and started documenting that too
* A few things are not quite right like network interfaces, but we
have the basic production cluster up and running
* Working to get the web console working, but in the meantime can use
the CLI on the os-control01 node:
https://console-openshift-console.apps.ocp.fedoraproject.org/


## DNF Counting
Goal of this Initiative
-----------------------
The DNF Counting project will enhance the currently existing program
that captures a ‘countme’ value from computers running Fedora weekly.
There are multiple scripts running from a server which parses the data
into a csv file for graphing and displaying trends that had been
misbehaving a lot. This program gives a good indication for how many
computers use Fedora so the project team will work on improving these
scripts and the program overall to make it a more reliable and
maintainable solution.

Updates
-------
* Finishing off last tests
* More deployment cleanup
* Investigate why our cronjobs are so noisy (ongoing)
* Ongoing work on documentation:
https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/dnf-counting/

Kindest regards & on behalf of the CPE team,
-- 
Vipul Siddharth
He/His/Him
Fedora | CentOS CI Infrastructure Team