CPE Quarterly Update Q4 2021

Thursday, 3, March 2022 zlopez Infra No Comments

This is a summary of the work done on initiatives by the CPE Team. Each quarter CPE Team together with CentOS and Fedora community representatives choose initiatives that will be being worked on in this quarter. The CPE Team is then split into multiple smaller sub-teams that will work on chosen initiatives + day to day work that needs to be done.

 

Following is the list of sub-teams in this quarter:

 

Infra & Releng

About

Purpose of this sub-team is to take care of day to day business regarding CentOS and Fedora Infrastructure and Fedora release engineering work. It’s responsible for services running in Fedora and CentOS infrastructure and preparing things for the new Fedora release (mirrors, mass branching, new namespaces etc.). This sub-team is also investigating possible initiatives. This is done by ARC (The Advance Reconnaissance Crew), which is formed from the Infra & Releng sub-team members based on the initiative that is being investigated.

 

Issue trackers

 

Documentation

 

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

Fedora Infrastructure

CentOS Infrastructure

Fedora Release Engineering

ARC

The ARC Team was looking at Bodhi and Image Builder in Q4.

CentOS Stream

About

This initiative is working on CentOS Stream/Emerging RHEL to make this new distribution a reality. The goal of this initiative is to prepare the ecosystem for the new CentOS Stream. 

 

Issue trackers

 

Documentation

 

Application URLs

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

 

OSCI – Distrobaker monitoring

About

In Q4 some of the CPE team were able to assist the OSCI team with some open issues they had that they were finding hard to get to before the end of the year. Our team worked on a way to improve the Distrobaker monitoring to monitor side-tags and have the code update prometheus for metrics on the side-tags. Distrobaker itself is a service which rebuilds the CentOS 9 Stream Koji builds for RHEL 9 in Brew and having good metrics on the application provides useful insights as to how the service is operating.

 

Issue trackers

 

Documentation

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

This team managed to do everything that is described in the ‘about’ section.

 

EPEL

About

Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL), CentOS and Scientific Linux (SL), Oracle Linux (OL).

EPEL packages are usually based on their Fedora counterparts and will never conflict with or replace packages in the base Enterprise Linux distributions. EPEL uses much of the same infrastructure as Fedora, including buildsystem, bugzilla instance, updates manager, mirror manager and more.   

 

Issue trackers

 

Documentation

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

 

CentOS Duffy CI

About

Duffy is a system within CentOS CI Infra which allows tenants to provision and access bare metal resources of multiple architectures for the purposes of CI testing.

We need to add the ability to checkout VMs in CentOS CI in Duffy. We have OpenNebula hypervisor available, and have started developing playbooks which can be used to create VMs using the OpenNebula API, but due to the current state of how Duffy is deployed, we are blocked with new dev work to add the VM checkout functionality. 

 

Issue trackers

 

Documentation

 

Application URLs

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

Reimplement Duffy from the ground up (which is ongoing). It features a new, much cleaner API than the currently deployed version which allows users to allocate differently featured nodes for their CI workflows. It comes with a metaclient app which translates between users of the legacy API and the new one. The Duffy core is agnostic of the features of managed nodes (e.g. bare metal vs. VM, architecture, OS type & version) and shifts that knowledge into configurable node pools with corresponding Ansible playbooks used for provisioning and deprovisioning.

Datanommer/Datagrepper V.2

About

The datanommer and datagrepper stacks are currently relying on fedmsg which we want to deprecate. These two applications need to be ported off fedmsg to fedora-messaging. As these applications are 'old-timers' in the fedora infrastructure, we would also like to look at optimizing the database or potentially redesigning it to better suit the current infrastructure needs.

For phase two, we would like to focus on a DB overhaul.

 

Issue trackers

 

Documentation

 

Application URLs

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

The team migrated the datanommer and datagrepper tools to use TimescaleDB as a backend, instead of plain PostgreSQL. This will greatly improve the scalability of the apps. As a reminder, datanommer stores all messages ever sent to our message bus (and that’s a lot of messages), and datagreppers is a web UI and API to query this database.

 

FCOS OpenShift migration

About

Enable the Fedora CoreOS to move their pipeline from the CentOS CI OCP4 cluster to the newly deployed Fedora infra OCP4 cluster.

 

Issue trackers

 

Documentation

 

Application URLs

Members of sub-team for Q4 2021

 

What the sub-team did in Q4 2021

Fedora CoreOS were making use of the CentOS CI OCP4 cluster to run some of their pipelines. We reused the playbooks and roles already developed in CentOS CI Infra, to recreate the project, service account and permissions required in order to deploy their pipeline on the new Fedora infra OCP4 cluster.

Epilog

If you get here, thank you for reading this. If you want to contact us, feel free to do it in #redhat-cpe channel on libera.chat.

Leave a Reply

Your email address will not be published. Required fields are marked *