CI-users

ci-users@lists.centos.org

420 discussions

Test results not sent to github PR
by Honza Horak 23 May '16

23 May '16

I'm fighting with github+jenkins integration; specifically I'd like to make jenkins to run a job [1] for every commit in PR [2] or after writing message '[test]' in this PR. Then I expect the test result to be set in github PR. One issue I see is that when trying to follow [3] and adding 'https://ci.centos.org/ghbrphook', I see 301 response in 'Recent Deliveries' section. Well, when adding [test] comment, the job is run, but the output is not sent into github. I'd appreciate any help here, since I'm quite new to jenkins.. [1] https://ci.centos.org/view/SCLo/job/SCLo-mariadb-container-pr/ [2] https://github.com/sclorg/mariadb-container/pull/1 [3] https://wiki.centos.org/QaWiki/CI/GithubIntegration Honza

2 3

Jenkins SafeRestart to add extra CSRF Protection 19-Apr-2016 14h30 UTC (09h30 EDT)
by Brian Stinson 21 May '16

21 May '16

Hi Folks, In response to news of directed attacks against public Jenkins instances[0], we are enabling some of the CSRF protections in ci.centos.org To do this we will issue a SafeRestart at 14:30 UTC Today! Running jobs will be given a chance to clear and new jobs should be queued up and will execute as soon as the restart finishes. Potential Impact: - If you are using the Jenkins REST interface you may need to modify your scripts to send the appropriate headers[1] - Jenkins Job Builder is tracking an issue to enable CSRF support[2]. Some basic tests were performed on our side, and simple jobs were configured correctly, but you may notice strange behavior if you are using JJB. [0]: https://groups.google.com/d/topic/jenkinsci-advisories/lJfvDs5s6bk [1]: https://wiki.jenkins-ci.org/display/JENKINS/Remote+access+API#RemoteaccessA… [2]: https://storyboard.openstack.org/#!/story/2000556 If you have any questions or comments, let us know here or find one of us in #centos-devel on Freenode. Cheers! -- Brian Stinson CentOS CI Infrastructure Team

3 7

Important infra outage notification - dates to be discussed
by Fabian Arrotin 20 May '16

20 May '16

Due to some reorganization at the DC/Cage level, we'll have to shutdown/move/reconfigure a big part of our hosted infra for the following services : - cbs.centos.org (Koji) - accounts.centos.org (auth backend) - ci.centos.org (jenkins-driven CI environment) We're working on a plan to minimize the downtime/reconfiguration part, but at first sight, due to the hardware move of the racks/recabling parts/etc, the announced downtime will be probably ~48h. What does that mean ? That during this window, nobody will be able to build/tests packages, nor be able to triggers automatically CI jobs (important). As said, we're working on an agenda with the team operating the DC, but we'd like you (cbs and ci users) to give us feedback on the best (or worst ?) time line for such migration. For example if you know that your $project will have a release soon, and already have an agenda for such release (and so build/ci) and that you rely on that infra, we'd like you to communicate those informations to us, so that we can try to find the best possible time slot for the migration, minimizing the impact on the whole CentOS ecosystem (and so for all our users) Feel free to answer in this thread, or find us in #centos-devel on freenode. -- Fabian Arrotin The CentOS Project | http://www.centos.org gpg key: 56BEC54E | twitter: @arrfab

1 0

centos-ci-skeleton v2016.1
by Colin Walters 19 May '16

19 May '16

Hi, https://github.com/cgwalters/centos-ci-skeleton/releases/tag/v2016.1 is a repo I put together today that's factoring out some recent work I did on a new duffy wrapper script: https://github.com/cgwalters/centos-ci-skeleton/releases/tag/v2016.1 Combined with JJB templates: https://github.com/cgwalters/centos-ci-skeleton/blob/master/jjb-tmpl/cciske… My high level goal is to try to establish a bit more of a shared baseline codebase. It seems for example that most CentOS CI users are using Jenkins Job Builder. (If you're not, you should really consider it). If you look at my demo job: https://github.com/cgwalters/centos-ci-skeleton/tree/master/jjb-demo It shows how to pair together things so that you get a reusable node that's provisioned via an Ansible playbook.

2 2

Request for virtual IP-addresses in the CI for fail-over testing
by Niels de Vos 19 May '16

19 May '16

Hi, there is an integration in place with Gluster, NFS-Ganesha and Pacemaker. This combination makes it possible to have an active-active high-available NFS-server backed by Gluster volumes. We'd like to add automated testing for functional fail-over in the CI. This requires the use of virtual-IPs that get assigned to the different NFS-Ganesha servers, which will migrate to other servers upon failure. On https://wiki.centos.org/QaWiki/PubHardware is a mentioning of "reserved IP addresses" where the Gluster project in the CI would like to get listed too. What is the process to request a few IPs, and what are the restrictions we need to be aware of (and how to put them in the Jenkins job)? Thanks, Niels

2 1

duffy requests
by Colin Walters 18 May '16

18 May '16

1) Public source code 2) Arbitrary metadata (could be JSON or just a blob) like /Node/get/?key=blah&metadata=<base64 encoded json> Then a new /InventoryExt verb that returns JSON like: [ { "name": "n49.pufty", "ssid": "abcde", "metadata": "<base64 encoded json>" }, { "name": "a29.pufty", "ssid": "abcde", "metadata": "<base64 encoded json>" } ] 3) Also add a new option to /get/ named "longpoll" which means the machine is automatically deallocated when the requester's TCP connection closes. This would help ensure that e.g. cancelling the job or a Jenkins restart etc. automatically deallocated the machine

4 5

Request for https://wiki.jenkins-ci.org/display/JENKINS/PostBuildScript+Plugin
by Colin Walters 16 May '16

16 May '16

It's a handy way to implement cleanup actions, such as de-provisioning a duffy machine regardless of whether or not a job succeeds.

2 2

Strategy for scaling jenkins slaves ?
by David Moreau Simard 16 May '16

16 May '16

Hi, The RDO slave currently has 15 execution threads running on two cores and 4GB of RAM. As we use ci.centos more and more for gating and periodic jobs, I can see that the slave starts to struggle a little bit CPU-wise when the execution threads are busy. The bulk of the jobs are offloaded to an ephemeral bare metal node but ansible still runs from the slave. Some jobs do run locally, such as smaller tox jobs. What's the strategy if we want to scale this ? For example, do we want to scale in increments of "10 threads/2 cores/4 GB RAM" by adding more slaves as need be or do we want to grow the specifications of the existing slave and grow the amount of threads ? I have a personal preference to have more smaller slaves as this also has the added benefit of redundancy so we're not left entirely out in the cold if this one big slave happens to crash. David Moreau Simard Senior Software Engineer | Openstack RDO dmsimard = [irc, github, twitter]

5 7

Accessing cbs.centos.org from inside CI
by Colin Walters 11 May '16

11 May '16

``` [atomic-sig@slave01 ~]$ host cbs.centos.org cbs.centos.org has address 172.20.1.15 [atomic-sig@slave01 ~]$ curl https://cbs.centos.org/repos/virt7-docker-common-candidate/x86_64/os/ ^C ``` Just times out - I'm guessing there's some intermediate firewall, or perhaps IP conflict on the 172.19 subnet? Using the external IP works: ``` [atomic-sig@slave01 ~]$ host cbs.centos.org 8.8.8.8 Using domain server: Name: 8.8.8.8 Address: 8.8.8.8#53 Aliases: cbs.centos.org has address 66.187.224.194 [atomic-sig@slave01 ~]$ curl http://66.187.224.194/repos/virt7-docker-common-candidate/x86_64/os/ <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> ```

4 9

going beyond getting started
by Colin Walters 27 Apr '16

27 Apr '16

Hi, so I got some more time to run through the process of onboarding. I got a simple job created via JJB that runs directly on the slave. At this point though I'd like to load some custom software (rpmdistro-gitoverlay). Now my understanding is that we only have a non-root user on the slave VM, and so if we want to do anything that isn't already installed, we should call out to Duffy? My first question is - has anyone tried out writing an Ansible dynamic inventory script for Duffy? The demo https://github.com/kbsingh/centos-ci-scripts/blob/master/build_python_scrip… is kind of obviously a poor man's Ansible =) I have 3 other questions about Duffy. First, might be interesting to investigate a configuration like this: http://www.projectatomic.io/blog/2015/05/building-and-running-live-atomic/ which basically runs out of RAM directly. This model is particularly well suited to workloads like Duffy where you don't *actually* want the OS to be persistent on disk. Using the disks as swap space instead of xfs/ext4 can be a dramatic speed improvement. (A large part is ignoring fsync and journaling) Beyond that, has any thought been given to also supporting e.g. OpenStack as a provisioning API? Or for that matter allocating a Kubernetes namespace or OpenShift project? My workloads for Project Atomic are going to be pretty mixed across all of these actually.

4 10

← Newer
1
...
33
34
35
36
37
38
39
...
42
Older →

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

CI-users