Hello!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization.
If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.
As far as I know, there are Fedora Rawhide AMIs[0], which should make this much easier, but that's all I can say, since I have almost zero experience with AWS overall.
Thank you!
Cheers, Frantisek
[0] https://fedoraproject.org/w/index.php?title=Test_Results:Current_Cloud_Test&...
On Wed, Jun 22, 2022 at 11:39 AM František Šumšal frantisek@sumsal.cz wrote:
Hello!
Hi!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
On this point, if CentOS CI is interested in offering Fedora AWS instances via their Duffy API, it'd be great if Fedora CoreOS were at the very least an option. It's *the* cloud-native variant of Fedora and it'd be great to see the CentOS CI community test their software on FCOS!
We currently build FCOS rawhide AWS images for both x86_64 and aarch64, but don't create AMIs.[1] We could do so if there's demand for it. Part of the issue there is garbage collection, which is something we'd like to tackle soon.
(To be clear, I'm speaking for myself here, not the whole FCOS team.)
[1] https://builds.coreos.fedoraproject.org/browser?stream=rawhide
On Wed, Jun 22, 2022 at 12:07 PM Jonathan Lebon jonathan@jlebon.com wrote:
On Wed, Jun 22, 2022 at 11:39 AM František Šumšal frantisek@sumsal.cz wrote:
Hello!
Hi!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
On this point, if CentOS CI is interested in offering Fedora AWS instances via their Duffy API, it'd be great if Fedora CoreOS were at the very least an option. It's *the* cloud-native variant of Fedora and it'd be great to see the CentOS CI community test their software on FCOS!
Well, that's not true. Obviously Fedora Cloud Edition is "cloud-native" as well, since it is built for cloud platforms. Hence, you know, "Fedora Cloud Edition".
Please don't say things like that again when they're obviously false.
On Wed, Jun 22, 2022 at 12:30 PM Neal Gompa ngompa13@gmail.com wrote:
On Wed, Jun 22, 2022 at 12:07 PM Jonathan Lebon jonathan@jlebon.com wrote:
On Wed, Jun 22, 2022 at 11:39 AM František Šumšal frantisek@sumsal.cz wrote:
Hello!
Hi!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
On this point, if CentOS CI is interested in offering Fedora AWS instances via their Duffy API, it'd be great if Fedora CoreOS were at the very least an option. It's *the* cloud-native variant of Fedora and it'd be great to see the CentOS CI community test their software on FCOS!
Well, that's not true. Obviously Fedora Cloud Edition is "cloud-native" as well, since it is built for cloud platforms. Hence, you know, "Fedora Cloud Edition".
Please don't say things like that again when they're obviously false.
I'm saying FCOS is the most cloud-native variant of Fedora. We build and upload for a lot more clouds and IMO have a better provisioning story. It's OK to have different opinions on this, but here is probably not the right place to debate it. :)
Hi,
On Wed, Jun 22, 2022 at 6:07 PM Jonathan Lebon jonathan@jlebon.com wrote:
On Wed, Jun 22, 2022 at 11:39 AM František Šumšal frantisek@sumsal.cz wrote:
Hello!
Hi!
After reading & discussing the recent news regarding the move to AWS, I
wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
On this point, if CentOS CI is interested in offering Fedora AWS instances via their Duffy API, it'd be great if Fedora CoreOS were at the very least an option. It's *the* cloud-native variant of Fedora and it'd be great to see the CentOS CI community test their software on FCOS!
We currently build FCOS rawhide AWS images for both x86_64 and aarch64, but don't create AMIs.[1] We could do so if there's demand for it.
My team is interested, we would like to offer testing on FCOS (and other rpm-ostree variants) as a service. We actually already run some tests against it last year, but it was done only to show that we will be able to test Automotive SIG images https://autosd.sig.centos.org/AutoSD-9/nightly/sample-images/ (which are also rpm-ostree based).
Part of the issue there is garbage collection, which is
something we'd like to tackle soon.
That should be fairly easy.
Best regards, /M
(To be clear, I'm speaking for myself here, not the whole FCOS team.)
[1] https://builds.coreos.fedoraproject.org/browser?stream=rawhide _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 22/06/2022 18:06, Jonathan Lebon wrote:
On Wed, Jun 22, 2022 at 11:39 AM František Šumšal frantisek@sumsal.cz wrote:
Hello!
Hi!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
On this point, if CentOS CI is interested in offering Fedora AWS instances via their Duffy API, it'd be great if Fedora CoreOS were at the very least an option. It's *the* cloud-native variant of Fedora and it'd be great to see the CentOS CI community test their software on FCOS!
We currently build FCOS rawhide AWS images for both x86_64 and aarch64, but don't create AMIs.[1] We could do so if there's demand for it. Part of the issue there is garbage collection, which is something we'd like to tackle soon.
(To be clear, I'm speaking for myself here, not the whole FCOS team.)
[1] https://builds.coreos.fedoraproject.org/browser?stream=rawhide
That's also an option (see previous answer about Fedora Rawhide) and only thing that we'd need is public AMI in that region and we can then start adding. Let's first ask if CI tenants are interested into this and if yes, we can make it happen : we can the easily bump number of "ready nodes" for such pool, should demand increase.
<snip>
We currently build FCOS rawhide AWS images for both x86_64 and aarch64, but don't create AMIs.[1] We could do so if there's demand for it. Part of the issue there is garbage collection, which is something we'd like to tackle soon.
There is a lambda function running in our AWS account that can help with this. It automatically deletes AMIs, EBS Volumes, Snapshots or instances based on tag. You just need to use the tag "Delete":"<delta_in_days>"
For example, if you tag your AMIs with "Delete": "200" they will be automatically cleaned up when they reach 200 days old.
Mark
Hi,
On Wed, Jun 22, 2022 at 5:39 PM František Šumšal frantisek@sumsal.cz wrote:
Hello!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
Fedora Rawhide AWS images are available on Fedora's AWS account, that we also use to test CentOS Stream:
❯ aws ec2 describe-images --filter Name=name,Values="Fedora-Cloud-Base-Rawhide*" | jq -r '.Images | .[] | .Name' | sort | tail -4 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-standard-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-standard-0
This is what we use in Testing Farm https://docs.testing-farm.io/.
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization.
If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.
Do you need some direct access to AWS? We provide testing on AWS instances as a service.
As far as I know, there are Fedora Rawhide AMIs[0], which should make this much easier, but that's all I can say, since I have almost zero experience with AWS overall.
It is easy, we test all Rawhide builds the second year now against those AMIs. Just ping me what you require, I bet there is a solution lying around.
Best regards, /M
Thank you!
Cheers, Frantisek
[0] https://fedoraproject.org/w/index.php?title=Test_Results:Current_Cloud_Test&...
-- PGP Key ID: 0xFB738CE27B634E4B _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 22/06/2022 18:45, Miroslav Vadkerti wrote:
Hi,
On Wed, Jun 22, 2022 at 5:39 PM František Šumšal <frantisek@sumsal.cz mailto:frantisek@sumsal.cz> wrote:
Hello! After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).Fedora Rawhide AWS images are available on Fedora's AWS account, that we also use to test CentOS Stream:
❯ aws ec2 describe-images --filter Name=name,Values="Fedora-Cloud-Base-Rawhide*" | jq -r '.Images | .[] | .Name' | sort | tail -4 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-standard-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-standard-0
This is what we use in Testing Farm https://docs.testing-farm.io/.
Great, so we now know that they exist and we can investigate options to start deploying these ....
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization. If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.Do you need some direct access to AWS? We provide testing on AWS instances as a service.
Well .. you know that it's exactly what Duffy and newer CI infra would be doing , so overlapping solutions .. What I find amusing is that we now seem to have two solutions providing same thing, using the *same* AWS sponsored account, and with common projects ...
On Thu, Jun 23, 2022 at 9:09 AM Fabian Arrotin arrfab@centos.org wrote:
On 22/06/2022 18:45, Miroslav Vadkerti wrote:
Hi,
On Wed, Jun 22, 2022 at 5:39 PM František Šumšal <frantisek@sumsal.cz mailto:frantisek@sumsal.cz> wrote:
Hello! After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).Fedora Rawhide AWS images are available on Fedora's AWS account, that we also use to test CentOS Stream:
❯ aws ec2 describe-images --filter Name=name,Values="Fedora-Cloud-Base-Rawhide*" | jq -r '.Images | .[] | .Name' | sort | tail -4 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-standard-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-standard-0
This is what we use in Testing Farm https://docs.testing-farm.io/.
Great, so we now know that they exist and we can investigate options to start deploying these ....
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization. If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.Do you need some direct access to AWS? We provide testing on AWS instances as a service.
Well .. you know that it's exactly what Duffy and newer CI infra would be doing , so overlapping solutions .. What I find amusing is that we now seem to have two solutions providing same thing, using the *same* AWS sponsored account, and with common projects ...
Hi,
Yeah, I guess it would be good time to talk about, so we do not overlap or know what is exactly overlap. The thing is CentOS testing is just a part of things we do.
Should I setup some call?
Best regards, /M
-- Fabian Arrotin The CentOS Project | https://www.centos.org gpg key: 17F3B7A1 | twitter: @arrfab _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
Hi, Yeah, I guess it would be good time to talk about, so we do not overlap or know what is exactly overlap. The thing is CentOS testing is just a part of things we do. Should I setup some call?
That would be great Miroslav. If you could add me to it as well, in addition to Fabian and Mark, I'd appreciate it.
On Thu, Jun 23, 2022 at 8:00 AM Miroslav Vadkerti mvadkert@redhat.com wrote:
On Thu, Jun 23, 2022 at 9:09 AM Fabian Arrotin arrfab@centos.org wrote:
On 22/06/2022 18:45, Miroslav Vadkerti wrote:
Hi,
On Wed, Jun 22, 2022 at 5:39 PM František Šumšal <frantisek@sumsal.cz mailto:frantisek@sumsal.cz> wrote:
Hello! After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).Fedora Rawhide AWS images are available on Fedora's AWS account, that
we
also use to test CentOS Stream:
❯ aws ec2 describe-images --filter Name=name,Values="Fedora-Cloud-Base-Rawhide*" | jq -r '.Images | .[] | .Name' | sort | tail -4 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.aarch64-hvm-us-east-2-standard-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-gp2-0 Fedora-Cloud-Base-Rawhide-20220621.n.3.x86_64-hvm-us-east-2-standard-0
This is what we use in Testing Farm https://docs.testing-farm.io/.
Great, so we now know that they exist and we can investigate options to start deploying these ....
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization. If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.Do you need some direct access to AWS? We provide testing on AWS instances as a service.
Well .. you know that it's exactly what Duffy and newer CI infra would be doing , so overlapping solutions .. What I find amusing is that we now seem to have two solutions providing same thing, using the *same* AWS sponsored account, and with common projects ...
Hi,
Yeah, I guess it would be good time to talk about, so we do not overlap or know what is exactly overlap. The thing is CentOS testing is just a part of things we do.
Should I setup some call?
Best regards, /M
-- Fabian Arrotin The CentOS Project | https://www.centos.org gpg key: 17F3B7A1 | twitter: @arrfab _______________________________________________ CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-- Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE IRC mvadkert #tft #tmt #osci :: Mobile +420 773 944 252 Remote Czech Republic :: Red Hat Czech s.r.o
CI-users mailing list CI-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 22/06/2022 17:39, František Šumšal wrote:
Hello!
After reading & discussing the recent news regarding the move to AWS, I wonder if it would be possible to provide Fedora Rawhide images along with the C8S and C9S ones (and maybe active stable Fedora releases as well).
A bit of background: In the systemd project we have several jobs with utilize Vagrant to run an Arch Linux VMs, in which we run tests alongside the C8S/C9S jobs, to cover issues with the latest-ish kernel and other software, and to also hunt down security issues with the latest versions of ASan and UBSan. However, all this is held together by a lot of duct tape and sheer will power, and in the end it requires an EC2 Metal instance to run, due to the additional level of virtualization.
If we were able to provision Rawhide instances directly (which should help us achieve the same goal as the Arch Linux VMs we currently use), that could, in theory, allow us to drop the requirement for Metal instances completely.
As far as I know, there are Fedora Rawhide AMIs[0], which should make this much easier, but that's all I can say, since I have almost zero experience with AWS overall.
Thank you!
Cheers, Frantisek
[0] https://fedoraproject.org/w/index.php?title=Test_Results:Current_Cloud_Test&...
Hi,
So yes, it would be possible and I just need to see how many we'd have in the ec2 ready pool and also need to be to have a AMI ID list for Rawhide for x86_64 and aarch64 :) https://alt.fedoraproject.org/cloud/ lists Fedora 36 but I guess there are other Rawhide AMI already available somewhere else (but not publicly advertised, or not easily findable)
What I found was this but it's a Wiki page and don't know if that's kept up2date : https://fedoraproject.org/wiki/Test_Results:Fedora_37_Rawhide_20220621.n.3_C...
(that page only lists x86_64 FWIW)
I'll try to ask internally to Fedora releng folks about where we can easily find such list and then it's just a matter of adding it to .yml file used by Duffy and it would then appear automatically as new pool
Once we'll have that list and also *ack* from Camilla, we can start adding Rawhide (and why not Fedora 35/36) as options, next to CentOS 7 / 8s and 9s
-
Camila Granella -
Fabian Arrotin -
František Šumšal -
Jonathan Lebon -
Mark O'Brien -
Miroslav Vadkerti -
Neal Gompa