Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
can you share some of these reports ?
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
do we know how many downloads one expects from this content ? Is it better to just push these to the rdoproject.org content space ? we could setup a regular rsync from our end to do the push out.
On 01/13/2016 05:36 PM, Karanbir Singh wrote:
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
can you share some of these reports ?
There was an issue opened against tripleo-quickstart before moving it to redhat-openstack:
https://github.com/trown/tripleo-quickstart/issues/6
There were also many reports on #rdo on freenode.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
do we know how many downloads one expects from this content ? Is it better to just push these to the rdoproject.org content space ? we could setup a regular rsync from our end to do the push out.
Right now, not many... but it is a bit of a chicken egg problem. Users who immediately have problems downloading the images are unlikely to keep using the quickstart. However, I would like to see it become the main way that RDO Manager is consumed for virtual environments.
If hosting them outside of centos.org is needed, we will need to discuss where the best place would be in the RDO meeting.
The images are fairly heavy, hosting in on our modest delorean infrastructure (trunk.rdoproject.org), while okay for packaging, is probably not the best place for these.
I would suggest somewhere else but I don't really know where !
David Moreau Simard Senior Software Engineer | Openstack RDO
dmsimard = [irc, github, twitter]
On Thu, Jan 14, 2016 at 7:57 AM, John Trowbridge trown@redhat.com wrote:
On 01/13/2016 05:36 PM, Karanbir Singh wrote:
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
can you share some of these reports ?
There was an issue opened against tripleo-quickstart before moving it to redhat-openstack:
https://github.com/trown/tripleo-quickstart/issues/6
There were also many reports on #rdo on freenode.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
do we know how many downloads one expects from this content ? Is it better to just push these to the rdoproject.org content space ? we could setup a regular rsync from our end to do the push out.
Right now, not many... but it is a bit of a chicken egg problem. Users who immediately have problems downloading the images are unlikely to keep using the quickstart. However, I would like to see it become the main way that RDO Manager is consumed for virtual environments.
If hosting them outside of centos.org is needed, we will need to discuss where the best place would be in the RDO meeting. _______________________________________________ Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
Moving this conversation forward - the question that came up was : does the RDO project have someplace we can push these to ? otherwise, we can fall back to pushing it to buildlogs.
We would need to find a way to trigger the push though. One option might be to have suiteable ACL's in place that allows the Jenkins build %post to promote the result on its own ( or do the trigger bits )
Regards,
On 22/01/16 11:32, Karanbir Singh wrote:
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
Moving this conversation forward - the question that came up was : does the RDO project have someplace we can push these to ? otherwise, we can fall back to pushing it to buildlogs.
ping :)
should we just try and workout where on buildlogs we might push these if rdo does not have a storage solution?
On 01/27/2016 08:52 AM, Karanbir Singh wrote:
On 22/01/16 11:32, Karanbir Singh wrote:
On 13/01/16 20:47, John Trowbridge wrote:
Hello,
I brought this up on IRC before the holidays, but it was suggested to bring it to this list.
We have some images that get created during CI of RDO-Manager[1], and a project that lets people consume these images to get a fully operational deathst^w TripleO cloud using them.[2]
I have had reports from users though that the download speed outside of the Red Hat RDU VPN is quite bad.
Do we have anywhere we can mirror these images?
[1] https://ci.centos.org/artifacts/rdo/images/ [2] https://github.com/redhat-openstack/tripleo-quickstart
Moving this conversation forward - the question that came up was : does the RDO project have someplace we can push these to ? otherwise, we can fall back to pushing it to buildlogs.
ping :)
should we just try and workout where on buildlogs we might push these if rdo does not have a storage solution?
That would be awesome. I tried putting one of them on a personal RAX account, but it was not really much of an improvement. I have currently updated the documentation for tripleo-quickstart to include instructions to pre-download the images. This has been a viable workaround for the near term, but it is still probably not ideal to be pointing end users at artifacts.ci.centos.
On 28/01/16 11:54, John Trowbridge wrote:
That would be awesome. I tried putting one of them on a personal RAX account, but it was not really much of an improvement. I have currently updated the documentation for tripleo-quickstart to include instructions to pre-download the images. This has been a viable workaround for the near term, but it is still probably not ideal to be pointing end users at artifacts.ci.centos.
as a data point - are you able to grab some images currently in place on buldlogs.centos.org hosts and see if its any better speeds ? try these urls http://buildlogs.centos.org/centos/7/atomic-host/x86_64/images/CentOS-Atomic...
On 01/28/2016 10:25 AM, Karanbir Singh wrote:
On 28/01/16 11:54, John Trowbridge wrote:
That would be awesome. I tried putting one of them on a personal RAX account, but it was not really much of an improvement. I have currently updated the documentation for tripleo-quickstart to include instructions to pre-download the images. This has been a viable workaround for the near term, but it is still probably not ideal to be pointing end users at artifacts.ci.centos.
as a data point - are you able to grab some images currently in place on buldlogs.centos.org hosts and see if its any better speeds ? try these urls http://buildlogs.centos.org/centos/7/atomic-host/x86_64/images/CentOS-Atomic...
After some further troubleshooting with folks, I am not so sure it is a speed issue so much as nginx dropping the connection. My workaround to pre-download the images uses wget for the built-in retry w/ resume, and I have not had any reported issues using that process.
Ansible uses curl, which is not handling the dropped http connection well, resulting in a broken download.
I tried the above link and it works great for me, but so does the artifacts server. Is the buildlogs server also going through nginx?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
On 28/01/16 15:39, John Trowbridge wrote:
On 01/28/2016 10:25 AM, Karanbir Singh wrote:
On 28/01/16 11:54, John Trowbridge wrote:
That would be awesome. I tried putting one of them on a personal RAX account, but it was not really much of an improvement. I have currently updated the documentation for tripleo-quickstart to include instructions to pre-download the images. This has been a viable workaround for the near term, but it is still probably not ideal to be pointing end users at artifacts.ci.centos.
as a data point - are you able to grab some images currently in place on buldlogs.centos.org hosts and see if its any better speeds ? try these urls http://buildlogs.centos.org/centos/7/atomic-host/x86_64/images/CentOS
- -Atomic-Host-7.20160125-GenericCloud.qcow2.gz
After some further troubleshooting with folks, I am not so sure it is a
speed issue so much as nginx dropping the connection. My workaround to pre-download the images uses wget for the built-in retry w/ resume, and I have not had any reported issues using that process.
Ansible uses curl, which is not handling the dropped http connection well, resulting in a broken download.
I tried the above link and it works great for me, but so does the artifacts server. Is the buildlogs server also going through nginx?
the buildlogs services are geo distributed across the US and EU. and run apache httpd natively. We are working with a CDN provider to get upto 40 pop's across asia, europe, america's - but thats a few weeks ( best case) out yet.
- -- Karanbir Singh, Project Lead, The CentOS Project +44-207-0999389 | http://www.centos.org/ | twitter.com/CentOS GnuPG Key : http://www.karan.org/publickey.asc
On 28/01/16 16:59, Karanbir Singh wrote:
On 28/01/16 15:39, John Trowbridge wrote:
On 01/28/2016 10:25 AM, Karanbir Singh wrote:
On 28/01/16 11:54, John Trowbridge wrote:
That would be awesome. I tried putting one of them on a personal RAX account, but it was not really much of an improvement. I have currently updated the documentation for tripleo-quickstart to include instructions to pre-download the images. This has been a viable workaround for the near term, but it is still probably not ideal to be pointing end users at artifacts.ci.centos.
as a data point - are you able to grab some images currently in place on buldlogs.centos.org hosts and see if its any better speeds ? try these urls http://buildlogs.centos.org/centos/7/atomic-host/x86_64/images/CentOS
-Atomic-Host-7.20160125-GenericCloud.qcow2.gz
After some further troubleshooting with folks, I am not so sure it is a
speed issue so much as nginx dropping the connection. My workaround to pre-download the images uses wget for the built-in retry w/ resume, and I have not had any reported issues using that process.
Ansible uses curl, which is not handling the dropped http connection well, resulting in a broken download.
I tried the above link and it works great for me, but so does the artifacts server. Is the buildlogs server also going through nginx?
the buildlogs services are geo distributed across the US and EU. and run apache httpd natively. We are working with a CDN provider to get upto 40 pop's across asia, europe, america's - but thats a few weeks ( best case) out yet.
just had a very quick chat with John on IRC - the summary of which is that the wget process he's using ( with retry ), seems to work around the problem they had. So we can park this issue for the time being.
Ci-users mailing list Ci-users@centos.org https://lists.centos.org/mailman/listinfo/ci-users
-
David Moreau Simard -
John Trowbridge -
Karanbir Singh -
Karanbir Singh