Hello!
Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format ?
root@test-srv:~# wget http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw --2016-03-21 13:16:31-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 374668382 (357M) [application/x-gzip] Saving to: 'CentOS-7-x86_64-GenericCloud.raw' CentOS-7-x86_64-GenericCloud.raw 100%[=========================================================================>] 357.31M 12.9MB/s in 30s 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw' saved [374668382/374668382]
Download reports [application/x-gzip] for raw file
And indeed root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified: Sat Feb 27 02:14:37 2016, from Unix
Ok, lets uncompress: root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw > CentOS-7-x86_64-GenericCloud.a
And check again root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU)
Ok. it's a tar archive.
root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v CentOS-7-x86_64-GenericCloud-1602.raw
Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw
What is the point to pack single raw file into the tar.gz and to name it raw ? Or it's just a mistake ?
Thanks!
On 21/03/16 14:34, Aliaksei Sheshka wrote:
What is the point to pack single raw file into the tar.gz and to name it raw ? Or it's just a mistake ?
Johnny is looking at the cdn side of thigs, but effectively we will not have a .raw - we will have a .raw.tar.gz file ( which will itself only have a .raw file compressed inside it )
On 03/21/2016 09:51 AM, Karanbir Singh wrote:
On 21/03/16 14:34, Aliaksei Sheshka wrote:
What is the point to pack single raw file into the tar.gz and to name it raw ? Or it's just a mistake ?
Johnny is looking at the cdn side of thigs, but effectively we will not have a .raw - we will have a .raw.tar.gz file ( which will itself only have a .raw file compressed inside it )
It looks as if using 'Multiple Views' in the apache setup means that you can effectively download a file even leaving off the extension .. in your case, it left off the tar.gz but allowed you to download that file anyway.
We are looking at changing the apache configuration to prevent this type of thing in the future.
As an example:
http://mirror.centos.org/centos/7/isos/x86_64/CentOS-7-x86_64-Everything-151...
that pulls down the .torrent file even though there is no .torrent
The bottom line is, please download the .raw.tar.gz file and not the .raw file and we are working on the configs.
On 21 March 2016 at 11:51, Karanbir Singh mail-lists@karan.org wrote:
On 21/03/16 14:34, Aliaksei Sheshka wrote:
What is the point to pack single raw file into the tar.gz and to name it
raw ?
Or it's just a mistake ?
Johnny is looking at the cdn side of thigs, but effectively we will not have a .raw - we will have a .raw.tar.gz file ( which will itself only have a .raw file compressed inside it )
-- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc
Why not a compressed qcow2?
Like: CentOS-7-x86_64-GenericCloud.qcow2c
This way, we can add it as-is to OpenStack Glance, that it will be downloaded by demand, when required and, OpenStack Nova will automatically uncompress the image for runtime.
Cheers! Thiago
On 22/03/16 01:06, Martinx - ジェームズ wrote:
On 21 March 2016 at 11:51, Karanbir Singh mail-lists@karan.org wrote:
On 21/03/16 14:34, Aliaksei Sheshka wrote:
What is the point to pack single raw file into the tar.gz and to name it
raw ?
Or it's just a mistake ?
Johnny is looking at the cdn side of thigs, but effectively we will not have a .raw - we will have a .raw.tar.gz file ( which will itself only have a .raw file compressed inside it )
-- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc
Why not a compressed qcow2?
Like: CentOS-7-x86_64-GenericCloud.qcow2c
This way, we can add it as-is to OpenStack Glance, that it will be downloaded by demand, when required and, OpenStack Nova will automatically uncompress the image for runtime.
We do publish a qcow2c, the always updated version ( updated each month end ) is at : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c
This is a symlink that points to the latest image. At the moment this is : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qc...
There will be a 1603 by the end of this week
Why not a compressed qcow2?
Like: CentOS-7-x86_64-GenericCloud.qcow2c
This way, we can add it as-is to OpenStack Glance, that it will be downloaded by demand, when required and, OpenStack Nova will
automatically
uncompress the image for runtime.
We do publish a qcow2c, the always updated version ( updated each month end ) is at : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c
This is a symlink that points to the latest image. At the moment this is :
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qc...
There will be a 1603 by the end of this week
-- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc
Sounds awesome! Thanks for sharing the symlink... I'll use it instead.. Cheers!
Problem re-appeared again.
At that time I'm unable to download Cloud Image linked from
https://wiki.centos.org/Download
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz
$ wget http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz --2016-10-10 11:21:32-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2607:1680:0:1::2 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 404 Not Found 2016-10-10 11:21:32 ERROR 404: Not Found.
As before I'm looking for a raw image, or a tar of the corresponding file system,
Thanks!
On Tue, Mar 29, 2016 at 12:57 PM, Martinx - ジェームズ thiagocmartinsc@gmail.com wrote:
Why not a compressed qcow2?
Like: CentOS-7-x86_64-GenericCloud.qcow2c
This way, we can add it as-is to OpenStack Glance, that it will be downloaded by demand, when required and, OpenStack Nova will
automatically
uncompress the image for runtime.
We do publish a qcow2c, the always updated version ( updated each month end ) is at : http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2c
This is a symlink that points to the latest image. At the moment this is :
http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1602.qc...
There will be a 1603 by the end of this week
-- Karanbir Singh +44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh GnuPG Key : http://www.karan.org/publickey.asc
Sounds awesome! Thanks for sharing the symlink... I'll use it instead.. Cheers! _______________________________________________ CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote:
$ wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz --2016-10-10 11:21:32-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2607:1680:0:1::2 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 404 Not Found 2016-10-10 11:21:32 ERROR 404: Not Found.
As before I'm looking for a raw image, or a tar of the corresponding file system,
did you look in the directory to see what is there?
http://cloud.centos.org/centos/7/images/
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of John R Pierce Sent: Monday, October 10, 2016 1:31 PM To: centos@centos.org Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 10/10/2016 8:28 AM, Aliaksei Sheshka wrote:
$ wgethttp://cloud.centos.org/centos/7/images/CentOS-7-x86_64-
GenericClo
ud.raw.xz --2016-10-10 11:21:32-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-
GenericCloud.r
aw.xz Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2607:1680:0:1::2 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 404 Not Found 2016-10-10 11:21:32 ERROR 404: Not Found.
As before I'm looking for a raw image, or a tar of the corresponding file system,
did you look in the directory to see what is there?
Hello,
Just a question, what exactly are these images?
I see it mentioned on the CentOS website but not a lot of info on exactly what it is and what it does.
How does this differ from a CentOS 7 VM installed from an ISO? Are these just pre-made images?
thanks
On 11/10/16 03:21, TE Dukes wrote:
Just a question, what exactly are these images?
I see it mentioned on the CentOS website but not a lot of info on exactly what it is and what it does.
How does this differ from a CentOS 7 VM installed from an ISO? Are these just pre-made images?
these are images prebuilt to work in cloud infrastructure like openshift / amazon ec2 etc. they are pre-setup with cloud-init tools and are formatted in different backing filetypes.
you can use them for local VM's as well, but you will just need to do a bit more work since there is no way to login to the images without exporting the metadata externally to setup passwords and keys etc.
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of Karanbir Singh Sent: Tuesday, October 11, 2016 5:21 PM To: centos@centos.org Subject: Re: [CentOS] CentOS-7-x86_64-GenericCloud.raw very unusual format
On 11/10/16 03:21, TE Dukes wrote:
Just a question, what exactly are these images?
I see it mentioned on the CentOS website but not a lot of info on exactly what it is and what it does.
How does this differ from a CentOS 7 VM installed from an ISO? Are these just pre-made images?
these are images prebuilt to work in cloud infrastructure like openshift / amazon ec2 etc. they are pre-setup with cloud-init tools and are formatted
in
different backing filetypes.
you can use them for local VM's as well, but you will just need to do a
bit
more work since there is no way to login to the images without exporting
the
metadata externally to setup passwords and keys etc.
Sorry I haven't replied sooner. Still trying to digest this.
I appreciate your response. I have no idea what you said or what use they would be if you couldn't login except via SSH. How would you add content? I did see something about having to change the root password or something.
Might spin one up to see, I'm still lost.
Is there a demo site?
TIA
did you look in the directory to see what is there?
Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare with CentOS-7-x86_64-GenericCloud.raw.xz )
But again link is not good, and why put raw disk inside the tar? It would me more natural to have compressed image so one can do {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.
Official wiki link is broken regardless.
On 11/10/16 13:16, Aliaksei Sheshka wrote:
did you look in the directory to see what is there?
Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare with CentOS-7-x86_64-GenericCloud.raw.xz )
But again link is not good, and why put raw disk inside the tar?
This is how OracleCloud works, they are unable to consume a raw file directly. I agree, its a bit odd.
It would me more natural to have compressed image so one can do {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.
for the sake of size, lots of people prefer to download the qcow2c image ( note the compressed flag ), and qemu-img convert on their own end. Is that an option for your usecase ?
Official wiki link is broken regardless.
will try and get that fixed.
On Tue, Oct 11, 2016 at 08:16:14AM -0400, Aliaksei Sheshka wrote:
Kind of, there is a CentOS-7-x86_64-GenericCloud.raw.tar.gz ( compare with CentOS-7-x86_64-GenericCloud.raw.xz ) But again link is not good, and why put raw disk inside the tar? It would me more natural to have compressed image so one can do {z,bz,xc}cat cloud.raw.xz > /dev/lvm/vm-disk for example.
Earlier versions of xz (RHEL 5, I think?) didn't handle sparse files, and we put the Fedora raw cloud image inside a tar for that reason. I don't know if the same applies here, but it might.
On 21/03/16 15:34, Aliaksei Sheshka wrote:
Hello!
Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format ?
root@test-srv:~# wget http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw --2016-03-21 13:16:31-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 374668382 (357M) [application/x-gzip] Saving to: 'CentOS-7-x86_64-GenericCloud.raw' CentOS-7-x86_64-GenericCloud.raw 100%[=========================================================================>] 357.31M 12.9MB/s in 30s 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw' saved [374668382/374668382]
Download reports [application/x-gzip] for raw file
And indeed root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified: Sat Feb 27 02:14:37 2016, from Unix
Ok, lets uncompress: root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw > CentOS-7-x86_64-GenericCloud.a
And check again root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU)
Ok. it's a tar archive.
root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v CentOS-7-x86_64-GenericCloud-1602.raw
Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw
What is the point to pack single raw file into the tar.gz and to name it raw ? Or it's just a mistake ?
Thanks!
So I found yesterday that the MultiViews option was active in the template used by cfgmgmt for those vhosts, and was the root cause of that behaviour. I confirm that such .raw image wasn't even present on those cloud.centos.org, but httpd served the .raw.tar.gz instead. Fix for this was pushed earlier today so you'll now have a 404 if you try to download that .raw file again. That brings though another question : why trying specifically to download a .raw file that isn't listed on that page ?
What you mean is not listed ? Click 1) https://www.centos.org/download/ there click 2) More download choices it goes to 3) https://wiki.centos.org/Download there you see 4) Cloud / Containers , http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
raw files are very useful, they are very convenient to tweak by simply mounting using losetup. And there is no good reason to put 1 file inside tar.gz, just compressed raw.gz would be fine.
On Tue, Mar 22, 2016 at 8:35 AM, Fabian Arrotin arrfab@centos.org wrote:
On 21/03/16 15:34, Aliaksei Sheshka wrote:
Hello!
Is anyone aware why CentOS-7-x86_64-GenericCloud.raw has such unusual format ?
root@test-srv:~# wget http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw --2016-03-21 13:16:31-- http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138 Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 374668382 (357M) [application/x-gzip] Saving to: 'CentOS-7-x86_64-GenericCloud.raw' CentOS-7-x86_64-GenericCloud.raw 100%[=========================================================================>] 357.31M 12.9MB/s in 30s 2016-03-21 13:17:03 (11.9 MB/s) - 'CentOS-7-x86_64-GenericCloud.raw' saved [374668382/374668382]
Download reports [application/x-gzip] for raw file
And indeed root@test-srv:~# file CentOS-7-x86_64-GenericCloud.raw CentOS-7-x86_64-GenericCloud.raw: gzip compressed data, last modified: Sat Feb 27 02:14:37 2016, from Unix
Ok, lets uncompress: root@test-srv:~# zcat -d CentOS-7-x86_64-GenericCloud.raw > CentOS-7-x86_64-GenericCloud.a
And check again root@test-srv:~# file CentOS-7-x86_64-GenericCloud.a CentOS-7-x86_64-GenericCloud.a: POSIX tar archive (GNU)
Ok. it's a tar archive.
root@test-srv:~# tar -xf CentOS-7-x86_64-GenericCloud.a -v CentOS-7-x86_64-GenericCloud-1602.raw
Now it's CentOS-7-x86_64-GenericCloud-1602.raw file which is indeed raw
What is the point to pack single raw file into the tar.gz and to name it raw ? Or it's just a mistake ?
Thanks!
So I found yesterday that the MultiViews option was active in the template used by cfgmgmt for those vhosts, and was the root cause of that behaviour. I confirm that such .raw image wasn't even present on those cloud.centos.org, but httpd served the .raw.tar.gz instead. Fix for this was pushed earlier today so you'll now have a 404 if you try to download that .raw file again. That brings though another question : why trying specifically to download a .raw file that isn't listed on that page ?
-- Fabian Arrotin The CentOS Project | http://www.centos.org gpg key: 56BEC54E | twitter: @arrfab
CentOS mailing list CentOS@centos.org https://lists.centos.org/mailman/listinfo/centos
On 03/22/2016 08:15 AM, Aliaksei Sheshka wrote:
What you mean is not listed ? Click 1) https://www.centos.org/download/ there click 2) More download choices it goes to 3) https://wiki.centos.org/Download there you see 4) Cloud / Containers , http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.raw
raw files are very useful, they are very convenient to tweak by simply mounting using losetup. And there is no good reason to put 1 file inside tar.gz, just compressed raw.gz would be fine.
The reason is that some big cloud guys need it as a tgz because that is what they use.
It is just as easy for anyone else (not specifically needing tgz) to extract the image to obtain a raw file from tgz format as from gz format. (one command, you end up with the raw file).
This way, we only need one compressed raw image file, not 2 or 3 raw images compressed in different ways.
Thanks, Johnny Hughes
<snip>
-
Aliaksei Sheshka -
Fabian Arrotin -
John R Pierce -
Johnny Hughes -
Karanbir Singh -
Martinx - ジェームズ -
Matthew Miller -
TE Dukes