I think I am encountering a download file size limit on centos 4 with httpd-2.0.52
The file in question is 5.2G in size, it does not show up in a browser directory listing, and I'm getting the error in the http error_log
value too large for defined data type: access
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
Tony Schreiner Boston College
centos-bounces@centos.org <> scribbled on Friday, October 20, 2006 1:32 PM:
I think I am encountering a download file size limit on centos 4 with httpd-2.0.52
The file in question is 5.2G in size, it does not show up in a browser directory listing, and I'm getting the error in the http error_log
value too large for defined data type: access
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
Tony Schreiner Boston College _______________________________________________ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
I thought the limit was 2GB, but I could be wrong. I also think this limitation is why the DVD.iso is distributed as a .torrent
Mike
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
Brett
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
No, this case is strictly an apache thing. the ext3 file size limitation is larger than 5G
On Fri, 2006-10-20 at 14:44 -0400, Jim Perrin wrote:
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
No, this case is strictly an apache thing. the ext3 file size limitation is larger than 5G
Right ... the apache is compiled without large file support ...
and before anyone asks ... NO, we won't compile apache with large file support ... apache 2.0 with large file support breaks many ABIs and it is not enterprise quality :)
On Oct 20, 2006, at 4:06 PM, Johnny Hughes wrote:
On Fri, 2006-10-20 at 14:44 -0400, Jim Perrin wrote:
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
No, this case is strictly an apache thing. the ext3 file size limitation is larger than 5G
Right ... the apache is compiled without large file support ...
and before anyone asks ... NO, we won't compile apache with large file support ... apache 2.0 with large file support breaks many ABIs and it is not enterprise quality :)
Just FYI, I compiled version 2.2 from apache.org and am running it in parallel on another port. I am able to download my large file that way.
Thanks for all the replies. Tony
On Fri, October 20, 2006 2:36 pm, Brett Serkez wrote:
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
On a side note the maximum file size for ext3 is partially dependent on the block size selected during formatting.
From what I can remember the following table depicts those limits.
Block size Max file size 1KB 16GB 2KB 256GB 4KB 2TB 8KB 2TB
On 10/20/06, Brett Serkez bserkez@gmail.com wrote:
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
Brett
I want to make a clarification here, and I would urge others to do the same. In the past few months, in many of my dealings with other Linux users, the topic of "which filesystem?" has been coming up more and more. Sure there may be some arcane benchmarks or even advanced features in certain file systems that might be useful to some ADVANCED users, who, in such a case, would already mostly know how this stuff works.
However, what I've been seeing much more lately is a symptom of confusion by users who are not advanced, and most beginners, who are totally confused about which file system to use. They think that some files (like mp3s or videos) can only be stored in certain file systems, or like in this case, there are some arbitrary limits on a file system and *obviously* another one (their favorite) is better.
I would ask any and all Linux users/admins who understand that the file system has nothing to do with the type of files you can store on it, and know that most users should not be worrying or even thinking about this at all, to please, please clarify this type of thinking whenever they see it. At recent linux user meetings I've been to, this has become one of the biggest points of confusion for both beginner and intermediate linux users.
Brett Serkez wrote:
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
The file size limitation is in the file system type, ext3 is the default on CentOS. There are other file system types that can be used in a partitiion, such as reiser, jfs, xfs, each with their own attributes.
No, the file system has nothing to do with it. You can have files way larger than 4GB on ext3.
The reason for 2GB limit in Apache is historical, and is based on sizes of data types in C programming language on 32-bit platforms, taking into account that too many applications use signed integer for storing the file size.
Tony Schreiner wrote:
I think I am encountering a download file size limit on centos 4 with httpd-2.0.52
The file in question is 5.2G in size, it does not show up in a browser directory listing, and I'm getting the error in the http error_log
value too large for defined data type: access
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
The limit is 2GB. While you can compile apache without limit, many programs will not work correctly with larger files, and some will simply refuse to touch anything larger than 2GB (for example, squid proxy server). With some applications it is just cosmetic stuff (they display negative size), some will totally break.
BTW, you should be able to serve files larger than 2GB over FTP. Actually, most CentOS mirrors that do carry DVD ISO images serve them only over FTP (I think there's only couple that serve them over HTTP too).
On Fri, 2006-10-20 at 20:58 -0500, Aleksandar Milivojevic wrote:
Tony Schreiner wrote:
I think I am encountering a download file size limit on centos 4 with httpd-2.0.52
The file in question is 5.2G in size, it does not show up in a browser directory listing, and I'm getting the error in the http error_log
value too large for defined data type: access
can someone confirm that there is a 4GB limit (or other) in the standard apache 2.0 on CentOS 4?
I honestly do not know how to change that but You should try breaking the files into 2GB Pieces, this would solve the issue (Hopefully).
-
Aleksandar Milivojevic -
Brett Serkez -
Brian Mathis -
Jim Perrin -
Johnny Hughes -
Matthew Martz -
Mike Kercher -
Samuel -
Tony Schreiner