Discuss March 2011

discuss@lists.centos.org

286 participants
250 discussions

wich filesystem to store > 250E6 small files in same or hashed dire
by Alain Spineux 14 Mar '11

14 Mar '11

Hi I need to store about 250.000.000 files. Files are less than 4k. On a ext4 (fedora 14) the system crawl at 10.000.000 in the same directory. I tried to create hash directories, two level of 4096 dir = 16.000.000 but I had to stop the script to create these dir after hours and "rm -rf" would have taken days ! mkfs was my friend I tried two levels, first of 4096 dir, second of 64 dir. The creation of the hash dir took "only" few minutes, but copying 10000 files make my HD scream for 120s ! I take only 10s when working in the same directory. The filenames are all 27 chars and the first chars can be used to hash the files. My question is : Which filesystem and how to store these files ? Regards -- Alain Spineux | aspineux gmail com Monitor your iT & Backups | http://www.magikmon.com Free Backup front-end | http://www.magikmon.com/mksbackup Your email 100% available | http://www.emailgency.com

7 8

FTP accounts
by Huib Laurens 14 Mar '11

14 Mar '11

Hello, I have setup a centos server running 5.5 and I have a problem with the FTP settings. Currently I have two FTP accounts based on that server, they lead to: /home/bella /home/carmen Currently the FPT accounts starts in the home directory when they are logged in. But they are able to see all directories on the server. What can I do to make sure they cant come out of there home directory? -- Regards, Huib "Abigor" Laurens Support Free Knowledge: http://wikimediafoundation.org/wiki/Donate

5 5

NFS still serving old directory after rename
by neubyr 14 Mar '11

14 Mar '11

Howdy, I have renamed a directory on NFS ver 3 server and then created a new directory again with the same name. # mv dir dir-hosed # mkdir dir The directory is auto-mounted on client side. I had unmounted directories on client side before making above changes. Now when I try to mount back 'dir', I still see old files and not new empty dir. Am I missing something here in the NFS config? Is it caching old directory contents? Any help? thanks, neuby.

3 4

Server locking up everyday around 3:30 AM - (INFO: task wget:13608 blocked for more than 120 seconds) need sleep, help.
by PJ 14 Mar '11

14 Mar '11

This may or may not be CentOS related, but am out of ideas at this point and wanted to bounce this off the list. I'm running a CentOS 5.5 server, running the latest kernel 2.6.18-194.32.1.el5. Almost everyday around 3:30 AM the server completely locks up and has to be power cycled before it will come back online. (this means someone hat to wake up and reboot the server, oh how I love being an internet janitor! :) Smells like a hardware issue to me too, but I went through all of the dell diagnostics, updated the firmware, everything checks out as being okay, RAID, disks, RAM, etc... Spent an hour on the phone with a Dell tech. No hardware issues, at least that we were able to find. There are no cron jobs that run at 3:30, no backups, the server has a load of 0, nothing is scheduled around that time... The only crontab entry at all is "*/5 * * * * wget -q www.websitedomain.com/cron.php >/dev/null 2>&1" They are running Magento for commerce purposes and this runs every 5 minutes. Why does the server only lockup around 3:30 AM? Because it's knows I am fast asleep? I was able to pull this from /var/log/messages, this happens just seconds before locking up completely... Mar 8 03:33:18 web1 kernel: INFO: task wget:13608 blocked for more than 120 seconds. Mar 8 03:33:19 web1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 8 03:33:19 web1 kernel: wget D ffff810001004420 0 13608 13607 (NOTLB) Mar 8 03:33:19 web1 kernel: ffff81007bc7bc78 0000000000000086 ffff81007bc7bd88 ffff81000100d3f8 Mar 8 03:33:19 web1 kernel: ffff81007bc7bbf0 0000000000000007 ffff8100849db0c0 ffffffff80308b60 Mar 8 03:33:19 web1 kernel: 00013a2964cdf439 0000000000003237 ffff8100849db2a8 0000000064c82eae Mar 8 03:33:19 web1 kernel: Call Trace: Mar 8 03:33:20 web1 kernel: [<ffffffff80063c6f>] __mutex_lock_slowpath+0x60/0x9b Mar 8 03:33:20 web1 kernel: [<ffffffff80063cb9>] .text.lock.mutex+0xf/0x14 Mar 8 03:33:20 web1 kernel: [<ffffffff8000cf82>] do_lookup+0x90/0x1e6 Mar 8 03:33:20 web1 kernel: [<ffffffff8000a29c>] __link_path_walk+0xa01/0xf5b Mar 8 03:33:20 web1 kernel: [<ffffffff8000ea4b>] link_path_walk+0x42/0xb2 Mar 8 03:33:20 web1 kernel: [<ffffffff8000cd72>] do_path_lookup+0x275/0x2f1 Mar 8 03:33:23 web1 kernel: [<ffffffff80012851>] getname+0x15b/0x1c2 Mar 8 03:33:23 web1 kernel: [<ffffffff800239d1>] __user_walk_fd+0x37/0x4c Mar 8 03:33:23 web1 kernel: [<ffffffff80028905>] vfs_stat_fd+0x1b/0x4a Mar 8 03:33:23 web1 kernel: [<ffffffff80023703>] sys_newstat+0x19/0x31 Mar 8 03:33:23 web1 kernel: [<ffffffff8005d116>] system_call+0x7e/0x83 If anyone has some advice on where to go from here it would be greatly appreciated. Thanks in advance. -- PJF

6 5

internal ip
by mattias 14 Mar '11

14 Mar '11

cool! i reinstall centos yestoday and xen and forgot to put bridge=xenbr0 in the config and my vm automaticley tooks a internal ip 192.168 something and i haven't set it in xend-config.sxp will xen not automaticley have bridge set?

1 0

any tutorial/how to for su-exec php under selinux on centos 5?
by Eero Volotinen 14 Mar '11

14 Mar '11

Hi, Any good tutorial how to setup su-exec php unders selinux on centos 5? -- Eero

4 4

CentOS server install
by Damien Hull 13 Mar '11

13 Mar '11

It's been a while since I've used CentOS. I'm doing a test install for a server setup. I unchecked desktop and checked server. What does server give me?

4 4

IPC Benchmark in Centos
by Peter Penzov 13 Mar '11

13 Mar '11

Hi, I'm interested is there any benchmark tests for Centos. How fast is for example Unix domain socket and Message Queue? Regards Peter

3 4

How to install source rpm on centos
by sync 13 Mar '11

13 Mar '11

Hi to all. I'm having a problem with the rpm command on centos 5.5; I am used to recompile a source rpm with the following command: root@test ~: rpmbuild --rebuild pssh-1.2.2-1.rf.src.rpm Installing pssh-1.2.2-1.rf.src.rpm error: cannot create %sourcedir /home/test/rpm/SOURCES error: pssh-1.2.2-1.rf.src.rpm cannot be installed Does anybody know something about that ? Thanks in advance....

4 4

Re: [CentOS] Race condition with mdadm at boot
by Chuck Munro 13 Mar '11

13 Mar '11

On 03/12/2011 09:00 AM, compdoc wrote: >> >On the particular Supermicro motherboard I'm using, there is a very >> >long delay (10 or 15 sec) between power-on and initiation of visible >> >BIOS activity, so all disk drives have ample time to spin up and stabilize. > > Yeah, I have used Supermicro in the past and they had the same long pause > when you turn them on. Good boards, except I had one die recently. > > I was wondering how many drives total, and how many watts the PSU is? > > Also, is the controller's firmware up to date? > > I agree, Supermicro does design good boards, with a lot of server-grade features that consumer boards lack. Not cheap, but worth the money. I assume the long power-on pause is due to the BIOS silently checking RAM, with the side effect of giving the disks ample time to spin up. I have a total of 15 drives. Three of them are fast 2-1/2" drives used for the host OS filesystems, running on the ICH-10 SATA controller. No problem at all with those. The other 12 drives are 2TB WD Caviar Black series. 6 are connected to the on-board 8-port LSI 1068E chip, and 6 divided equally between 2 Tempo 'Sonnet' 4-port PCIe cards (Marvell chips). All drives have the same 8 partitions each. All drives have the same 8-partition configuration. The LSI controller supports 8 RAID-6 arrays using 5 active drives plus a hot spare. The Tempo controllers support the same arrangement using the other 6 drives. The firmware on everything is up to date. Other than the annoying failure to bind 1 or 2 random partitions on the last drive in each group of 6, the performance of this configuration is quite good. I still have the 'scsi_mod.scan=sync' kernel parameter in place, so there may be some other cause of the failure to bind some of the partitions. FWIW, in more than 10 system boots, there has never been any consistent pattern to these failures. Chuck

2 1

← Newer
1
...
11
12
13
14
15
16
17
...
25
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

Discuss March 2011