[CentOS] Odd INFO "120 seconds" in logs for 2.6.18-194.3.1

Mon Jun 7 20:12:36 UTC 2010
Steve Brooks <steveb at mcs.st-and.ac.uk>

Hi,

Since upgrading to "2.6.18-194" I am getting odd messages in the logs. 
Such as;

sraid3 kernel  INFO  task pdflush 259 blocked for more than 120 seconds.


The output from

> grep '120 seconds' /var/log/messages | tr : ' ' | awk '{print $10}' | sort | uniq -c

       6 nfsd
       4 pdflush

This is from an NFS server that since the upgrade has been flakey. I have 
an identical server running "2.6.18-164.11.1" and no such messages are 
seen.

is anyone else seeing this and/or know what is going on?

Steve

The messages appear  as follows.

============================================================================================

Jun  7 19:45:21 sraid3 kernel: INFO: task nfsd:3369 blocked for more than 
120 seconds.
Jun  7 19:45:21 sraid3 kernel: "echo 0 > 
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun  7 19:45:21 sraid3 kernel: nfsd          D ffff8101062a9100     0 
3369      1          3370  3368 (L-TLB)
Jun  7 19:45:21 sraid3 kernel:  ffff8101053519e0 0000000000000046 
0000000000000020 ffff810105ea0780
Jun  7 19:45:21 sraid3 kernel:  ffff8101180e203a 000000000000000a 
ffff81013ecb77a0 ffff8101062a9100
Jun  7 19:45:21 sraid3 kernel:  00000cab54499f77 00000000000026c3 
ffff81013ecb7988 00000001000002d8
Jun  7 19:45:21 sraid3 kernel: Call Trace:
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff80064b29>] 
_spin_lock_bh+0x9/0x14
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff800ec2a2>] inode_wait+0x0/0xd
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff800ec2ab>] inode_wait+0x9/0xd
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff80063a16>] 
__wait_on_bit+0x40/0x6e
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff800ec2a2>] inode_wait+0x0/0xd
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff80063ab0>] 
out_of_line_wait_on_bit+0x6c/0x78
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff800a0aec>] 
wake_bit_function+0x0/0x23
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff8003dbbf>] ifind_fast+0x6e/0x83
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff80023290>] 
iget_locked+0x59/0x149
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88cf0b0f>] 
:ext4:ext4_iget+0x16/0x65a
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff800a0abe>] 
autoremove_wake_function+0x0/0x2e
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88cf8171>] 
:ext4:ext4_get_dentry+0x3b/0x87
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dcf36b>] 
:exportfs:find_exported_dentry+0x43/0x480
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88ddc753>] 
:nfsd:nfsd_acceptable+0x0/0xd8
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88de074f>] 
:nfsd:exp_get_by_name+0x5b/0x71
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88de0d3e>] 
:nfsd:exp_find_key+0x89/0x9c
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff8008b4b1>] 
__wake_up_common+0x3e/0x68
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff8009b1dd>] 
set_current_groups+0x159/0x164
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dcf7f3>] 
:exportfs:export_decode_fh+0x4b/0x50
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88ddcac5>] 
:nfsd:fh_verify+0x29a/0x4bd
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dddccf>] 
:nfsd:nfsd_open+0x20/0x184
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dddffb>] 
:nfsd:nfsd_write+0x89/0xd5
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88de4b1a>] 
:nfsd:nfsd3_proc_write+0xea/0x109
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dda1db>] 
:nfsd:nfsd_dispatch+0xd8/0x1d6
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88d5a651>] 
:sunrpc:svc_process+0x454/0x71b
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff80064644>] __down_read+0x12/0x92
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dda5a1>] :nfsd:nfsd+0x0/0x2cb
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dda746>] 
:nfsd:nfsd+0x1a5/0x2cb
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff8005dfb1>] child_rip+0xa/0x11
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dda5a1>] :nfsd:nfsd+0x0/0x2cb
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff88dda5a1>] :nfsd:nfsd+0x0/0x2cb
Jun  7 19:45:21 sraid3 kernel:  [<ffffffff8005dfa7>] child_rip+0x0/0x11

============================================================================================



-- 
Dr Stephen Brooks

http://www-solar.mcs.st-and.ac.uk/
Solar MHD Theory Group
Tel    ::  01334 463735
Fax    ::  01334 463748
E-mail :: steveb at mcs.st-andrews.ac.uk
---------------------------------------
Mathematical Institute
North Haugh
University of St. Andrews
St Andrews, Fife KY16 9SS
SCOTLAND
---------------------------------------