echo 0 proc sys kernel hung_task_timeout_secs disables this message

If your server crashes frequently and if your log throws out the following error message, then you are probably running with buggy kernel version “2.6.18-194.32.1.el5“. This needs to be upgraded to “kernel-2.6.18-238” atleast.

 

Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 2193 2166 2194 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff8104329ffe18 0000000000000082 ffff810363481558 ffff810432a92a78
Mar 6 00:36:06 mytv kernel: 0000000300000001 0000000000000007 ffff8103317fd7a0 ffff81041d767040
Mar 6 00:36:06 mytv kernel: 000145a166ba6621 0000000001178623 ffff8103317fd988 0000000280008d94
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] thread_return+0x62/0xfe
Mar 6 00:36:06 mytv kernel: [] sys_getsockname+0x9c/0xb2
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:
Mar 6 00:36:06 mytv kernel: INFO: task mysqld:27457 blocked for more than 120 seconds.
Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 27457 2166 27463 27441 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff8101db559e18 0000000000000082 0000000000000000 0000000000000001
Mar 6 00:36:06 mytv kernel: ffff8101db559e88 0000000000000001 ffff81029e23f040 ffff810171c3d080
Mar 6 00:36:06 mytv kernel: 000145a4237abea6 000000000000bde6 ffff81029e23f228 0000000200000000
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] generic_file_aio_read+0x34/0x39
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] autoremove_wake_function+0x0/0x2e
Mar 6 00:36:06 mytv kernel: [] thread_return+0x62/0xfe
Mar 6 00:36:06 mytv kernel: [] sys_faccessat+0x148/0x18d
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:
Mar 6 00:36:06 mytv kernel: INFO: task mysqld:27464 blocked for more than 120 seconds.
Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 27464 2166 27466 27463 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff81023fe05e18 0000000000000082 0000000000000000 0000000000000001
Mar 6 00:36:06 mytv kernel: ffff81023fe05e88 0000000000000007 ffff8102151677a0 ffff81043e0c0040
Mar 6 00:36:06 mytv kernel: 000145ae237fd7de 0000000003d504c4 ffff810215167988 0000000200000000
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] generic_file_aio_read+0x34/0x39
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] autoremove_wake_function+0x0/0x2e
Mar 6 00:36:06 mytv kernel: [] sys_faccessat+0x148/0x18d
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:

 

Steps to upgrade kernel

======================

You can download it from CentOS official site by changing the CentosBase repo file “/etc/yum.repos.d/CentOS-Base.repo” from

[base]
name=CentOS-$releasever - Base
mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo  
=os
#baseurl=http://mirror.centos.org/centos/$releasever/os/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

to

[base]
name=CentOS-$releasever - Base
mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo
=os
#baseurl=http://mirror.centos.org/centos/$releasever/centosplus/$basearch/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

And try by using the following command

#yum upgrade kernel*

make sure that you have default=0 in /etc/grub.conf which will load the newer version of kernel after reboot.
 




 

Thanks for viewing helpinlinux.com

5 comments

  1. Eternally Vigilant says:

    You can’t be serious. You suggest “upgrading” to an unofficial kernel located on a .ru domain.

    Yeah, I’m sure you’re not going to hack my box.

    Please DO NOT follow these instructions. Use the official CentOS repositories only unless you really do know what you’re doing.

    • Siru says:

      Hi,

      Centos official site doesn’t have the upgraded kernel version in its repository when this post was made so I used unofficial kernel. Now they have added the new kernel version, so i have edited the post now, you can check with the same. Thank you for your advice.

Leave a Reply to Shoaib Cancel reply

Protected by WP Anti Spam