If your server crashes frequently and if your log throws out the following error message, then you are probably running with buggy kernel version “2.6.18-194.32.1.el5“. This needs to be upgraded to “kernel-2.6.18-238” atleast.
Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 2193 2166 2194 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff8104329ffe18 0000000000000082 ffff810363481558 ffff810432a92a78
Mar 6 00:36:06 mytv kernel: 0000000300000001 0000000000000007 ffff8103317fd7a0 ffff81041d767040
Mar 6 00:36:06 mytv kernel: 000145a166ba6621 0000000001178623 ffff8103317fd988 0000000280008d94
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] thread_return+0x62/0xfe
Mar 6 00:36:06 mytv kernel: [] sys_getsockname+0x9c/0xb2
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:
Mar 6 00:36:06 mytv kernel: INFO: task mysqld:27457 blocked for more than 120 seconds.
Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 27457 2166 27463 27441 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff8101db559e18 0000000000000082 0000000000000000 0000000000000001
Mar 6 00:36:06 mytv kernel: ffff8101db559e88 0000000000000001 ffff81029e23f040 ffff810171c3d080
Mar 6 00:36:06 mytv kernel: 000145a4237abea6 000000000000bde6 ffff81029e23f228 0000000200000000
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] generic_file_aio_read+0x34/0x39
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] autoremove_wake_function+0x0/0x2e
Mar 6 00:36:06 mytv kernel: [] thread_return+0x62/0xfe
Mar 6 00:36:06 mytv kernel: [] sys_faccessat+0x148/0x18d
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:
Mar 6 00:36:06 mytv kernel: INFO: task mysqld:27464 blocked for more than 120 seconds.
Mar 6 00:36:06 mytv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Mar 6 00:36:06 mytv kernel: mysqld D 0000000000000014 0 27464 2166 27466 27463 (NOTLB)
Mar 6 00:36:06 mytv kernel: ffff81023fe05e18 0000000000000082 0000000000000000 0000000000000001
Mar 6 00:36:06 mytv kernel: ffff81023fe05e88 0000000000000007 ffff8102151677a0 ffff81043e0c0040
Mar 6 00:36:06 mytv kernel: 000145ae237fd7de 0000000003d504c4 ffff810215167988 0000000200000000
Mar 6 00:36:06 mytv kernel: Call Trace:
Mar 6 00:36:06 mytv kernel: [] generic_file_aio_read+0x34/0x39
Mar 6 00:36:06 mytv kernel: [] __down_read+0x7a/0x92
Mar 6 00:36:06 mytv kernel: [] do_page_fault+0x446/0x874
Mar 6 00:36:06 mytv kernel: [] autoremove_wake_function+0x0/0x2e
Mar 6 00:36:06 mytv kernel: [] sys_faccessat+0x148/0x18d
Mar 6 00:36:06 mytv kernel: [] error_exit+0x0/0x84
Mar 6 00:36:06 mytv kernel:
Steps to upgrade kernel
======================
You can download it from CentOS official site by changing the CentosBase repo file “/etc/yum.repos.d/CentOS-Base.repo” from
[base] name=CentOS-$releasever - Base mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo =os #baseurl=http://mirror.centos.org/centos/$releasever/os/$basearch/ gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5
to
[base] name=CentOS-$releasever - Base mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo =os #baseurl=http://mirror.centos.org/centos/$releasever/centosplus/$basearch/ gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5
And try by using the following command
#yum upgrade kernel*
make sure that you have default=0 in /etc/grub.conf which will load the newer version of kernel after reboot.
Thanks for viewing helpinlinux.com
You can’t be serious. You suggest “upgrading” to an unofficial kernel located on a .ru domain.
Yeah, I’m sure you’re not going to hack my box.
Please DO NOT follow these instructions. Use the official CentOS repositories only unless you really do know what you’re doing.
Hi,
Centos official site doesn’t have the upgraded kernel version in its repository when this post was made so I used unofficial kernel. Now they have added the new kernel version, so i have edited the post now, you can check with the same. Thank you for your advice.
Well guess what, i am facing this problem in kernel-2.6.18-238 !
HELP!!!
Hi,
Try upgrading the kernel to another high version.