attempt to access beyond end of device

# Recently, in the last few weeks, my box has started to become increasingly unstable.
# I'm not aware of any significant changes having been made, hardware or software wise
# other than the usual periodic `yum update`
# Several months ago (at least year+ now) I did resize one of the partitions as I moved
# data around to a new VMDK.  Perhaps this is the root cause.

# This morning (9/24) it tanked again but this time I saw a 'kernel: journal commit I/O error'
# on the console. The box was nonresponsive so I rebooted it. The box came back up and again
# within 30-40 minutes or so it became non responsive.  Usually services start to fail like
# Apache, mail & SQL.  After a reboot it was up for about an hour but starting at
# 11:40:47 AM EST, it started spewing errors in /var/log/messages.

# I have no software or hardware RAID setup on this box.
# This is a virtual machine (on ESXi) that sits on a NAS.
# The NAS is setup for RAID5.

# I've been told two things thus far
#    1) filesystem larger than your partition
#    2) problem may be that you already resized the volume but not the filesystem, so to fix
#    you need to make it the original size again then resize the f/s then the volume
# For starters, I have no idea what the exact sizes of these were back then!
# Second, I'm not sure how I can resize the filesystem to match the current volume size
# without losing data (without dd'ing to another device then dd'ing back)
###################################################################################################

# cat /etc/redhat-release
CentOS release 5.8 (Final)

# kernel
2.6.18-308.13.1.el5

# fdisk -ul /dev/sda

Disk /dev/sda: 42.9 GB, 42949672960 bytes
255 heads, 63 sectors/track, 5221 cylinders, total 83886080 sectors
Units = sectors of 1 * 512 = 512 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *          63      208844      104391   83  Linux
/dev/sda2          208845    31459327    15625241+  83  Linux
/dev/sda3        31664115    63119384    15727635   83  Linux
/dev/sda4        63119385    83875364    10377990    5  Extended
/dev/sda5        63119448    73609829     5245191   83  Linux
/dev/sda6        73609893    75714344     1052226   82  Linux swap / Solaris
/dev/sda7        75714408    77811711     1048652   83  Linux


 # mount
/dev/sda7 on / type ext3 (rw,usrquota)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/sdb1 on /home type ext3 (rw,usrquota)
/dev/sda5 on /tmp type ext3 (rw,noexec,nosuid)
/dev/sda3 on /usr type ext3 (rw,usrquota)
/dev/sda2 on /var type ext3 (rw,usrquota)
/dev/sda1 on /boot type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw,noexec,nosuid)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
/tmp on /var/tmp type none (rw,noexec,nosuid,bind)

# handful of entries from var/log/messages
Sep 24 11:40:47 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:47 srv11 kernel: sda2: rw=0, want=6466685320, limit=31455270
Sep 24 11:40:47 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:47 srv11 kernel: sda2: rw=0, want=6466685320, limit=31455270
Sep 24 11:40:47 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:47 srv11 kernel: sda2: rw=0, want=6466685320, limit=31455270
...
Sep 24 11:40:48 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:48 srv11 kernel: sda2: rw=0, want=6466685320, limit=31455270
Sep 24 11:40:48 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:48 srv11 kernel: sda2: rw=0, want=7273095608, limit=31455270
Sep 24 11:40:48 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:48 srv11 kernel: sda2: rw=0, want=6065068504, limit=31455270
Sep 24 11:40:48 srv11 kernel: attempt to access beyond end of device
Sep 24 11:40:48 srv11 kernel: sda2: rw=0, want=15083465552, limit=31455270
...