API tools faq
paste
Advertisement
Guest User

Postgres CPU soft lockup

a guest
Jul 5th, 2013
334
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 9.97 KB | None | 0 0
raw download clone embed print report
  1. Message from syslogd@glibmpdb001 at Jul  5 11:58:35 ...
  2.  kernel:[1813775.496456] Stack:
  3.  
  4. Message from syslogd@glibmpdb001 at Jul  5 11:58:35 ...
  5.  kernel:[1813775.496487] Call Trace:
  6.  
  7. Message from syslogd@glibmpdb001 at Jul  5 11:58:35 ...
  8.  kernel:[1813775.496585] Code: 39 0a 72 50 c7 02 00 00 00 00 8b 93 e0 00 00 00 48 8b 4c 24 28 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 38 1c 00 00 8b 4b 34 89 0a <eb> 27 48 ff 83 a0 00 00 00 48 8b 74 24 40 48 8b 7c 24 38 e8 00
  9.  
  10. [1813775.496127] BUG: soft lockup - CPU#3 stuck for 73s! [postgres:18723]
  11. [1813775.496232] Modules linked in: ksplice_qgqlupz2(O) ksplice_xnz0gzg4(O) ksplice_qkhyzcuo(O) ksplice_yqujy928_vmlinux_new(O) ksplice_yqujy928(O) ksplice_kcxjolf4(O) ksplice_4flavub6(O) ksplice_cbwue45z(O) ksplice_lggkb6n3_vmlinux_new(O) ksplice_lggkb6n3(O) ksplice_aib3o61b_vmlinux_new(O) ksplice_aib3o61b(O) ksplice_xy0ia043(O) ksplice_owmy15re(O) ksplice_8rsojbhr(O) ksplice_k8hjc0t0(O) ksplice_q9qowfxw(O) ksplice_tb393701(O) ksplice_m7aa9dau_vmlinux_new(O) ksplice_m7aa9dau(O) ksplice_xt82wyup(O) ksplice_8td5qotf(O) ksplice_clga6taq_vmlinux_new(O) ksplice_clga6taq(O) ksplice_yr1zy6b9_vmlinux_new(O) ksplice_yr1zy6b9(O) ksplice_cqy2c8w5_vmlinux_new(O) ksplice_cqy2c8w5(O) ksplice_8uop58vy_vmlinux_new(O) ksplice_8uop58vy(O) ksplice_6nh0bn6f_vmlinux_new(O) ksplice_6nh0bn6f(O) ksplice_fw3hau3j(O) ksplice_ifqrsd1p_vmlinux_new(O) ksplice_ifqrsd1p(O) ksplice_njd9qvp0(O) ksplice_lqsc6o34(O) ksplice_zyrhe5he_vmlinux_new(O) ksplice_zyrhe5he(O) ksplice_0lwo7qjs(O) ksplice_k36ujisx_vmlinux_new(O) ksplice_k36ujisx(O) ksplice_5thylwz8(O) ksplice_2g18u2g7(O) ksplice_ixmvcp18(O) ksplice_y464rjpt_vmlinux_new(O) ksplice_y464rjpt(O) ksplice_hkhli5md(O) ksplice_aanarxy3_vmlinux_new(O) ksplice_aanarxy3(O) ksplice_5jbsymg5_vmlinux_new(O) ksplice_5jbsymg5(O) ksplice_sslvhzno(O) ksplice_p41kj9hn_ext4_new(O) ksplice_p41kj9hn(O) ksplice_ahwbulf2(O) ksplice_u6ayurtd_jbd2_new(O) ksplice_u6ayurtd(O) ksplice_ms100f63_vmlinux_new(O) ksplice_ms100f63(O) ksplice_kyaykxnb(O) ksplice_to0ifrbz(O) ip6t_LOG xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT ipt_LOG xt_limit xt_tcpudp xt_addrtype xt_state ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables vsock(O) vmci(O) isofs ksplice_hciwvf0p(O) ksplice_qenkfvj2_vmlinux_new(O) ksplice_qenkfvj2(O) nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_pcm snd_page_alloc vmwgfx ttm drm parport_pc parport snd_timer coretemp crc32c_intel snd ghash_clmulni_intel ac shpchp vmw_balloon i2c_piix4 i2c_core soundcore power_supply processor aesni_intel psmouse pcspkr evdev serio_raw aes_x86_64 aes_generic button cryptd thermal_sys container ext4 crc16 jbd2 mbcache sr_mod cdrom sg ata_generic sd_mod crc_t10dif ata_piix floppy libata mptspi scsi_transport_spi mptscsih mptbase scsi_mod vmxnet3 [last unloaded: ksplice_qgqlupz2_mantis_core_new]
  12. [1813775.496336] CPU 3
  13. [1813775.496337] Modules linked in: ksplice_qgqlupz2(O) ksplice_xnz0gzg4(O) ksplice_qkhyzcuo(O) ksplice_yqujy928_vmlinux_new(O) ksplice_yqujy928(O) ksplice_kcxjolf4(O) ksplice_4flavub6(O) ksplice_cbwue45z(O) ksplice_lggkb6n3_vmlinux_new(O) ksplice_lggkb6n3(O) ksplice_aib3o61b_vmlinux_new(O) ksplice_aib3o61b(O) ksplice_xy0ia043(O) ksplice_owmy15re(O) ksplice_8rsojbhr(O) ksplice_k8hjc0t0(O) ksplice_q9qowfxw(O) ksplice_tb393701(O) ksplice_m7aa9dau_vmlinux_new(O) ksplice_m7aa9dau(O) ksplice_xt82wyup(O) ksplice_8td5qotf(O) ksplice_clga6taq_vmlinux_new(O) ksplice_clga6taq(O) ksplice_yr1zy6b9_vmlinux_new(O) ksplice_yr1zy6b9(O) ksplice_cqy2c8w5_vmlinux_new(O) ksplice_cqy2c8w5(O) ksplice_8uop58vy_vmlinux_new(O) ksplice_8uop58vy(O) ksplice_6nh0bn6f_vmlinux_new(O) ksplice_6nh0bn6f(O) ksplice_fw3hau3j(O) ksplice_ifqrsd1p_vmlinux_new(O) ksplice_ifqrsd1p(O) ksplice_njd9qvp0(O) ksplice_lqsc6o34(O) ksplice_zyrhe5he_vmlinux_new(O) ksplice_zyrhe5he(O) ksplice_0lwo7qjs(O) ksplice_k36ujisx_vmlinux_new(O) ksplice_k36ujisx(O) ksplice_5thylwz8(O) ksplice_2g18u2g7(O) ksplice_ixmvcp18(O) ksplice_y464rjpt_vmlinux_new(O) ksplice_y464rjpt(O) ksplice_hkhli5md(O) ksplice_aanarxy3_vmlinux_new(O) ksplice_aanarxy3(O) ksplice_5jbsymg5_vmlinux_new(O) ksplice_5jbsymg5(O) ksplice_sslvhzno(O) ksplice_p41kj9hn_ext4_new(O) ksplice_p41kj9hn(O) ksplice_ahwbulf2(O) ksplice_u6ayurtd_jbd2_new(O) ksplice_u6ayurtd(O) ksplice_ms100f63_vmlinux_new(O) ksplice_ms100f63(O) ksplice_kyaykxnb(O) ksplice_to0ifrbz(O) ip6t_LOG xt_hl ip6t_rt nf_conntrack_ipv6 nf_defrag_ipv6 ipt_REJECT ipt_LOG xt_limit xt_tcpudp xt_addrtype xt_state ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack_ftp nf_conntrack iptable_filter ip_tables x_tables vsock(O) vmci(O) isofs ksplice_hciwvf0p(O) ksplice_qenkfvj2_vmlinux_new(O) ksplice_qenkfvj2(O) nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc loop snd_pcm snd_page_alloc vmwgfx ttm drm parport_pc parport snd_timer coretemp crc32c_intel snd ghash_clmulni_intel ac shpchp vmw_balloon i2c_piix4 i2c_core soundcore power_supply processor aesni_intel psmouse pcspkr evdev serio_raw aes_x86_64 aes_generic button cryptd thermal_sys container ext4 crc16 jbd2 mbcache sr_mod cdrom sg ata_generic sd_mod crc_t10dif ata_piix floppy libata mptspi scsi_transport_spi mptscsih mptbase scsi_mod vmxnet3 [last unloaded: ksplice_qgqlupz2_mantis_core_new]
  14. [1813775.496396]
  15. [1813775.496398] Pid: 18723, comm: postgres Tainted: G           O 3.2.0-4-amd64 #1 Debian 3.2.41-2+deb7u2 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
  16. [1813775.496402] RIP: 0010:[<ffffffffa003ef1c>]  [<ffffffffa003ef1c>] vmxnet3_xmit_frame+0x76d/0x7ae [vmxnet3]
  17. [1813775.496409] RSP: 0018:ffff880002f03978  EFLAGS: 00000286
  18. [1813775.496411] RAX: 0000000000000000 RBX: ffffffffa03d513c RCX: 00000000000000f0
  19. [1813775.496412] RDX: ffffc90001814618 RSI: 0000000000000206 RDI: 0000000000000206
  20. [1813775.496414] RBP: ffff88020ad8bb70 R08: 0000000000000001 R09: 0000000000000000
  21. [1813775.496415] R10: 000000000000ffff R11: ffff8803e64d26c8 R12: ffffffff8104bf67
  22. [1813775.496417] R13: 0000000000000246 R14: ffffffff81658b80 R15: 00000000e8ed54e9
  23. [1813775.496419] FS:  00007fa09b381720(0000) GS:ffff88043fd80000(0000) knlGS:0000000000000000
  24. [1813775.496420] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
  25. [1813775.496422] CR2: 00007fa09b4f3000 CR3: 00000000031e0000 CR4: 00000000000006e0
  26. [1813775.496439] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
  27. [1813775.496453] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
  28. [1813775.496455] Process postgres (pid: 18723, threadinfo ffff880002f02000, task ffff88006784e870)
  29. [1813775.496456] Stack:
  30. [1813775.496480]  ffff88042b9a6000 ffff88042d4e4ef0 00000020a03d8460 0000000000000002
  31. [1813775.496482]  05a8880200000022 ffff88042b9a6000 ffff88042f34c090 ffff88042b9a6a60
  32. [1813775.496485]  0000000000000206 ffff88042b9a6a68 ffff88042b9a7c30 ffff88042d4e4ed0
  33. [1813775.496487] Call Trace:
  34. [1813775.496529]  [<ffffffff8128fa7f>] ? dev_hard_start_xmit+0x3cd/0x513
  35. [1813775.496533]  [<ffffffff812b981e>] ? __ip_flush_pending_frames.isra.29+0x68/0x68
  36. [1813775.496536]  [<ffffffff812a610b>] ? sch_direct_xmit+0x61/0x135
  37. [1813775.496538]  [<ffffffff8128fe77>] ? dev_queue_xmit+0x2b2/0x45b
  38. [1813775.496540]  [<ffffffff812b133a>] ? ipv4_mtu+0x35/0x6a
  39. [1813775.496544]  [<ffffffff812cb42b>] ? tcp_transmit_skb+0x6d7/0x70a
  40. [1813775.496546]  [<ffffffff81283ab3>] ? __alloc_skb+0x9f/0x133
  41. [1813775.496548]  [<ffffffff812cbed4>] ? tcp_write_xmit+0x6b4/0x7bd
  42. [1813775.496551]  [<ffffffff8134c6ef>] ? _cond_resched+0x7/0x1c
  43. [1813775.496553]  [<ffffffff812cc01e>] ? __tcp_push_pending_frames+0x18/0x44
  44. [1813775.496555]  [<ffffffff812c14f4>] ? tcp_sendmsg+0x644/0x724
  45. [1813775.496559]  [<ffffffff8127dbd1>] ? sock_sendmsg+0xc1/0xde
  46. [1813775.496562]  [<ffffffff810b9f3d>] ? free_pcppages_bulk+0xf9/0x10c
  47. [1813775.496566]  [<ffffffff810fad10>] ? fcheck_files.isra.7+0x13/0x14
  48. [1813775.496568]  [<ffffffff810fb0c4>] ? fget_light+0x2c/0x73
  49. [1813775.496570]  [<ffffffff8127f463>] ? sys_sendto+0xf7/0x137
  50. [1813775.496573]  [<ffffffff81037ed3>] ? set_next_entity+0x32/0x55
  51. [1813775.496575]  [<ffffffff8103981a>] ? finish_task_switch+0x4e/0xb9
  52. [1813775.496577]  [<ffffffff8134c694>] ? __schedule+0x5ac/0x5c3
  53. [1813775.496580]  [<ffffffff810d4f34>] ? do_munmap+0x2da/0x2f3
  54. [1813775.496584]  [<ffffffff813529d2>] ? system_call_fastpath+0x16/0x1b
  55. [1813775.496585] Code: 39 0a 72 50 c7 02 00 00 00 00 8b 93 e0 00 00 00 48 8b 4c 24 28 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 38 1c 00 00 8b 4b 34 89 0a <eb> 27 48 ff 83 a0 00 00 00 48 8b 74 24 40 48 8b 7c 24 38 e8 00
  56. [1813775.496775] Call Trace:
  57. [1813775.496780]  [<ffffffff8128fa7f>] ? dev_hard_start_xmit+0x3cd/0x513
  58. [1813775.496782]  [<ffffffff812b981e>] ? __ip_flush_pending_frames.isra.29+0x68/0x68
  59. [1813775.496784]  [<ffffffff812a610b>] ? sch_direct_xmit+0x61/0x135
  60. [1813775.496786]  [<ffffffff8128fe77>] ? dev_queue_xmit+0x2b2/0x45b
  61. [1813775.496788]  [<ffffffff812b133a>] ? ipv4_mtu+0x35/0x6a
  62. [1813775.496790]  [<ffffffff812cb42b>] ? tcp_transmit_skb+0x6d7/0x70a
  63. [1813775.496792]  [<ffffffff81283ab3>] ? __alloc_skb+0x9f/0x133
  64. [1813775.496794]  [<ffffffff812cbed4>] ? tcp_write_xmit+0x6b4/0x7bd
  65. [1813775.496796]  [<ffffffff8134c6ef>] ? _cond_resched+0x7/0x1c
  66. [1813775.496798]  [<ffffffff812cc01e>] ? __tcp_push_pending_frames+0x18/0x44
  67. [1813775.496800]  [<ffffffff812c14f4>] ? tcp_sendmsg+0x644/0x724
  68. [1813775.496802]  [<ffffffff8127dbd1>] ? sock_sendmsg+0xc1/0xde
  69. [1813775.496804]  [<ffffffff810b9f3d>] ? free_pcppages_bulk+0xf9/0x10c
  70. [1813775.496806]  [<ffffffff810fad10>] ? fcheck_files.isra.7+0x13/0x14
  71. [1813775.496808]  [<ffffffff810fb0c4>] ? fget_light+0x2c/0x73
  72. [1813775.496810]  [<ffffffff8127f463>] ? sys_sendto+0xf7/0x137
  73. [1813775.496812]  [<ffffffff81037ed3>] ? set_next_entity+0x32/0x55
  74. [1813775.496814]  [<ffffffff8103981a>] ? finish_task_switch+0x4e/0xb9
  75. [1813775.496816]  [<ffffffff8134c694>] ? __schedule+0x5ac/0x5c3
  76. [1813775.496818]  [<ffffffff810d4f34>] ? do_munmap+0x2da/0x2f3
  77. [1813775.496820]  [<ffffffff813529d2>] ? system_call_fastpath+0x16/0x1b
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!