[192765.830059] INFO: rcu_sched detected stalls on CPUs/tasks: {} (detected by 0, t=60002 ) [192765.841407] INFO: Stall ended before state dump start [192825.841319] INFO: rcu_sched self-detected stall on CPU[192825.842328] INFO: rcu_sched d) [192825.842345] sending NMI to all CPUs: [192825.842352] NMI backtrace for cpu 0 [192825.842363] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G O 3.16.7-ckt9-voyage #1 [192825.842366] Hardware name: PC Engines APU/APU, BIOS 4.0 09/08/2014 [192825.842372] task: c1433878 ti: c1426000 task.ti: c1426000 [192825.842378] EIP: 0060:[] EFLAGS: 00200006 CPU: 0 [192825.842396] EIP is at arch_trigger_all_cpu_backtrace+0x66/0x95 [192825.842400] EAX: 00000800 EBX: c143e940 ECX: c13b6e5a EDX: 00000800 [192825.842404] ESI: f616f72c EDI: 000013bb EBP: c1427e4c ESP: c1427e44 [192825.842409] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [192825.842413] CR0: 8005003b CR2: b7764750 CR3: 3544f000 CR4: 00000790 [192825.842414] Stack: [192825.842417] c13d0cec c143e940 c1427e74 c1064a26 00000001 00200083 c143e940 00000000 [192825.842430] 00000001 c1433878 00000000 00000000 c1427e88 c103203b f616f8e0 f326674a [192825.842444] 0000af63 c1427e90 c106c2b4 c1427ea8 c106c4a8 c1427f28 f616f8e0 f616f514 [192825.842457] Call Trace: [192825.842462] [] rcu_check_callbacks+0x373/0x41c [192825.842478] [] update_process_times+0x2d/0x50 [192825.842490] [] tick_sched_handle+0x30/0x32 [192825.842503] [] tick_sched_timer+0x31/0x55 [192825.842511] [] __run_hrtimer.isra.24+0x3e/0x94 [192825.842524] [] hrtimer_interrupt+0xeb/0x1d9 [192825.842534] [] local_apic_timer_interrupt+0x41/0x46 [192825.842543] [] smp_apic_timer_interrupt+0x2e/0x3d [192825.842552] [] apic_timer_interrupt+0x2d/0x40 [192825.842564] [] ? acpi_safe_halt+0x17/0x1a [192825.842575] [] acpi_idle_enter_c1+0x4e/0x74 [192825.842583] [] cpuidle_enter_state+0x2c/0x96 [192825.842595] [] cpuidle_enter+0xf/0x12 [192825.842603] [] cpu_startup_entry+0x135/0x1e1 [192825.842616] [] rest_init+0x5d/0x5f [192825.842625] [] start_kernel+0x359/0x360 [192825.842635] [] i386_start_kernel+0x79/0x7d [192825.842644] Code: ba 54 6e 3b c1 74 05 ba ec 0c 3d c1 52 68 5a 6e 3b c1 e8 98 5a 2f 00 d [192825.842742] NMI backtrace for cpu 1 [192825.842751] CPU: 1 PID: 25469 Comm: tc Tainted: G O 3.16.7-ckt9-voyage #1 [192825.842753] Hardware name: PC Engines APU/APU, BIOS 4.0 09/08/2014 [192825.842757] task: f5e20470 ti: f3ea6000 task.ti: f3ea6000 [192825.842762] EIP: 0060:[] EFLAGS: 00000002 CPU: 1 [192825.842773] EIP is at io_serial_in+0xd/0x12 [192825.842777] EAX: c14f5100 EBX: c14f51ec ECX: 00000000 EDX: 000003fd [192825.842780] ESI: 0000270b EDI: 00000020 EBP: f3ea7a44 ESP: f3ea7a44 [192825.842784] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [192825.842787] CR0: 80050033 CR2: 080c6b74 CR3: 35d89000 CR4: 00000790 [192825.842788] Stack: [192825.842790] f3ea7a58 c1221650 c14f51ec 00000031 c12216a6 f3ea7a68 c12216b9 c14e25a1 [192825.842802] c14f51ec f3ea7a80 c121e838 c14e25ce c14f51ec 00000001 c122123b f3ea7aa8 [192825.842812] c12224c6 c12216a6 0000003a c14e2594 00000005 00000046 c144dec4 c1222422 [192825.842823] Call Trace: [192825.842827] [] wait_for_xmitr+0x19/0x6f [192825.842836] [] ? wait_for_xmitr+0x6f/0x6f [192825.842843] [] serial8250_console_putchar+0x13/0x20 [192825.842851] [] uart_console_write+0x2b/0x36 [192825.842857] [] ? io_serial_in+0x12/0x12 [192825.842863] [] serial8250_console_write+0xa4/0xe4 [192825.842870] [] ? wait_for_xmitr+0x6f/0x6f [192825.842876] [] ? serial8250_modem_status+0x9c/0x9c [192825.842883] [] call_console_drivers.constprop.24+0x63/0x6d [192825.842892] [] console_unlock+0x13a/0x371 [192825.842900] [] vprintk_emit+0x348/0x354 [192825.842907] [] printk+0x17/0x19 [192825.842915] [] rcu_check_callbacks+0xfa/0x41c [192825.842924] [] update_process_times+0x2d/0x50 [192825.842931] [] tick_sched_handle+0x30/0x32 [192825.842939] [] tick_sched_timer+0x31/0x55 [192825.842946] [] __run_hrtimer.isra.24+0x3e/0x94 [192825.842954] [] hrtimer_interrupt+0xeb/0x1d9 [192825.842962] [] local_apic_timer_interrupt+0x41/0x46 [192825.842970] [] smp_apic_timer_interrupt+0x2e/0x3d [192825.842977] [] apic_timer_interrupt+0x2d/0x40 [192825.842985] [] ? _raw_spin_lock_bh+0x27/0x2b [192825.842991] [] gnet_stats_start_copy_compat+0x27/0x8d [192825.842999] [] tc_fill_qdisc+0x195/0x225 [192825.843007] [] tc_dump_qdisc_root+0x8f/0xc4 [192825.843014] [] tc_dump_qdisc+0x7f/0xd6 [192825.843020] [] netlink_dump+0xb4/0x201 [192825.843027] [] netlink_recvmsg+0x180/0x28b [192825.843035] [] sock_recvmsg+0x59/0x72 [192825.843042] [] ? _copy_from_user+0x29/0x3f [192825.843049] [] ? verify_iovec+0x4b/0x80 [192825.843055] [] ? sock_sendmsg_nosec+0x6a/0x6a [192825.843060] [] ___sys_recvmsg.part.27+0xd1/0x160 [192825.843067] [] ? sock_sendmsg_nosec+0x6a/0x6a [192825.843073] [] ? cpumask_any_but+0x21/0x30 [192825.843080] [] ? lru_cache_add+0x8/0xa [192825.843088] [] ? page_add_new_anon_rmap+0x77/0xb5 [192825.843096] [] ? handle_mm_fault+0x2ba/0x674 [192825.843103] [] ? _copy_from_user+0x29/0x3f [192825.843109] [] __sys_recvmsg+0x3b/0x59 [192825.843116] [] SyS_socketcall+0x186/0x1b2 [192825.843123] [] ? smp_threshold_interrupt+0x5/0x5 [192825.843130] [] ? vmalloc_sync_all+0x106/0x106 [192825.843138] [] syscall_call+0x7/0x7 [192825.843145] Code: 0f b6 48 35 d3 e2 03 50 08 89 1a 5b 5d c3 55 0f b6 48 35 89 e5 d3 e2 3 [192826.399601] { 1} (t=60561 jiffies g=1443066 c=1443065 q=5051) [192826.405893] sending NMI to all CPUs: [192826.409560] NMI backtrace for cpu 1 [192826.413149] CPU: 1 PID: 25469 Comm: tc Tainted: G O 3.16.7-ckt9-voyage #1 [192826.420981] Hardware name: PC Engines APU/APU, BIOS 4.0 09/08/2014 [192826.427247] task: f5e20470 ti: f3ea6000 task.ti: f3ea6000 [192826.432732] EIP: 0060:[] EFLAGS: 00000006 CPU: 1 [192826.438309] EIP is at arch_trigger_all_cpu_backtrace+0x6c/0x95 [192826.444234] EAX: 00000800 EBX: 00002710 ECX: c13b6e5a EDX: 00000800 [192826.450585] ESI: f617b72c EDI: 000013bb EBP: f3ea7b28 ESP: f3ea7b24 [192826.456940] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [192826.462435] CR0: 80050033 CR2: 080c6b74 CR3: 35d89000 CR4: 00000790 [192826.468794] Stack: [192826.470899] c143e940 f3ea7b64 c1064832 c13bf23b 0000ec91 001604fa 001604f9 000013bb [192826.478933] 00000001 f5e20470 c143e940 00000001 0b7911e7 f5e20470 00000000 00000001 [192826.486966] f3ea7b78 c103203b f617b8e0 f31720a2 0000af63 f3ea7b80 c106c2b4 f3ea7b98 [192826.495003] Call Trace: [192826.497549] [] rcu_check_callbacks+0x17f/0x41c [192826.503041] [] update_process_times+0x2d/0x50 [192826.508450] [] tick_sched_handle+0x30/0x32 [192826.513597] [] tick_sched_timer+0x31/0x55 [192826.518659] [] __run_hrtimer.isra.24+0x3e/0x94 [192826.524152] [] hrtimer_interrupt+0xeb/0x1d9 [192826.529388] [] local_apic_timer_interrupt+0x41/0x46 [192826.535315] [] smp_apic_timer_interrupt+0x2e/0x3d [192826.541070] [] apic_timer_interrupt+0x2d/0x40 [192826.546478] [] ? _raw_spin_lock_bh+0x27/0x2b [192826.551800] [] gnet_stats_start_copy_compat+0x27/0x8d [192826.557902] [] tc_fill_qdisc+0x195/0x225 [192826.562875] [] tc_dump_qdisc_root+0x8f/0xc4 [192826.568109] [] tc_dump_qdisc+0x7f/0xd6 [192826.572912] [] netlink_dump+0xb4/0x201 [192826.577713] [] netlink_recvmsg+0x180/0x28b [192826.582862] [] sock_recvmsg+0x59/0x72 [192826.587576] [] ? _copy_from_user+0x29/0x3f [192826.592721] [] ? verify_iovec+0x4b/0x80 [192826.597610] [] ? sock_sendmsg_nosec+0x6a/0x6a [192826.603020] [] ___sys_recvmsg.part.27+0xd1/0x160 [192826.608686] [] ? sock_sendmsg_nosec+0x6a/0x6a [192826.614096] [] ? cpumask_any_but+0x21/0x30 [192826.619247] [] ? lru_cache_add+0x8/0xa [192826.624046] [] ? page_add_new_anon_rmap+0x77/0xb5 [192826.629800] [] ? handle_mm_fault+0x2ba/0x674 [192826.635121] [] ? _copy_from_user+0x29/0x3f [192826.640270] [] __sys_recvmsg+0x3b/0x59 [192826.645069] [] SyS_socketcall+0x186/0x1b2 [192826.650130] [] ? smp_threshold_interrupt+0x5/0x5 [192826.655801] [] ? vmalloc_sync_all+0x106/0x106 [192826.661208] [] syscall_call+0x7/0x7 [192826.665743] Code: 05 ba ec 0c 3d c1 52 68 5a 6e 3b c1 e8 98 5a 2f 00 8b 0d dc b4 43 c1 8 [192826.686274] NMI backtrace for cpu 0 [192826.689875] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G O 3.16.7-ckt9-voyage #1 [192826.697969] Hardware name: PC Engines APU/APU, BIOS 4.0 09/08/2014 [192826.704246] task: c1433878 ti: c1426000 task.ti: c1426000 [192826.709741] EIP: 0060:[] EFLAGS: 00200246 CPU: 0 [192826.715328] EIP is at acpi_safe_halt+0x17/0x1a [192826.719869] EAX: 00000000 EBX: f5cec464 ECX: 00000001 EDX: 00000001 [192826.726232] ESI: 00000001 EDI: f5cec400 EBP: c1427f64 ESP: c1427f64 [192826.732592] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [192826.738087] CR0: 8005003b CR2: b7764750 CR3: 35007000 CR4: 00000790 [192826.744445] Stack: [192826.746553] c1427f78 c120297f c1449560 f5ef2800 c14495bc c1427f98 c126adc6 00000001 [192826.754587] 14f241e3 0000af64 c1449560 c1427fec 00000001 c1427fa4 c126aee8 f5ef2800 [192826.762618] c1427fcc c1051e54 c1426000 00037191 c1427fec c1427fec c1449560 00037191 [192826.770655] Call Trace: [192826.773214] [] acpi_idle_enter_c1+0x4e/0x74 [192826.778457] [] cpuidle_enter_state+0x2c/0x96 [192826.783783] [] cpuidle_enter+0xf/0x12 [192826.788502] [] cpu_startup_entry+0x135/0x1e1 [192826.793828] [] rest_init+0x5d/0x5f [192826.798284] [] start_kernel+0x359/0x360 [192826.803170] [] i386_start_kernel+0x79/0x7d [192826.808312] Code: f8 43 4f c1 89 e5 b8 0f 00 00 00 e8 4e 1b ff ff 31 c0 5d c3 64 a1 e8 f [192826.829309] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long tos