Summary of Test results:
----------------------
DTT - kdump results
Crash point Type kdump
(IRQ handling with IRQs disabled)
INT_HARDWARE_ENTRY
Panic Works
Bug Works
Exception Works
Loop Hangs
Overflow Works
(Tasklet with IRQs enabled)
INT_TASKLET_ENTRY
Panic Works
Bug Works
Exception Works
Loop Hangs
Overflow Hangs
(Timer processing)
TIMERADD
Panic Boots into second kernel but panics.
Bug works
Exception Doesnt crash the kernel.
Loop works
Overflow works
(Tasklet with IRQs disabled)
TASKLET
Panic Works
Bug Works
Exception Works
Loop Works
overflow Hangs
(Block I/O)
FS_DEVRW
Panic Works
Bug Hangs
Exception Hangs
Loop Hangs
Overflow Works
(Memory Swap-out)
MEM_SWAPOUT
Panic Not able to test as crash point didnt hit
Bug - do -
Exception - do -
Loop - do -
Overflow - do -
(IRQ handling with IRQs enabled)
INT_HW_IRQ_EN
Panic works
Bug works
Exception works
Loop hangs
Overflow reboots.
(SCSI command)
SCSI_DISPATCH_CMD Panic works
Bug works
Exception hangs
Loop hangs
Overflow works
(IDE command)
IDE_CORE_CP Panic No IDE device
Bug No IDE device
Exception No IDE device
Loop No IDE deivce
Overflow No IDE device
Hardware:
--------
llm07:~ # cat /proc/cpuinfo
processor : 0
vendor_id : AuthenticAMD
cpu family : 15
model : 5
model name : AMD Opteron(tm) Processor 248
stepping : 8
cpu MHz : 2193.435
cache size : 1024 KB
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext lm 3dnowext 3dnow
bogomips : 4392.99
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: ts ttp
processor : 1
vendor_id : AuthenticAMD
cpu family : 15
model : 5
model name : AMD Opteron(tm) Processor 248
stepping : 8
cpu MHz : 2193.435
cache size : 1024 KB
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext lm 3dnowext 3dnow
bogomips : 4386.43
TLB size : 1024 4K pages
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: ts ttp
lspci :
----
llm07:~ # lspci
0000:00:06.0 PCI bridge: Advanced Micro Devices [AMD] AMD-8111 PCI (rev 07)
0000:00:07.0 ISA bridge: Advanced Micro Devices [AMD] AMD-8111 LPC (rev 05)
0000:00:07.3 Bridge: Advanced Micro Devices [AMD] AMD-8111 ACPI (rev 05)
0000:00:0a.0 PCI bridge: Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge (rev 12)
0000:00:0a.1 PIC: Advanced Micro Devices [AMD] AMD-8131 PCI-X APIC (rev 01)
0000:00:0b.0 PCI bridge: Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge (rev 12)
0000:00:0b.1 PIC: Advanced Micro Devices [AMD] AMD-8131 PCI-X APIC (rev 01)
0000:00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:19.0 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:19.1 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:19.2 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:00:19.3 Host bridge: Advanced Micro Devices [AMD] K8 NorthBridge
0000:01:00.0 USB Controller: Advanced Micro Devices [AMD] AMD-8111 USB (rev 0b)
0000:01:00.1 USB Controller: Advanced Micro Devices [AMD] AMD-8111 USB (rev 0b)
0000:01:05.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27)
0000:02:01.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 03)
0000:02:01.1 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 03)
0000:02:02.0 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 07)
TESTS :
-----
IRQ handling with IRQs disabled : Panic
-----------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HARDWARE_ENTRY -t panic -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 07:21 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
119 safe_halt();
(gdb) info threads
* 2 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
* 1 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
(gdb) info registers
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0x8 8
r10 0x8 8
r11 0x246 582
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
#1 0x0000000000000000 in ?? ()
#2 0xffffffff802089ea in cpu_idle () at arch/x86_64/kernel/process.c:223
#3 0xffffffff807497b3 in start_kernel () at init/main.c:576
#4 0xffffffff806ad920 in saved_video_mode ()
#5 0xffffffff807492aa in x86_64_start_kernel (real_mode_data=Variable "real_mode_data" is not available.
)
at arch/x86_64/kernel/head64.c:120
#6 0x00000000ffffffff in ?? ()
#7 0x0000000000000405 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x00af9b000000ffff in ?? ()
#12 0x00cf93000000ffff in ?? ()
#13 0x00cffa000000ffff in ?? ()
#14 0x00cff3000000ffff in ?? ()
#15 0x00affb000000ffff in ?? ()
#16 0x00cf9b000000ffff in ?? ()
#17 0x0c008b000000206f in ?? ()
#18 0x00000000ffff8100 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
IRQ handling with IRQs disabled : Bug
--------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HARDWARE_ENTRY -t bug -c 100
llm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 07:34 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info registers
rax 0x0 0
rbx 0xffff81000cccd400 -139637761977344
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a7c88 0xffffffff806a7c88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c4e99 -2140385639
r12 0xffffffff806a7f58 -2140504232
r13 0xb 11
r14 0xffffffff806a4c08 -2140517368
r15 0xffffffff8052dda9 -2142052951
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) info threads
* 2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80502ba1 in die_nmi (str=Variable "str" is not available.
) at arch/x86_64/kernel/traps.c:463
#4 0xffffffff8050303b in nmi_watchdog_tick (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:495
#5 0xffffffff805029f6 in default_do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/traps.c:647
#6 0xffffffff80502f33 in do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:531
#7 0xffffffff805025c3 in nmi () at system.h:182
#8 0xffffffff8052dda9 in __func__.4 ()
#9 0xffffffff806a4c08 in boot_cpu_stack ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0xffffffff8073a400 in pidmap_lock ()
#14 0xffffffff806c44f5 in __log_buf ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000002 in ?? ()
#18 0xffff81000c003400 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0xffff81008b883000 in ?? ()
#21 0xffffffff806a4c08 in boot_cpu_stack ()
#22 0xffffffff8073a428 in irq_desc ()
#23 0xffffffffffffffff in ?? ()
#24 0xffffffff805020bd in .text.lock.spinlock () at sched.h:13
#25 0x0000000000000010 in ?? ()
#26 0x0000000000000086 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0xffffffff806a4ba8 in boot_cpu_stack ()
#28 0x0000000000000018 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000000 in ?? ()
IRQ handling with IRQs disabled : Exception
-------------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HARDWARE_ENTRY -t exception -c 11
llm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 05:43 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
119 safe_halt();
(gdb) info threads
* 2 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
* 1 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
(gdb) info registers
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0x0 0
r10 0x0 0
r11 0xffff81000c0051c0 -139637775380032
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) gt
Undefined command: "gt". Try "help".
(gdb) bt
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
#1 0x0000000000000000 in ?? ()
#2 0xffffffff802089ea in cpu_idle () at arch/x86_64/kernel/process.c:223
#3 0xffffffff807497b3 in start_kernel () at init/main.c:576
#4 0xffffffff806ad920 in saved_video_mode ()
#5 0xffffffff807492aa in x86_64_start_kernel (real_mode_data=Variable "real_mode_data" is not available.
)
at arch/x86_64/kernel/head64.c:120
#6 0x00000000ffffffff in ?? ()
#7 0x0000000000000405 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x00af9b000000ffff in ?? ()
#12 0x00cf93000000ffff in ?? ()
#13 0x00cffa000000ffff in ?? ()
#14 0x00cff3000000ffff in ?? ()
#15 0x00affb000000ffff in ?? ()
#16 0x00cf9b000000ffff in ?? ()
#17 0x0c008b000000206f in ?? ()
#18 0x00000000ffff8100 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
IRQ handling with IRQs disabled : Loop
-------------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HARDWARE_ENTRY -t loop -c 100
llm07 login: NMI Watchdog detected LOCKUP on CPU 0
CPU 0
Modules linked in:
Pid: 0, comm: swapper Not tainted 2.6.16-mm2 #5
RIP: 0010:[<ffffffff80472d74>] <ffffffff80472d74>{cpoint_default_exit+87}
RSP: 0018:ffffffff806a4f58 EFLAGS: 00000096
RAX: 000000000000000d RBX: ffffffff8073a400 RCX: ffffffff805aaaa8
RDX: ffffffff805aaaa8 RSI: 0000000000000046 RDI: ffffffff805aaaa0
RBP: 0000000000000000 R08: ffffffff805aaaa8 R09: 0000000000000000
R10: 0000000000000000 R11: ffffffff806a4e78 R12: 0000000000000000
R13: ffffffff805a5040 R14: ffffffff80747f08 R15: 0000000000000000
FS: 00002aef98187d80(0000) GS:ffffffff80737000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000000502d00 CR3: 00000000b9834000 CR4: 00000000000006e0
Process swapper (pid: 0, threadinfo ffffffff80746000, task ffffffff805a3180)
Stack: 0000000000000000 ffffffff80254140 ffffffff80747f08 ffffffff80747f08
0000000000000000 0000000000000000 0000000000000000 ffffffff8020bc28
ffff8100af611b48 ffffffff8020832f
Call Trace: <IRQ> <ffffffff80254140>{INT_HARDWARE_ENTRY_hook+24}
<ffffffff8020bc28>{do_IRQ+57} <ffffffff8020832f>{default_idle+0}
<ffffffff80209d62>{ret_from_intr+0} <EOI> <ffffffff8020832f>{default_idle+0}
<ffffffff802089ea>{cpu_idle+160} <ffffffff80208364>{default_idle+53}
<ffffffff802089ea>{cpu_idle+160} <ffffffff807497b3>{start_kernel+486}
<ffffffff807492aa>{_sinittext+682}
Code: eb fe 31 ff e8 41 f7 ff ff eb 17 48 c7 c7 3a 63 57 80 eb 07
console shuts up ...
IRQ handling with IRQs disabled : Overflow
------------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HARDWARE_ENTRY -t overflow
U need to give the command two times.. otherwise it wont work.
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509064 Mar 29 07:57 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info regs
Undefined info command: "regs". Try "help info".
(gdb) info registers
rax 0x0 0
rbx 0xffff8100b7afd000 -139634894974976
rcx 0x40000 262144
rdx 0xdad6aa 14341802
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a3e28 0xffffffff806a3e28
r8 0xffffffff 4294967295
r9 0x7 7
r10 0x0 0
r11 0x0 0
r12 0x0 0
r13 0x9 9
r14 0x0 0
r15 0xffffffff805a3180 -2141572736
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) info threads
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80504219 in do_page_fault (regs=Variable "regs" is not available.
) at arch/x86_64/mm/fault.c:560
#4 0xffffffff8020a71d in error_sti () at cpumask.h:183
#5 0x0000000000000000 in ?? ()
#6 0xffff81000c003800 in ?? ()
#7 0x0000000021a8c9e4 in ?? ()
#8 0x0000000080209dce in ?? ()
#9 0xffffffff806a4280 in boot_cpu_stack ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0xffffffff806a42b4 in boot_cpu_stack ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000001 in ?? ()
#17 0xffffffff806a42a8 in boot_cpu_stack ()
#18 0x0000000000000000 in ?? ()
#19 0xffff81000c004c20 in ?? ()
#20 0xffffffffffffffff in ?? ()
#21 0xffffffff80229bd8 in find_busiest_group (sd=Cannot access memory at address 0x80209d9e
) at bitops.h:243
Previous frame inner to this frame (corrupt stack?)
(gdb)
Tasklet with IRQs enabled + Panic :
--------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_TASKLET_ENTRY -t panic -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 00:52 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
2 process 2687 0x00002aebb0525d60 in ?? ()
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest") at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:306
#3 0x0000000000000000 in ?? ()
#4 0xffffffff8023637f in INT_TASKLET_ENTRY_hook () at kernel/softirq.c:270
#5 0xffffffff802365f8 in __do_softirq () at kernel/softirq.c:97
#6 0xffffffff8020ac26 in call_softirq () at cpumask.h:183
#7 0xffffffff806a4fa0 in boot_cpu_stack ()
#8 0xffffffff8020bad3 in do_softirq () at arch/x86_64/kernel/irq.c:149
#9 0xffffffff8020a580 in apic_timer_interrupt () at cpumask.h:183
#10 0xffffffff80747f08 in init_thread_union ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
(gdb) info registers
rax 0x0 0
rbx 0xffff81000cd12c00 -139637761692672
rcx 0xffffffff805aaaa8 -2141541720
rdx 0xffffffff805aaaa8 -2141541720
rsi 0x246 582
rdi 0x0 0
rbp 0x0 0x0
rsp 0xffffffff806a4d98 0xffffffff806a4d98
r8 0xffffffff805aaaa8 -2141541720
r9 0x0 0
r10 0x0 0
r11 0xffffffff806a4d68 -2140517016
r12 0xffffffff80781d10 -2139611888
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
Tasklet with IRQs enabled + bug() :
----------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_TASKLET_ENTRY -t bug -c 100
lm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
119 safe_halt();
(gdb) info threads
* 2 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
* 1 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
(gdb) info registers
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0xffff8100b6b27b48 -139634911577272
r10 0xffff8100b6b27b48 -139634911577272
r11 0xffff81013d6eb800 -139632651094016
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
#1 0x0000000000000000 in ?? ()
#2 0xffffffff802089ea in cpu_idle () at arch/x86_64/kernel/process.c:223
#3 0xffffffff807497b3 in start_kernel () at init/main.c:576
#4 0xffffffff806ad920 in saved_video_mode ()
#5 0xffffffff807492aa in x86_64_start_kernel (real_mode_data=Variable "real_mode_data" is not available.
)
at arch/x86_64/kernel/head64.c:120
#6 0x00000000ffffffff in ?? ()
#7 0x0000000000000405 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x00af9b000000ffff in ?? ()
#12 0x00cf93000000ffff in ?? ()
#13 0x00cffa000000ffff in ?? ()
#14 0x00cff3000000ffff in ?? ()
#15 0x00affb000000ffff in ?? ()
#16 0x00cf9b000000ffff in ?? ()
#17 0x0c008b000000206f in ?? ()
#18 0x00000000ffff8100 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
Tasklet with IRQs enabled + Exception
---------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_TASKLET_ENTRY -t exception -c 100
llm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 05:30 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) info registers
rax 0x0 0
rbx 0xffff81013dc1dc00 -139632645645312
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a4b98 0xffffffff806a4b98
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c4502 -2140388094
r12 0x0 0
r13 0x9 9
r14 0x2 2
r15 0xffffffff805a3180 -2141572736
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80504219 in do_page_fault (regs=Variable "regs" is not available.
) at arch/x86_64/mm/fault.c:560
#4 0xffffffff8020a71d in error_sti () at cpumask.h:183
#5 0x0000000000000000 in ?? ()
#6 0x0000000000000000 in ?? ()
#7 0x0000000000000000 in ?? ()
#8 0xffffffff80781d10 in per_cpu__tasklet_hi_vec ()
#9 0x0000000000000000 in ?? ()
#10 0xffff81000c004e40 in ?? ()
#11 0xffff81000504a800 in ?? ()
#12 0x0000000000000046 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000004 in ?? ()
#16 0xffff810005027e78 in ?? ()
#17 0xffffffff805af640 in FS_DEVRW ()
#18 0x0fdf057bf6577b80 in ?? ()
#19 0xffffffff805af460 in probe_sem ()
#20 0xffffffffffffffff in ?? ()
#21 0xffffffff80472d59 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:311
#22 0x0000000000000010 in ?? ()
#23 0x0000000000010297 in ?? ()
#24 0xffffffff806a4f38 in boot_cpu_stack ()
#25 0x0000000000000018 in ?? ()
#26 0xffffffff80472d23 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:300
---Type <return> to continue, or q <return> to quit---
#27 0xffffffff8023637f in INT_TASKLET_ENTRY_hook () at kernel/softirq.c:270
#28 0xffffffff802365f8 in __do_softirq () at kernel/softirq.c:97
#29 0xffffffff8020ac26 in call_softirq () at cpumask.h:183
#30 0xffffffff806a4fa0 in boot_cpu_stack ()
#31 0xffffffff8020bad3 in do_softirq () at arch/x86_64/kernel/irq.c:149
#32 0xffffffff8020a580 in apic_timer_interrupt () at cpumask.h:183
#33 0xffffffff80747f08 in init_thread_union ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
Tasklet with IRQs enabled + Loop
--------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_TASKLET_ENTRY -t loop -c 50
hangs.
Tasklet with IRQs enabled + overflow :
-----------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_TASKLET_ENTRY -t overflow -c 50
hangs
Block I/O + Panic :
------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p FS_DEVRW -t panic -c 50
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 02:30 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/lib.
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 11215 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest")
at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
)
at drivers/dtt/khdtt.c:306
#3 0xffff8100b4311b08 in ?? ()
#4 0xffffffff8027b984 in FS_DEVRW_hook () at fs/buffer.c:2887
#5 0xffffffff802c85d5 in search_by_key (p_s_sb=0xffff81000cd34000,
p_s_key=0xffff8100b4311d98, p_s_search_path=0xffff8100b4311d18,
n_stop_level=1) at fs/reiserfs/stree.c:671
#6 0xffffffff802b8a0a in reiserfs_update_sd_size (th=0xffff8100b4311df8,
inode=0xffff81000cd39968, size=114837) at fs/reiserfs/inode.c:1342
#7 0xffffffff802c139a in reiserfs_dirty_inode (inode=0xffff81000cd39968)
at reiserfs_fs.h:1906
#8 0xffffffff80297e59 in __mark_inode_dirty (inode=0xffff81000cd39968,
flags=1) at fs/fs-writeback.c:65
#9 0xffffffff8028eaa9 in touch_atime (mnt=0x0, dentry=0x246) at fs.h:1124
#10 0xffffffff802556f5 in generic_file_mmap (file=0x0, vma=0xffff8100b81c9dd0)
at fs.h:1143
#11 0xffffffff802663a2 in do_mmap_pgoff (file=0xffff8100babdc1c0,
addr=47823946788864, len=118784, prot=Variable "prot" is not available.
) at mm/mmap.c:1068
#12 0xffffffff8020ffcb in sys_mmap (addr=0, len=114837, prot=1, flags=2, fd=Variable "fd" is not.)
at arch/x86_64/kernel/sys_x86_64.c:59
---Type <return> to continue, or q <return> to quit---
#13 0xffffffff8020979a in system_call () at cpumask.h:183
#14 0x0000000000000246 in ?? ()
#15 0x0000000000000002 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000003 in ?? ()
#18 0x0000000000000009 in ?? ()
#19 0x00007fffc94fb190 in ?? ()
#20 0x0000000000000001 in ?? ()
#21 0x000000000001c095 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000009 in ?? ()
#24 0x00002b7ee15bc4fc in ?? ()
#25 0x0000000000000033 in ?? ()
#26 0x0000000000010202 in ?? ()
#27 0x00007fffc94faf80 in ?? ()
#28 0x000000000000002b in ?? ()
#29 0x0000000f00044b7f in ?? ()
#30 0x003c634a000001b3 in ?? ()
#31 0x00159eea00208006 in ?? ()
#32 0x000d0004003c0217 in ?? ()
#33 0x00418525000d0001 in ?? ()
#34 0x000d000500108002 in ?? ()
#35 0x0041858f000d0002 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) info registers
rax 0x0 0
rbx 0xffff81000cd34c00 -139637761553408
rcx 0xffffffff805aaaa8 -2141541720
rdx 0xffffffff805aaaa8 -2141541720
rsi 0x246 582
rdi 0x0 0
rbp 0x0 0x0
rsp 0xffff8100b4311978 0xffff8100b4311978
r8 0xffffffff805aaaa8 -2141541720
r9 0x0 0
r10 0x0 0
r11 0xffff8100b4311948 -139634953610936
r12 0x0 0
r13 0x1 1
r14 0xffff8100b4311ba0 -139634953610336
r15 0xffff8100b4311d98 -139634953609832
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x0 0
es 0x0 0
fs 0x0 0
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb)
Block I/O + bug
--------------
llm07:/home/murali/dtt_tools # ./ttutils set -p FS_DEVRW -t bug -c 100
llm07 login: ----------- [cut here ] --------- [please bite here ] ---------
Kernel BUG at drivers/dtt/khdtt.c:310
invalid opcode: 0000 [1] SMP
last sysfs file: /devices/system/cpu/cpu1/crash_notes
CPU 1
Modules linked in:
Pid: 11205, comm: bash Not tainted 2.6.16-mm2 #1
RIP: 0010:[<ffffffff80472d4d>] <ffffffff80472d4d>{cpoint_default_exit+48}
RSP: 0018:ffff810139d4f7d8 EFLAGS: 00010292
RAX: 000000000000000c RBX: ffff81000cca7d68 RCX: ffffffff805aaaa8
RDX: ffffffff805aaaa8 RSI: 0000000000000246 RDI: ffffffff805aaaa0
RBP: 0000000000000000 R08: ffffffff805aaaa8 R09: 0000000000000001
R10: ffff810000000000 R11: ffff810139d4f6f8 R12: 0000000000000000
R13: 0000000000000001 R14: ffff810139d4f860 R15: ffff810139d4fa58
FS: 00002b773b2a60a0(0000) GS:ffff81013e0a3640(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000005bd2c8 CR3: 000000013ac6a000 CR4: 00000000000006e0
Process bash (pid: 11205, threadinfo ffff810139d4e000, task ffff81013dc9e7a0)
Stack: 0000000000000034 ffffffff8027b984 ffff810139d4fa28 000000000000001f
000000000000001f 0000000000000010 00000000000004c0 ffffffff802c85d5
000000203a56abe8 ffff810139d4fa28
Call Trace: <ffffffff8027b984>{FS_DEVRW_hook+24} <ffffffff802c85d5>{search_by_key+319}
<ffffffff8047294d>{cpoint_countdown+61} <ffffffff80472d23>{cpoint_default_exit+6}
<ffffffff8027b984>{FS_DEVRW_hook+24} <ffffffff802c863e>{search_by_key+424}
<ffffffff802c863e>{search_by_key+424} <ffffffff802b8a0a>{reiserfs_update_sd_size+127}
<ffffffff802c139a>{reiserfs_dirty_inode+86} <ffffffff80297e59>{__mark_inode_dirty+40}
<ffffffff8028eaa9>{touch_atime+173} <ffffffff8028687a>{__link_path_walk+2663}
<ffffffff80286cee>{link_path_walk+78} <ffffffff8027948a>{vfs_read+281}
<ffffffff802872f9>{do_path_lookup+607} <ffffffff80287463>{__path_lookup_intent_open+78}
<ffffffff80282ef0>{open_exec+40} <ffffffff8027948a>{vfs_read+281}
<ffffffff802a44d5>{load_elf_binary+791} <ffffffff80281c53>{search_binary_handler+148}
<ffffffff8028310c>{do_execve+370} <ffffffff8020979a>{system_call+126}
<ffffffff802083bf>{sys_execve+48} <ffffffff80209bbe>{stub_execve+106}
Code: 0f 0b 68 1b 63 57 80 c2 36 01 eb 3d c7 04 25 00 00 00 00 00
RIP <ffffffff80472d4d>{cpoint_default_exit+48} RSP <ffff810139d4f7d8>
<4>time.c: Lost 155 timer tick(s)! rip 10:INT_HW_IRQ_EN_hook+0x7/0x5e
last clier oops_begin+0x1b/0x6e caller die+0x17/0x42
BUG: warning at kernel/exit.c:848/do_exit()
time.c: Lost 2 timer tick(s)! rip 10:__do_softirq+0x45/0xd3
last clier _spin_lock_irqsave+0x15/0x27 caller release_console_sem+0x17/0x1c3
Call Trace: <ffffffff802346dc>{do_exit+82} <ffffffff80501ef9>{_spin_unlock_irqrestore+8}
<ffffffff8020b237>{kernel_math_error+0} <ffffffff80502d69>{do_trap+242}
<ffffffff8020b87e>{do_invalid_op+145} <ffffffff80472d4d>{cpoint_default_exit+48}
<ffffffff8027ab93>{__find_get_block+423} <ffffffff80231cdd>{printk+141}
<ffffffff8020a71d>{error_exit+0} <ffffffff80472d4d>{cpoint_default_exit+48}
<ffffffff80472d4d>{cpoint_default_exit+48} <ffffffff8027b984>{FS_DEVRW_hook+24}
<ffffffff802c85d5>{search_by_key+319} <ffffffff8047294d>{cpoint_countdown+61}
<ffffffff80472d23>{cpoint_default_exit+6} <ffffffff8027b984>{FS_DEVRW_hook+24}
<ffffffff802c863e>{search_by_key+424} <ffffffff802c863e>{search_by_key+424}
<ffffffff802b8a0a>{reiserfs_update_sd_size+127} <ffffffff802c139a>{reiserfs_dirty_inode+8} <ffffffff80297e59>{__mark_inode_dirty+40} <ffffffff8028eaa9>{touch_atime+173}
<ffffffff8028687a>{__link_path_walk+2663} <ffffffff80286cee>{link_path_walk+78}
<ffffffff8027948a>{vfs_read+281} <ffffffff802872f9>{do_path_lookup+607}
<ffffffff80287463>{__path_lookup_intent_open+78} <ffffffff80282ef0>{open_exec+40}
<ffffffff8027948a>{vfs_read+281} <ffffffff802a44d5>{load_elf_binary+791}
<ffffffff80281c53>{search_binary_handler+148} <ffffffff8028310c>{do_execve+370}
<ffffffff8020979a>{system_call+126} <ffffffff802083bf>{sys_execve+48}
<ffffffff80209bbe>{stub_execve+106}
hangs.
Block I/O + Exception :
----------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p FS_DEVRW -t exception -c 50
llm07 login: Unable to handle kernel NULL pointer dereference at 0000000000000000 RIP:
<ffffffff80472d59>{cpoint_default_exit+60}
PGD ba52e067 PUD bad05067 PMD 0
Oops: 0002 [1] SMP
last sysfs file: /devices/system/cpu/cpu1/crash_notes
CPU 1
Modules linked in:
Pid: 2646, comm: syslogd Not tainted 2.6.16-mm2 #1
RIP: 0010:[<ffffffff80472d59>] <ffffffff80472d59>{cpoint_default_exit+60}
RSP: 0018:ffff8100ba58d698 EFLAGS: 00010297
RAX: 0000000000000004 RBX: ffff81000cdcbd08 RCX: ffff81013e02edf8
RDX: ffffffff805af600 RSI: 0000000000000000 RDI: ffffffff805af460
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
R10: 00000000000080ad R11: 0000000000000046 R12: 0000000000000000
R13: 0000000000000001 R14: ffff8100ba58d720 R15: ffff8100ba58d918
FS: 00002ac7977066e0(0000) GS:ffff81013e0a3640(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 00000000bb386000 CR4: 00000000000006e0
Process syslogd (pid: 2646, threadinfo ffff8100ba58c000, task ffff8100bb7ab760)
Stack: 0000000000000034 ffffffff8027b984 ffff8100ba58d8c8 00000000ffffffff
0000000000000000 0000000000000010 000000000000052f ffffffff802c85d5
000000000000006c ffff8100ba58d8c8
Call Trace: <ffffffff8027b984>{FS_DEVRW_hook+24} <ffffffff802c85d5>{search_by_key+319}
<ffffffff802c9a08>{reiserfs_paste_into_item+258} <ffffffff80243be1>{bit_waitqueue+53}
<ffffffff80280e8b>{inode_get_bytes+16} <ffffffff802b8a0a>{reiserfs_update_sd_size+127}
<ffffffff8050202b>{_read_lock_irq+14} <ffffffff80255b54>{find_lock_page+36}
<ffffffff802c139a>{reiserfs_dirty_inode+86} <ffffffff80297e59>{__mark_inode_dirty+40}
<ffffffff802bbdd4>{reiserfs_submit_file_region_for_write+320}
<ffffffff80243c0f>{bit_waitqueue+99} <ffffffff802bd6b9>{reiserfs_file_write+6220}
<ffffffff802c863e>{search_by_key+424} <ffffffff8028a4cf>{__pollwait+0}
<ffffffff80502097>{_spin_lock_irqsave+21} <ffffffff80483981>{skb_dequeue+72}
<ffffffff804861b4>{skb_recv_datagram+147} <ffffffff80243be1>{bit_waitqueue+53}
<ffffffff802ccd21>{get_cnode+24} <ffffffff802ccec1>{journal_mark_dirty+333}
<ffffffff802c8435>{pathrelse+38} <ffffffff80243c9a>{autoremove_wake_function+0}
<ffffffff802c13b3>{reiserfs_dirty_inode+111} <ffffffff80297f17>{__mark_inode_dirty+230}
<ffffffff8028e9f5>{file_update_time+185} <ffffffff80284332>{pipe_writev+927}
<ffffffff80278ea8>{do_readv_writev+404} <ffffffff802bbe6d>{reiserfs_file_write+0}
<ffffffff80279019>{sys_writev+69} <ffffffff8020979a>{system_call+126}
Code: c7 04 25 00 00 00 00 00 00 00 00 eb 30 48 c7 c7 2f 63 57 80
RIP <ffffffff80472d59>{cpoint_default_exit+60} RSP <ffff8100ba58d698>
CR2: 0000000000000000
BUG: warning at kernel/exit.c:848/do_exit()
time.c: Lost 2 timer tick(s)! rip 10:__do_softirq+0x45/0xd3
last clier _spin_lock_irqsave+0x15/0x27 caller release_console_sem+0x17/0x1c3
Call Trace: <ffffffff802346dc>{do_exit+82} <ffffffff80501ef9>{_spin_unlock_irqrestore+8}
<ffffffff80504219>{do_page_fault+1852} <ffffffff8027b96c>{FS_DEVRW_hook+0}
<ffffffff802be6e9>{get_parents+429} <ffffffff8020a71d>{error_exit+0}
<ffffffff80472d59>{cpoint_default_exit+60} <ffffffff80472d23>{cpoint_default_exit+6}
<ffffffff8027b984>{FS_DEVRW_hook+24} <ffffffff802c85d5>{search_by_key+319}
<ffffffff802c9a08>{reiserfs_paste_into_item+258} <ffffffff80243be1>{bit_waitqueue+53}
<ffffffff80280e8b>{inode_get_bytes+16} <ffffffff802b8a0a>{reiserfs_update_sd_size+127}
<ffffffff8050202b>{_read_lock_irq+14} <ffffffff80255b54>{find_lock_page+36}
<ffffffff802c139a>{reiserfs_dirty_inode+86} <ffffffff80297e59>{__mark_inode_dirty+40}
<ffffffff802bbdd4>{reiserfs_submit_file_region_for_write+320}
<ffffffff80243c0f>{bit_waitqueue+99} <ffffffff802bd6b9>{reiserfs_file_write+6220}
<ffffffff802c863e>{search_by_key+424} <ffffffff8028a4cf>{__pollwait+0}
<ffffffff80502097>{_spin_lock_irqsave+21} <ffffffff80483981>{skb_dequeue+72}
<ffffffff804861b4>{skb_recv_datagram+147} <ffffffff80243be1>{bit_waitqueue+53}
<ffffffff802ccd21>{get_cnode+24} <ffffffff802ccec1>{journal_mark_dirty+333}
<ffffffff802c8435>{pathrelse+38} <ffffffff80243c9a>{autoremove_wake_function+0}
<ffffffff802c13b3>{reiserfs_dirty_inode+111} <ffffffff80297f17>{__mark_inode_dirty+230}
<ffffffff8028e9f5>{file_update_time+185} <ffffffff80284332>{pipe_writev+927}
<ffffffff80278ea8>{do_readv_writev+404} <ffffffff802bbe6d>{reiserfs_file_write+0}
<ffffffff80279019>{sys_writev+69} <ffffffff8020979a>{system_call+126}
hangs.
Block I/O + loop :
-----------------
hangs.
Block I/O + overflow :
---------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p FS_DEVRW -t overflow -c 20
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 1 process 10282 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80502ba1 in die_nmi (str=Variable "str" is not available.
) at arch/x86_64/kernel/traps.c:463
#4 0xffffffff8050303b in nmi_watchdog_tick (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:495
#5 0xffffffff805029f6 in default_do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/traps.c:647
#6 0xffffffff80502f33 in do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:531
#7 0xffffffff805025c3 in nmi () at system.h:182
#8 0xffff810139113db8 in ?? ()
#9 0x0000000000000001 in ?? ()
#10 0xffff8100b786a150 in ?? ()
#11 0xffffffff80780800 in per_cpu__kstat ()
#12 0xffff810139113c88 in ?? ()
#13 0xffffffff80780800 in per_cpu__kstat ()
#14 0xffff8100053c81e0 in ?? ()
#15 0x0000000000000282 in ?? ()
#16 0x0000000000000046 in ?? ()
#17 0xffff8100053c81e0 in ?? ()
#18 0xffff8100c0023800 in ?? ()
#19 0x0000000000000010 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000001 in ?? ()
#22 0xffff8100c0023800 in ?? ()
#23 0xffffffffffffffff in ?? ()
#24 0xffffffff805020bd in .text.lock.spinlock () at sched.h:13
#25 0x0000000000000010 in ?? ()
#26 0x0000000000000082 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0xffff810139113c00 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000000 in ?? ()
#54 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) info registers
rax 0x0 0
rbx 0xffff81013e2bac00 -139632638710784
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffff81013cd20090 0xffff81013cd20090
rsp 0xffffffff806a7c88 0xffffffff806a7c88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c50d8 -2140385064
r12 0xffffffff806a7f58 -2140504232
r13 0xb 11
r14 0x1 1
r15 0xffff810139113db8 -139632724329032
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x0 0
ds 0x0 0
es 0x0 0
fs 0x0 0
gs 0x0 0
Tasklet with IRQs disabled + panic :
-----------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TASKLET -t panic -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 05:04 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1
vmlinux-16M vmlinux-1M
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info regs
Undefined info command: "regs". Try "help info".
(gdb) info registers
rax 0x0 0
rbx 0xffff81013ddfec00 -139632643675136
rcx 0xffffffff805aaaa8 -2141541720
rdx 0xffffffff805aaaa8 -2141541720
rsi 0x46 70
rdi 0x0 0
rbp 0xffffffff8073a150 0xffffffff8073a150
rsp 0xffffffff806a4d98 0xffffffff806a4d98
r8 0xffffffff805aaaa8 -2141541720
r9 0x0 0
r10 0x46 70
r11 0xffffffff806a4d68 -2140517016
r12 0xa 10
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x46 70
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest") at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:306
#3 0x0000000000000000 in ?? ()
#4 0xffffffff80236306 in TASKLET_hook () at kernel/softirq.c:256
#5 0xffffffff802365f8 in __do_softirq () at kernel/softirq.c:97
#6 0xffffffff8020ac26 in call_softirq () at cpumask.h:183
#7 0xffffffff806a4fa0 in boot_cpu_stack ()
#8 0xffffffff8020bad3 in do_softirq () at arch/x86_64/kernel/irq.c:149
#9 0xffffffff8020a580 in apic_timer_interrupt () at cpumask.h:183
#10 0xffffffff80747f08 in init_thread_union ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
Tasklet with IRQs disabled + bug :
-------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TASKLET -t bug -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 29 05:18 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1
vmlinux-16M vmlinux-1M
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
81 io.h: No such file or directory.
in io.h
(gdb) info registers
rax 0xffffff60 4294967136
rbx 0xffffffff80719380 -2140040320
rcx 0x0 0
rdx 0x3fd 1021
rsi 0x5 5
rdi 0xffffffff80719380 -2140040320
rbp 0xffffffff80719458 0xffffffff80719458
rsp 0xffffffff806a4ee0 0xffffffff806a4ee0
r8 0xffffffff80746000 -2139856896
r9 0xffff8100b4487b48 -139634952078520
r10 0xffff8100b4487b48 -139634952078520
r11 0x0 0
r12 0xffffffff807184c0 -2140044096
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80392ae9 0xffffffff80392ae9 <serial_in+85>
eflags 0x202 514
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) info threads
* 2 process 0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
* 1 process 0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
(gdb) btr
Undefined command: "btr". Try "help".
(gdb) bt
#0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
#1 0xffffffff80394c73 in serial8250_interrupt (irq=4, dev_id=0xffffffff807184c0,
regs=0xffffffff80747f08) at drivers/serial/8250.c:1278
#2 0xffffffff80254070 in INT_HW_IRQ_EN_hook () at kernel/irq/handle.c:91
#3 0xffffffff80254155 in INT_HARDWARE_ENTRY_hook () at kernel/irq/handle.c:177
#4 0xffffffff8020bc28 in do_IRQ (regs=0xffffffff80747f08) at arch/x86_64/kernel/irq.c:100
#5 0xffffffff80209d62 in common_interrupt () at cpumask.h:183
#6 0xffffffff80747f08 in init_thread_union ()
#7 0x0000000000000000 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
Tasklet with IRQs disabled + exception :
--------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TASKLET -t exception -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 30 21:14 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) info registers
rax 0x0 0
rbx 0xffff81013e060c00 -139632641176576
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a4b98 0xffffffff806a4b98
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c4cfb -2140386053
r12 0x0 0
r13 0x9 9
r14 0x2 2
r15 0xffffffff805a3180 -2141572736
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80504219 in do_page_fault (regs=Variable "regs" is not available.
) at arch/x86_64/mm/fault.c:560
#4 0xffffffff8020a71d in error_sti () at cpumask.h:183
#5 0x0000000000000000 in ?? ()
#6 0x0000000000000000 in ?? ()
#7 0x0000000000000000 in ?? ()
#8 0x000000000000000a in ?? ()
#9 0xffffffff8073a150 in softirq_vec ()
#10 0x0000000000000001 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000046 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000004 in ?? ()
#16 0xffff81013e02ee78 in ?? ()
#17 0xffffffff805af580 in TIMERADD ()
#18 0x0fdf8786c2ffb260 in ?? ()
#19 0xffffffff805af460 in probe_sem ()
#20 0xffffffffffffffff in ?? ()
#21 0xffffffff80472d59 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:311
#22 0x0000000000000010 in ?? ()
#23 0x0000000000010097 in ?? ()
#24 0xffffffff806a4f38 in boot_cpu_stack ()
#25 0x0000000000000018 in ?? ()
#26 0xffffffff80472d23 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:300
---Type <return> to continue, or q <return> to quit---
#27 0xffffffff80236306 in TASKLET_hook () at kernel/softirq.c:256
#28 0xffffffff802365f8 in __do_softirq () at kernel/softirq.c:97
#29 0xffffffff8020ac26 in call_softirq () at cpumask.h:183
#30 0xffffffff806a4fa0 in boot_cpu_stack ()
#31 0xffffffff8020bad3 in do_softirq () at arch/x86_64/kernel/irq.c:149
#32 0xffffffff8020a580 in apic_timer_interrupt () at cpumask.h:183
#33 0xffffffff80747f08 in init_thread_union ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000000 in ?? ()
#54 0x0000000000000000 in ?? ()
Tasklet with IRQs disabled + loop :
----------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TASKLET -t loop -c 100
llm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 30 22:40 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
119 safe_halt();
(gdb) info threads
* 2 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
* 1 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
(gdb) bt
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
#1 0x0000000000000000 in ?? ()
#2 0xffffffff802089ea in cpu_idle () at arch/x86_64/kernel/process.c:223
#3 0xffffffff807497b3 in start_kernel () at init/main.c:576
#4 0xffffffff806ad920 in saved_video_mode ()
#5 0xffffffff807492aa in x86_64_start_kernel (real_mode_data=Variable "real_mode_data" is not available.
)
at arch/x86_64/kernel/head64.c:120
#6 0x00000000ffffffff in ?? ()
#7 0x0000000000000405 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x00af9b000000ffff in ?? ()
#12 0x00cf93000000ffff in ?? ()
#13 0x00cffa000000ffff in ?? ()
#14 0x00cff3000000ffff in ?? ()
#15 0x00affb000000ffff in ?? ()
#16 0x00cf9b000000ffff in ?? ()
#17 0x0c008b000000206f in ?? ()
#18 0x00000000ffff8100 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000000 in ?? ()
#54 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) info registers
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0xffff8100ba49bb48 -139634851333304
r10 0xffff8100ba49bb48 -139634851333304
r11 0xffff8100ba49bb48 -139634851333304
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb)
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0xffff8100ba49bb48 -139634851333304
r10 0xffff8100ba49bb48 -139634851333304
r11 0xffff8100ba49bb48 -139634851333304
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
Tasklet with IRQs enabled + overflow
------------------------------------
hangs.
Timer processing + panic :
-------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t panic -c 100
llm07:/home/murali/dtt_tools # ./ttutils ls
llm07:~ # Kernel panic - not syncing: dumptest
Bootdata ok (command line is root=/dev/sda1 vga=0x314 selinux=0 console=tty0 console=ttyS0,3840)Linux version 2.6.16-mm2 (root@llm07) (gcc version 3.3.3 (SuSE Linux)) #6 Wed Mar 29 04:59:08 PS6BIOS-provided physical RAM map:
BIOS-e820: 0000000000000100 - 000000000009ac00 (usable)
BIOS-e820: 000000000009ac00 - 00000000000a0000 (reserved)
BIOS-e820: 0000000000100000 - 00000000fbf70000 (usable)
BIOS-e820: 00000000fbf70000 - 00000000fbf7b000 (ACPI data)
BIOS-e820: 00000000fbf7b000 - 00000000fbf80000 (ACPI NVS)
BIOS-e820: 00000000fbf80000 - 00000000fc000000 (reserved)
BIOS-e820: 00000000fec00000 - 00000000fec00400 (reserved)
BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
user-defined physical RAM map:
user: 0000000000000000 - 00000000000a0000 (usable)
user: 0000000001000000 - 0000000001544000 (usable)
user: 00000000015e4400 - 0000000005000000 (usable)
user: 00000000fbf70000 - 00000000fbf7b000 (ACPI data)
DMI present.
ACPI: PM-Timer IO Port: 0x8008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:5 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:5 APIC version 16
WARNING: NR_CPUS limit of 1 reached. Processor ignored.
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x03] address[0xfc000000] gsi_base[24])
IOAPIC[1]: apic_id 3, version 17, address 0xfc000000, GSI 24-27
ACPI: IOAPIC (id[0x04] address[0xfc001000] gsi_base[28])
IOAPIC[2]: apic_id 4, version 17, address 0xfc001000, GSI 28-31
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
Setting APIC routing to flat
ACPI: HPET id: 0x102282a0 base: 0xfed00000
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at 10000000 (gap: 5000000:f6f70000)
Checking aperture...
CPU 0: aperture @ 8000000 size 64 MB
CPU 1: aperture @ 8000000 size 64 MB
Built 1 zonelists
Kernel command line: root=/dev/sda1 vga=0x314 selinux=0 console=tty0 console=ttyS0,38400 init 3 KInitializing CPU#0
PID hash table entries: 256 (order: 8, 2048 bytes)
time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer.
time.c: Detected 2193.434 MHz processor.
Console: colour dummy device 80x25
time.c: Lost 177 timer tick(s)! rip 10:start_kernel+0x102/0x1e1
last clier 0x0 caller 0x0
time.c: Lost 5 timer tick(s)! rip 10:__do_softirq+0x39/0xa4
last clier 0x0 caller 0x0
unexpected IRQ trap at vector 29
Dentry cache hash table entries: 8192 (order: 4, 65536 bytes)
time.c: Lost 3 timer tick(s)! rip 10:release_console_sem+0x13c/0x1af
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f
Inode-cache hash table entries: 4096 (order: 3, 32768 bytes)
Memory: 58848k/81920k available (2940k kernel code, 6620k reserved, 1597k data, 196k init)
Calibrating delay using timer specific routine.. 4392.85 BogoMIPS (lpj=8785714)
Mount-cache hash table entries: 256
8 compiled-in crash points registered
Crash dump test tools' module successfully loaded
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU: AMD Opteron(tm) Processor 248 stepping 08
Using local APIC timer interrupts.
result 12462714
Detected 12.462 MHz APIC timer.
NMI Watchdog detected LOCKUP on CPU 0
CPU 0
Modules linked in:
Pid: 1, comm: swapper Not tainted 2.6.16-mm2 #6
RIP: 0010:[<ffffffff81014297>] <ffffffff81014297>{setup_APIC_timer+53}
RSP: 0000:ffff810001747e88 EFLAGS: 00000012
RAX: 00000000054aec4e RBX: 00000000000c2bad RCX: 0000000000000000
RDX: 0000000001046d5a RSI: 00000000000000fa RDI: ffffffff81511903
RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000000
R10: 0000000000000000 R11: ffffffff814892d9 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffffffff814fb000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00002ab4d4e28000 CR3: 0000000001001000 CR4: 00000000000006e0
Process swapper (pid: 1, threadinfo ffff810001746000, task ffff810001745530)
Stack: 0000000000000000 0000000000000012 000000000be2a7a0 ffffffff81511903
000030ae00000000 0000000000000000 0000000000000000 ffffffff81511ccd
0000000000000001 0000000000000000
Call Trace: <ffffffff81511903>{setup_boot_APIC_clock+289}
<ffffffff81511ccd>{APIC_init_uniprocessor+215} <ffffffff81007078>{init+61}
<ffffffff8100a09e>{child_rip+8} <ffffffff8113821e>{acpi_ds_init_one_object+0}
<ffffffff8100703b>{init+0} <ffffffff8100a096>{child_rip+0}
Code: 39 d0 73 f5 8b 04 25 f0 e0 5f ff 39 d0 72 f5 eb 3f 31 c0 e6
console shuts up ...
<4>time.c: Lost 1360 timer tick(s)! rip 10:__down_read+0x85/0x8c
last clier setup_boot_APIC_clock+0x41/0x128 caller APIC_init_uniprocessor+0xd7/0xe4
Kernel panic - not syncing: Aiee, killing interrupt handler!
time.c: Lost 3 timer tick(s)! rip 10:release_console_sem+0x13c/0x1af
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f
BUG: warning at kernel/panic.c:138/panic()
Call Trace: <NMI> <ffffffff810271f4>{panic+528} <ffffffff812d9be3>{__down_read+133}
<ffffffff812d9b71>{__down_read+19} <ffffffff810331b1>{blocking_notifier_call_chain+53}
<ffffffff81029e0a>{do_exit+151} <ffffffff81168227>{do_unblank_screen+24}
<ffffffff812da8fe>{__die+0} <ffffffff812dad38>{nmi_watchdog_tick+168}
<ffffffff812da750>{default_do_nmi+122} <ffffffff812dac7b>{do_nmi+61}
<ffffffff812da35f>{nmi+127} <ffffffff81511903>{setup_boot_APIC_clock+289}
<ffffffff81014297>{setup_APIC_timer+53} <EOE> <ffffffff81511903>{setup_boot_APIC_clock+28} <ffffffff81511ccd>{APIC_init_uniprocessor+215} <ffffffff81007078>{init+61}
<ffffffff8100a09e>{child_rip+8} <ffffffff8113821e>{acpi_ds_init_one_object+0}
<ffffffff8100703b>{init+0} <ffffffff8100a096>{child_rip+0}
time.c: Lost 3 timer tick(s)! rip 10:__delay+0x8/0x10
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f
Timer processing + bug:
-----------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t bug -c 100
llm07:/proc # ls -l vmcore
/bin/ls: vmcore: No such file or directory
llm07:/proc # Read from remote host llm07: Connection reset by peer
Connection to llm07 closed.
[murali@mchintag ~]$ ssh root@llm07
Password:
Last login: Fri Mar 31 01:41:54 2006 from 9.124.31.95
cllm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 31 01:56 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
81 io.h: No such file or directory.
in io.h
(gdb) info threads
2 process 1 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
(gdb) info registers
rax 0xffffff60 4294967136
rbx 0xffffffff80719380 -2140040320
rcx 0x0 0
rdx 0x3fd 1021
rsi 0x5 5
rdi 0xffffffff80719380 -2140040320
rbp 0xffffffff80719458 0xffffffff80719458
rsp 0xffffffff806a4ee0 0xffffffff806a4ee0
r8 0xffffffff80746000 -2139856896
r9 0x0 0
r10 0x0 0
r11 0x0 0
r12 0xffffffff807184c0 -2140044096
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80392ae9 0xffffffff80392ae9 <serial_in+85>
eflags 0x202 514
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80392ae9 in serial_in (up=0xffffffff80719380, offset=5) at io.h:81
#1 0xffffffff80394c73 in serial8250_interrupt (irq=4, dev_id=0xffffffff807184c0,
regs=0xffffffff80747f08) at drivers/serial/8250.c:1278
#2 0xffffffff80254070 in INT_HW_IRQ_EN_hook () at kernel/irq/handle.c:91
#3 0xffffffff80254155 in INT_HARDWARE_ENTRY_hook () at kernel/irq/handle.c:177
#4 0xffffffff8020bc28 in do_IRQ (regs=0xffffffff80747f08) at arch/x86_64/kernel/irq.c:100
#5 0xffffffff80209d62 in common_interrupt () at cpumask.h:183
#6 0xffffffff80747f08 in init_thread_union ()
#7 0x0000000000000000 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000000 in ?? ()
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
Timer processing + exception :
------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t bug -c 100
llm07 login: Unable to handle kernel NULL pointer dereference at 0000000000000000 RIP:
<ffffffff80472d59>{cpoint_default_exit+60}
PGD bca26067 PUD bca25067 PMD 0
Oops: 0002 [1] SMP
last sysfs file: /devices/system/cpu/cpu1/crash_notes
CPU 1
Modules linked in:
Pid: 1471, comm: irqbalance Not tainted 2.6.16-mm2 #5
RIP: 0010:[<ffffffff80472d59>] <ffffffff80472d59>{cpoint_default_exit+60}
RSP: 0018:ffff8100bb921e48 EFLAGS: 00010297
RAX: 0000000000000004 RBX: ffff8100c0024ec0 RCX: ffff810005027d78
RDX: ffffffff805af540 RSI: 00007fff1c99d300 RDI: ffffffff805af460
RBP: ffff8100c0024ec0 R08: ffff8100bb921ee8 R09: ffff8100bb921ee8
R10: 0000000000000008 R11: 00000000442d0114 R12: ffff8100bb921ee8
R13: ffff8100c0024ec0 R14: 000000c17aa65dec R15: 0000000000000000
FS: 00002b808e4426e0(0000) GS:ffff81013e0a3640(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 00000000bca4d000 CR4: 00000000000006e0
Process irqbalance (pid: 1471, threadinfo ffff8100bb920000, task ffff8100bd3ac820)
Stack: 00007fff1c99d300 ffffffff802461b6 ffff81013fd0cd20 0000000000000001
0000000000000286 ffff8100bb921ee8 0000000000000001 ffff8100bb921ee8
00007fff1c99d530 00007fff1c99d430
Call Trace: <ffffffff802461b6>{TIMERADD_hook+24} <ffffffff80500dbe>{do_nanosleep+54}
<ffffffff80246213>{hrtimer_nanosleep+74} <ffffffff80245e5e>{hrtimer_wakeup+0}
<ffffffff80246324>{sys_nanosleep+85} <ffffffff8020979a>{system_call+126}
Code: c7 04 25 00 00 00 00 00 00 00 00 eb 30 48 c7 c7 2f 63 57 80
RIP <ffffffff80472d59>{cpoint_default_exit+60} RSP <ffff8100bb921e48>
CR2: 0000000000000000
<4>time.c: Lost 109 timer tick(s)! rip 10:INT_HW_IRQ_EN_hook+0x7/0x5e
last clier oops_begin+0x1b/0x6e caller do_page_fault+0x653/0x7aa
but doesnt crash !!
Timer processing + loop:
--------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t loop -c 100
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Mar 31 02:43 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
2 process 2661 acquire_console_sem () at kernel/printk.c:714
* 1 process 10287 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80502ba1 in die_nmi (str=Variable "str" is not available.
) at arch/x86_64/kernel/traps.c:463
#4 0xffffffff8050303b in nmi_watchdog_tick (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:495
#5 0xffffffff805029f6 in default_do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/traps.c:647
#6 0xffffffff80502f33 in do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:531
#7 0xffffffff805025c3 in nmi () at system.h:182
#8 0x0000000000000000 in ?? ()
#9 0x0000023fec32f43c in ?? ()
#10 0xffff81000c004ec0 in ?? ()
#11 0xffff8100ba61cdb0 in ?? ()
#12 0xffff81000c004ec0 in ?? ()
#13 0xffff81000c004ec0 in ?? ()
#14 0xffff8100b01b5d98 in ?? ()
#15 0x00007fff6085c110 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0xffffffff805aaaa8 in log_wait ()
#18 0x000000000000000d in ?? ()
#19 0xffffffff805aaaa8 in log_wait ()
#20 0xffffffff805aaaa8 in log_wait ()
#21 0x0000000000000046 in ?? ()
#22 0xffffffff805aaaa0 in console_printk ()
#23 0xffffffffffffffff in ?? ()
#24 0xffffffff80472d74 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:316
#25 0x0000000000000010 in ?? ()
#26 0x0000000000000092 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0xffff8100b01b5e78 in ?? ()
#28 0x0000000000000018 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000000 in ?? ()
#54 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) info registers
rax 0x0 0
rbx 0xffff8100bbf8f800 -139634823071744
rcx 0x40000 262144
rdx 0x6965 26981
rsi 0x246 582
rdi 0x0 0
rbp 0xffff8100b176e190 0xffff8100b176e190
rsp 0xffffffff806a7c88 0xffffffff806a7c88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c4ea1 -2140385631
r12 0xffffffff806a7f58 -2140504232
r13 0xb 11
r14 0x23fec32f43c 2473568957500
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x0 0
es 0x0 0
fs 0x0 0
gs 0x0 0
Timer processing + overflow:
------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t overflow -c 100
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 1 process 11125 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) info registers
rax 0x0 0
rbx 0xffff81013e088000 -139632641015808
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffff8100bbb06760 0xffff8100bbb06760
rsp 0xffffffff806a7c88 0xffffffff806a7c88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c5ab3 -2140382541
r12 0xffffffff806a7f58 -2140504232
r13 0xb 11
r14 0x1 1
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x0 0
es 0x0 0
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80502ba1 in die_nmi (str=Variable "str" is not available.
) at arch/x86_64/kernel/traps.c:463
#4 0xffffffff8050303b in nmi_watchdog_tick (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:495
#5 0xffffffff805029f6 in default_do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/traps.c:647
#6 0xffffffff80502f33 in do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:531
#7 0xffffffff805025c3 in nmi () at system.h:182
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000001 in ?? ()
#10 0xffff81013866b8a0 in ?? ()
#11 0xffffffff80780800 in per_cpu__kstat ()
#12 0xffff8100b7d01c78 in ?? ()
#13 0xffffffff80780800 in per_cpu__kstat ()
#14 0x0000000000000246 in ?? ()
#15 0x0000000000000008 in ?? ()
#16 0x0000000000000008 in ?? ()
#17 0xffff81013dfbbe80 in ?? ()
#18 0xffff8100c0023800 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000001 in ?? ()
#22 0xffff8100c0023800 in ?? ()
#23 0xffffffffffffffff in ?? ()
#24 0xffffffff805020bd in .text.lock.spinlock () at sched.h:13
#25 0x0000000000000010 in ?? ()
#26 0x0000000000000082 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0xffff8100b7d01bf0 in ?? ()
#28 0x0000000000000018 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
SCSI command + panic :
----------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p SCSI_DISPATCH_CMD -t panic -c 100
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0x0000000000401a6d in ?? ()
(gdb) info threads
2 process 180 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 2699 0x0000000000401a6d in ?? ()
(gdb) bt
#0 0x0000000000401a6d in ?? ()
Cannot access memory at address 0x7fffc616ec70
(gdb) thread 2
[Switching to thread 2 (process 180)]#0 0xffffffff80251297 in crash_kexec (regs=0x0)
at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest") at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:306
#3 0x0000000000000000 in ?? ()
#4 0xffffffff803efc69 in SCSI_DISPATCH_CMD_hook () at drivers/scsi/scsi.c:642
#5 0xffff81000cde9000 in ?? ()
#6 0xffff810135699d80 in ?? ()
#7 0xffffffff803f3dfc in scsi_request_fn (q=0xffff81013e3da760) at drivers/scsi/scsi_lib.c:1632
#8 0xffffffff80335bd9 in __generic_unplug_device (q=0xffff81000cde1308)
at block/ll_rw_blk.c:1596
#9 0xffffffff80335f5b in generic_unplug_device (q=0xffff81000cde1308) at block/ll_rw_blk.c:1615
#10 0xffffffff80332bf3 in blk_backing_dev_unplug (bdi=Variable "bdi" is not available.
) at block/ll_rw_blk.c:1632
#11 0xffffffff8027b4b5 in sync_buffer (word=0x0) at blkdev.h:638
#12 0xffffffff80500af3 in __wait_on_bit (wq=Variable "wq" is not available.
) at kernel/wait.c:162
#13 0xffffffff80500ba5 in out_of_line_wait_on_bit (word=Variable "word" is not available.
) at kernel/wait.c:175
#14 0xffffffff802cc876 in flush_commit_list (s=0xffff8100bd4d6000, jl=0xffff81013e2247c0,
flushall=1) at buffer_head.h:295
#15 0xffffffff802d05aa in do_journal_end (th=0xffff81013e1c5dc8, p_s_sb=0xffff8100bd4d6000,
nblocks=Variable "nblocks" is not available.
) at fs/reiserfs/journal.c:4220
#16 0xffffffff802c1319 in reiserfs_sync_fs (s=0xffff8100bd4d6000, wait=Variable "wait" is not available.
)
at fs/reiserfs/super.c:71
#17 0xffffffff8027e8e7 in sync_supers () at fs/super.c:335
#18 0xffffffff8025b357 in wb_kupdate (arg=Variable "arg" is not available.
) at mm/page-writeback.c:413
#19 0xffffffff8025b9f1 in pdflush (dummy=Variable "dummy" is not available.
) at mm/pdflush.c:126
#20 0xffffffff80243b78 in kthread (_create=Variable "_create" is not available.
) at kernel/kthread.c:96
#21 0xffffffff8020a8d6 in child_rip () at cpumask.h:183
#22 0xffffffff80243a39 in kthread_create (threadfn=Variable "threadfn" is not available.
) at kernel/kthread.c:156
#23 0xffff81013e071da8 in ?? ()
---Type <return> to continue, or q <return> to quit---
#24 0x0000000000000216 in ?? ()
#25 0xffff81013dddd1c0 in ?? ()
#26 0xffff81013e071d50 in ?? ()
#27 0xffff81013e071da8 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000297 in ?? ()
#30 0x0000000000000297 in ?? ()
#31 0xffff81000cc46000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000001 in ?? ()
#34 0x0000000000000611 in ?? ()
#35 0xffff81013e071da8 in ?? ()
#36 0xffffffff80243aaf in kthread_should_stop () at kernel/kthread.c:51
#37 0x0000000000000000 in ?? ()
#38 0xffffffff8020a8ce in kernel_thread () at cpumask.h:183
#39 0x0000000000000010 in ?? ()
#40 0x0000000000000200 in ?? ()
#41 0xffff81013e1c5f58 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0xffff8100bd59c860 in ?? ()
#44 0xffffffff805aa8e0 in update_sched_domains_nb.6 ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0xffffffffffffffff in ?? ()
#48 0xffffffff8023ab8d in recalc_sigpending_tsk (t=0x0) at kernel/signal.c:224
#49 0x0000000000000000 in ?? ()
#50 0x0000000000000000 in ?? ()
#51 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#52 0x0000000000000000 in ?? ()
#53 0x0000000000000060 in ?? ()
#54 0x0000000000000000 in ?? ()
#55 0x0000000000000000 in ?? ()
#56 0x0000000000000000 in ?? ()
#57 0x0000000000000020 in ?? ()
#58 0x0000000000000000 in ?? ()
#59 0x0000000000000010 in ?? ()
#60 0x0000000000000000 in ?? ()
#61 0x0000000000000060 in ?? ()
#62 0x0000000000000000 in ?? ()
#63 0x0000000000000000 in ?? ()
#64 0x0000000000000000 in ?? ()
#65 0x0000000000000020 in ?? ()
#66 0x0000000000000010 in ?? ()
#67 0x0000000000000020 in ?? ()
#68 0x0000000000000000 in ?? ()
#69 0x0000000000000070 in ?? ()
#70 0x0000000000000010 in ?? ()
#71 0x0000000000000000 in ?? ()
#72 0x0000000000000000 in ?? ()
#73 0x0000000000000030 in ?? ()
#74 0x0000000000000020 in ?? ()
#75 0x0000000000000020 in ?? ()
#76 0x0000000000000000 in ?? ()
#77 0x0000000000000060 in ?? ()
#78 0x0000000000000000 in ?? ()
SCSI command + bug :
---------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p SCSI_DISPATCH_CMD -t bug -c 100
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff805001a2 in cond_resched () at kernel/sched.c:4336
4336 {
(gdb) info threads
2 process 11295 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 2743 0xffffffff805001a2 in cond_resched () at kernel/sched.c:4336
(gdb) info registers
rax 0x53ca 21450
rbx 0x0 0
rcx 0x53c9 21449
rdx 0x3c 60
rsi 0x202 514
rdi 0xffffffff80231f0b -2145181941
rbp 0x20000 0x20000
rsp 0xffff81013bd1be58 0xffff81013bd1be58
r8 0x1 1
r9 0x0 0
r10 0x286 646
r11 0x0 0
r12 0x0 0
r13 0x506e20 5271072
r14 0x0 0
r15 0x0 0
rip 0xffffffff805001a2 0xffffffff805001a2 <cond_resched+1>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x0 0
es 0x0 0
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff805001a2 in cond_resched () at kernel/sched.c:4336
#1 0xffffffff80231f59 in do_syslog (type=Variable "type" is not available.
) at kernel/printk.c:221
#2 0xffffffff802ab68b in kmsg_read (file=Variable "file" is not available.
) at fs/proc/kmsg.c:38
#3 0xffffffff8027941c in vfs_read (file=0xffff8100bbb078c0,
buf=0x506e20 <Address 0x506e20 out of bounds>, count=Variable "count" is not available.
) at fs/read_write.c:264
#4 0xfffffffffffffff7 in ?? ()
#5 0xffffffff80279578 in sys_read (fd=Variable "fd" is not available.
) at fs/read_write.c:351
#6 0xffffffff8020979a in system_call () at cpumask.h:183
#7 0x0000000000000246 in ?? ()
#8 0x0000000000000001 in ?? ()
#9 0x00002af6e7175560 in ?? ()
#10 0x0000000000020000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x00000000000003c4 in ?? ()
#13 0x0000000000020000 in ?? ()
#14 0x0000000000506e20 in ?? ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x00002af6e72231e2 in ?? ()
#18 0x0000000000000033 in ?? ()
#19 0x0000000000010216 in ?? ()
#20 0x00007fffc3a495d8 in ?? ()
#21 0x000000000000002b in ?? ()
#22 0x7f0a102302000014 in ?? ()
#23 0x0018007c18000a66 in ?? ()
#24 0x0307100a20230200 in ?? ()
#25 0x02000015cf7d1800 in ?? ()
#26 0x180005fab40a2023 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) thread 2
[Switching to thread 2 (process 11295)]#0 0xffffffff80251297 in crash_kexec (regs=0x0)
at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest") at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:306
#3 0x0000000000000000 in ?? ()
#4 0xffffffff803efc69 in SCSI_DISPATCH_CMD_hook () at drivers/scsi/scsi.c:642
#5 0xffff8100bd534800 in ?? ()
#6 0xffff81013e1a15c0 in ?? ()
#7 0xffffffff803f3dfc in scsi_request_fn (q=0xffff81013dd76760) at drivers/scsi/scsi_lib.c:1632
#8 0xffffffff80335bd9 in __generic_unplug_device (q=0xffff8100bd414000)
at block/ll_rw_blk.c:1596
#9 0xffffffff80335f5b in generic_unplug_device (q=0xffff8100bd414000) at block/ll_rw_blk.c:1615
#10 0xffffffff80332bf3 in blk_backing_dev_unplug (bdi=Variable "bdi" is not available.
) at block/ll_rw_blk.c:1632
#11 0xffffffff80279da5 in block_sync_page (page=0xffffffff805aaaa8) at blkdev.h:638
#12 0xffff81013fd313e0 in ?? ()
#13 0xffffffff80255ab1 in sync_page (word=0x0) at mm/filemap.c:170
#14 0xffff81013fd313e0 in ?? ()
#15 0xffffffff805009fa in __wait_on_bit_lock (wq=Variable "wq" is not available.
) at kernel/wait.c:188
#16 0xffffffff80255a6b in __lock_page (page=Variable "page" is not available.
) at mm/filemap.c:545
#17 0xffffffff80256623 in do_generic_mapping_read (mapping=0xffff8100b3aa23b0,
_ra=0xffff810139746c28, filp=0xffff810139746bc0, ppos=0xffff81013539ff50,
desc=0xffff81013539fdb8, actor=0xffffffff802557b1 <file_read_actor>) at pagemap.h:175
#18 0xffffffff80257cb0 in __generic_file_aio_read (iocb=Variable "iocb" is not available.
) at fs.h:1639
#19 0xffffffff80257e3b in generic_file_read (filp=Variable "filp" is not available.
) at mm/filemap.c:1122
#20 0xffffffff8027941c in vfs_read (file=0xffff810139746bc0,
buf=0x2b648ae27000 <Address 0x2b648ae27000 out of bounds>, count=Variable "count" is not available.
) at fs/read_write.c:264
#21 0xfffffffffffffff7 in ?? ()
#22 0xffffffff80279578 in sys_read (fd=Variable "fd" is not available.
) at fs/read_write.c:351
#23 0xffffffff8020979a in system_call () at cpumask.h:183
---Type <return> to continue, or q <return> to quit---
#24 0x0000000000000246 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x00002b648b1496e0 in ?? ()
#27 0x00002b648b1496e0 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000020000 in ?? ()
#31 0x00002b648ae27000 in ?? ()
#32 0x0000000000000003 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x00002b648afd41e2 in ?? ()
#35 0x0000000000000033 in ?? ()
SCSI command + exception :
--------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p SCSI_DISPATCH_CMD -t exception -c 100
llm07 login: Unable to handle kernel NULL pointer dereference at 0000000000000000 RIP:
<ffffffff80472d59>{cpoint_default_exit+60}
PGD 13ce08067 PUD 13ce09067 PMD 0
Oops: 0002 [1] SMP
last sysfs file: /devices/system/cpu/cpu1/crash_notes
CPU 1
Modules linked in:
Pid: 947, comm: reiserfs/1 Not tainted 2.6.16-mm2 #5
RIP: 0010:[<ffffffff80472d59>] <ffffffff80472d59>{cpoint_default_exit+60}
RSP: 0018:ffff81013d771a88 EFLAGS: 00010297
RAX: 0000000000000004 RBX: ffff8100ba89ea80 RCX: ffff810005027cf8
RDX: ffffffff805af500 RSI: 0000000000001000 RDI: ffffffff805af460
RBP: ffff8100bd430800 R08: ffff8100b6a5d6c0 R09: ffff8100b6a5d6c0
R10: ffff81000cd62000 R11: ffff81000cd62000 R12: ffff8100bd40a000
R13: ffff8100bd430800 R14: 0000000000000000 R15: 0000000000680047
FS: 00002ae0d6a436e0(0000) GS:ffff81013e0a3640(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 000000013cdd5000 CR4: 00000000000006e0
Process reiserfs/1 (pid: 947, threadinfo ffff81013d770000, task ffff8100052ab820)
Stack: 0000000000000000 ffffffff803efc69 ffff8100b6a5d6c0 ffff8100b6a5d6c0
ffff8100b6a5d6c0 ffff81000cd62000 ffff8100bd40a000 ffff8100bd430800
ffff8100ba89ea80 ffffffff803f3dfc
Call Trace: <ffffffff803efc69>{SCSI_DISPATCH_CMD_hook+24}
<ffffffff803f3dfc>{scsi_request_fn+607} <ffffffff80335bd9>{__generic_unplug_device+29}
<ffffffff80336382>{__make_request+924} <ffffffff80334720>{generic_make_request+499}
<ffffffff80334822>{submit_bio+194} <ffffffff8027a41c>{submit_bh+249}
<ffffffff8027c5ef>{__block_write_full_page+467} <ffffffff802558fc>{find_get_pages_tag+117} <ffffffff8027f1fd>{blkdev_get_block+0} <ffffffff80298820>{mpage_writepages+449}
<ffffffff8027f3bb>{blkdev_writepage+0} <ffffffff802cf8c6>{flush_async_commits+0}
<ffffffff8025b28e>{do_writepages+32} <ffffffff80256af2>{__filemap_fdatawrite_range+98}
<ffffffff802cf938>{flush_async_commits+114} <ffffffff802404a3>{run_workqueue+154}
<ffffffff80240551>{worker_thread+0} <ffffffff80243a39>{keventd_create_kthread+0}
<ffffffff80240659>{worker_thread+264} <ffffffff8022ab90>{default_wake_function+0}
<ffffffff80243a39>{keventd_create_kthread+0} <ffffffff8022ab90>{default_wake_function+0}
<ffffffff80243a39>{keventd_create_kthread+0} <ffffffff80243b78>{kthread+201}
<ffffffff8020a8d6>{child_rip+8} <ffffffff80243a39>{keventd_create_kthread+0}
<ffffffff80240551>{worker_thread+0} <ffffffff80240551>{worker_thread+0}
<ffffffff80243aaf>{kthread+0} <ffffffff8020a8ce>{child_rip+0}
Code: c7 04 25 00 00 00 00 00 00 00 00 eb 30 48 c7 c7 2f 63 57 80
RIP <ffffffff80472d59>{cpoint_default_exit+60} RSP <ffff81013d771a88>
CR2: 0000000000000000
<4>time.c: Lost 182 timer tick(s)! rip 10:INT_HW_IRQ_EN_hook+0x7/0x5e
last clier oops_begin+0x1b/0x6e caller do_page_fault+0x653/0x7aa
time.c: Lost 2 timer tick(s)! rip 10:__do_softirq+0x45/0xd3
last clier default_idle+0x20/0x60 caller cpu_idle+0xa0/0xc3
SCSI command + loop:
--------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p SCSI_DISPATCH_CMD -t loop -c 100
hangs.
SCSI command + overflow :
--------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p SCSI_DISPATCH_CMD -t overflow -c 100
illm07:~ # cd /proc/
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509052 Apr 2 23:48 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) info registers
rax 0x0 0
rbx 0xffff81013e307800 -139632638396416
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a7c88 0xffffffff806a7c88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c59be -2140382786
r12 0xffffffff806a7f58 -2140504232
r13 0xb 11
r14 0x1 1
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80502ba1 in die_nmi (str=Variable "str" is not available.
) at arch/x86_64/kernel/traps.c:463
#4 0xffffffff8050303b in nmi_watchdog_tick (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:495
#5 0xffffffff805029f6 in default_do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/traps.c:647
#6 0xffffffff80502f33 in do_nmi (regs=Variable "regs" is not available.
) at arch/x86_64/kernel/nmi.c:531
#7 0xffffffff805025c3 in nmi () at system.h:182
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000001 in ?? ()
#10 0xffff8100b9aad0d0 in ?? ()
#11 0xffffffff80780800 in per_cpu__kstat ()
#12 0xffffffff806a4cd8 in boot_cpu_stack ()
#13 0xffffffff80780800 in per_cpu__kstat ()
#14 0xffffffff806a4c58 in boot_cpu_stack ()
#15 0xffff8100baa07630 in ?? ()
#16 0x0000000000000001 in ?? ()
#17 0xffff8100b554dc98 in ?? ()
#18 0xffff8100c0023800 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000001 in ?? ()
#22 0xffff8100c0023800 in ?? ()
#23 0xffffffffffffffff in ?? ()
#24 0xffffffff805020bd in .text.lock.spinlock () at sched.h:13
#25 0x0000000000000010 in ?? ()
#26 0x0000000000000082 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0xffffffff806a4c50 in boot_cpu_stack ()
#28 0x0000000000000018 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
IRQ handling with IRQs enabled : panic
--------------------------------------
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Apr 3 02:39 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info threads
* 2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest") at kernel/panic.c:89
#2 0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:306
#3 0x00000000000000a9 in ?? ()
#4 0xffffffff80254064 in INT_HW_IRQ_EN_hook () at kernel/irq/handle.c:87
#5 0xffffffff80254155 in INT_HARDWARE_ENTRY_hook () at kernel/irq/handle.c:177
#6 0xffffffff8020bc28 in do_IRQ (regs=0xffffffff80747f08) at arch/x86_64/kernel/irq.c:100
#7 0xffffffff80209d62 in common_interrupt () at cpumask.h:183
#8 0xffffffff80747f08 in init_thread_union ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x0000000000000000 in ?? ()
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000000 in ?? ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000000 in ?? ()
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
(gdb) info registers
rax 0x0 0
rbx 0xffff81013d40a800 -139632654112768
rcx 0xffffffff805aaaa8 -2141541720
rdx 0xffffffff805aaaa8 -2141541720
rsi 0x246 582
rdi 0x0 0
rbp 0x0 0x0
rsp 0xffffffff806a4d88 0xffffffff806a4d88
r8 0xffffffff805aaaa8 -2141541720
r9 0x0 0
r10 0x0 0
r11 0xffffffff806a4d58 -2140517032
r12 0x0 0
r13 0xa9 169
r14 0xffffffff80747f08 -2139848952
r15 0x0 0
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
IRQ handling with IRQs enabled : bug
------------------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p INT_HW_IRQ_EN -t bug -c 100
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
119 safe_halt();
(gdb) info threads
* 2 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
* 1 process 0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
(gdb) info registes
Undefined info command: "registes". Try "help info".
(gdb) info registers
rax 0x0 0
rbx 0xffffffff8020832f -2145352913
rcx 0x0 0
rdx 0xffffffff80737000 -2139918336
rsi 0x1 1
rdi 0xffffffff802089ea -2145351190
rbp 0x8e000 0x8e000
rsp 0xffffffff80747fb0 0xffffffff80747fb0
r8 0xffffffff80746000 -2139856896
r9 0x1 1
r10 0x1 1
r11 0x0 0
r12 0x0 0
r13 0x0 0
r14 0x0 0
r15 0x0 0
rip 0xffffffff80208364 0xffffffff80208364 <default_idle+53>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) bt
#0 0xffffffff80208364 in default_idle () at arch/x86_64/kernel/process.c:119
#1 0x0000000000000000 in ?? ()
#2 0xffffffff802089ea in cpu_idle () at arch/x86_64/kernel/process.c:223
#3 0xffffffff807497b3 in start_kernel () at init/main.c:576
#4 0xffffffff806ad920 in saved_video_mode ()
#5 0xffffffff807492aa in x86_64_start_kernel (real_mode_data=Variable "real_mode_data" is not available.
)
at arch/x86_64/kernel/head64.c:120
#6 0x00000000ffffffff in ?? ()
#7 0x0000000000000405 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0x0000000000000000 in ?? ()
#11 0x00af9b000000ffff in ?? ()
#12 0x00cf93000000ffff in ?? ()
#13 0x00cffa000000ffff in ?? ()
#14 0x00cff3000000ffff in ?? ()
#15 0x00affb000000ffff in ?? ()
#16 0x00cf9b000000ffff in ?? ()
#17 0x0c008b000000206f in ?? ()
#18 0x00000000ffff8100 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---q
Quit
IRQ handling with IRQs enabled : exception
-------------------------------------------
llm07:/proc # ls -l vmcore
-r-------- 1 root root 5233509408 Apr 3 03:51 vmcore
llm07:/proc # gdb /home/murali/linux-2.6.16/vmlinux-1M vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64 kexec.h: No such file or directory.
in kexec.h
(gdb) info registers
rax 0x0 0
rbx 0xffff81000ccb9c00 -139637762057216
rcx 0x0 0
rdx 0x246 582
rsi 0x246 582
rdi 0x0 0
rbp 0xffffffff805a3180 0xffffffff805a3180
rsp 0xffffffff806a4b88 0xffffffff806a4b88
r8 0x2 2
r9 0x0 0
r10 0x0 0
r11 0xffffffff806c5344 -2140384444
r12 0x0 0
r13 0x9 9
r14 0x2 2
r15 0xffffffff805a3180 -2141572736
rip 0xffffffff80251297 0xffffffff80251297 <crash_kexec+185>
eflags 0x246 582
cs 0x10 16
ss 0x18 24
ds 0x18 24
es 0x18 24
fs 0x0 0
gs 0x0 0
(gdb) info threads
* 2 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0 0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1 0xffffffff80231162 in panic (fmt=0xffffffff80533f8e "Aiee, killing interrupt handler!")
at kernel/panic.c:89
#2 0xffffffff80234721 in do_exit (code=Variable "code" is not available.
) at kernel/exit.c:855
#3 0xffffffff80504219 in do_page_fault (regs=Variable "regs" is not available.
) at arch/x86_64/mm/fault.c:560
#4 0xffffffff8020a71d in error_sti () at cpumask.h:183
#5 0x0000000000000000 in ?? ()
#6 0xffffffff80747f08 in init_thread_union ()
#7 0x00000000000000a9 in ?? ()
#8 0x0000000000000000 in ?? ()
#9 0x0000000000000000 in ?? ()
#10 0xffff81013ddda580 in ?? ()
#11 0xffff8100bd4f4000 in ?? ()
#12 0xffff8100ba5a7b48 in ?? ()
#13 0xffff8100ba5a7b48 in ?? ()
#14 0xffff8100ba5a7b48 in ?? ()
#15 0x0000000000000004 in ?? ()
#16 0xffff81013e02eef8 in ?? ()
#17 0xffffffff805af480 in hook_lock ()
#18 0xffffffff80746000 in ?? () at swab.h:134
#19 0xffffffff805af460 in probe_sem ()
#20 0xffffffffffffffff in ?? ()
#21 0xffffffff80472d59 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:311
#22 0x0000000000000010 in ?? ()
#23 0x0000000000010297 in ?? ()
#24 0xffffffff806a4f28 in boot_cpu_stack ()
#25 0x0000000000000018 in ?? ()
#26 0xffffffff80472d23 in cpoint_default_exit (hook=Variable "hook" is not available.
) at drivers/dtt/khdtt.c:300
---Type <return> to continue, or q <return> to quit---
#27 0xffffffff80254064 in INT_HW_IRQ_EN_hook () at kernel/irq/handle.c:87
#28 0xffffffff80254155 in INT_HARDWARE_ENTRY_hook () at kernel/irq/handle.c:177
#29 0xffffffff8020bc28 in do_IRQ (regs=0xffffffff80747f08) at arch/x86_64/kernel/irq.c:100
#30 0xffffffff80209d62 in common_interrupt () at cpumask.h:183
#31 0xffffffff80747f08 in init_thread_union ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000000 in ?? ()
#45 0x0000000000000000 in ?? ()
#46 0x0000000000000000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0x0000000000000000 in ?? ()
#49 0x0000000000000000 in ?? ()
IRQ handling with IRQs enabled : loop
--------------------------------------
hangs.
IRQ handling with IRQs enabled : overflow
-----------------------------------------
reboots.