[root@llm11 proc]# crash /home/murali/linux-2.6.17.2/System.map /home/murali/linux-2.6.17.2/vmlinux vmcore crash 4.0-2.24 Copyright (C) 2002, 2003, 2004, 2005, 2006 Red Hat, Inc. Copyright (C) 2004, 2005, 2006 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005 Fujitsu Limited Copyright (C) 2005 NEC Corporation Copyright (C) 1999, 2002 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. GNU gdb 6.1 Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i686-pc-linux-gnu"... please wait... (gathering module symbol data) WARNING: cannot access vmalloc'd module memory SYSTEM MAP: /home/murali/linux-2.6.17.2/System.map DEBUG KERNEL: /home/murali/linux-2.6.17.2/vmlinux (2.6.17.2) DUMPFILE: vmcore CPUS: 8 DATE: Mon Jul 3 15:45:02 2006 UPTIME: 00:06:55 LOAD AVERAGE: 0.01, 0.10, 0.07 TASKS: 164 NODENAME: llm11.in.ibm.com RELEASE: 2.6.17.2 VERSION: #7 SMP PREEMPT Mon Jul 3 15:34:28 IST 2006 MACHINE: i686 (2488 Mhz) MEMORY: 4.6 GB PANIC: "" PID: 0 COMMAND: "swapper" TASK: c7945070 (1 of 8) [THREAD_INFO: f7f64000] CPU: 5 STATE: TASK_RUNNING (PANIC) crash> bt PID: 0 TASK: c7945070 CPU: 5 COMMAND: "swapper" #0 [f7f65ec4] crash_kexec at c01408fd #1 [f7f65f18] panic at c01202cc #2 [f7f65f30] cpoint_default_exit at c03bb4dd #3 [f7f65f38] INT_HARDWARE_ENTRY_hook at c0145d1a #4 [f7f65f64] do_IRQ at c0105a2e #5 [f7f65f70] common_interrupt at c0103ad9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: f7f64000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: f7f64000 CS: 0060 EIP: c0100d9e ERR: ffffff00 EFLAGS: 00000246 #6 [f7f65fa4] default_idle at c0100d9e #7 [f7f65fa8] cpu_idle at c0100e40 crash> bt -a PID: 0 TASK: c04fd4e0 CPU: 0 COMMAND: "swapper" #0 [c058ff2c] crash_nmi_callback at c0113e9c #1 [c058ff84] do_nmi at c010533d #2 [c058ff94] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: c058e000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: c058e000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [c058ffc8] default_idle at c0100d9e #4 [c058ffcc] cpu_idle at c0100e40 PID: 0 TASK: c7940530 CPU: 1 COMMAND: "swapper" #0 [c7961f08] crash_nmi_callback at c0113e9c #1 [c7961f60] do_nmi at c010533d #2 [c7961f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: c7960000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: c7960000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [c7961fa4] default_idle at c0100d9e #4 [c7961fa8] cpu_idle at c0100e40 PID: 0 TASK: c7940030 CPU: 2 COMMAND: "swapper" #0 [f7f03f08] crash_nmi_callback at c0113e9c #1 [f7f03f60] do_nmi at c010533d #2 [f7f03f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: f7f02000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: f7f02000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [f7f03fa4] default_idle at c0100d9e #4 [f7f03fa8] cpu_idle at c0100e40 PID: 0 TASK: c7945a70 CPU: 3 COMMAND: "swapper" #0 [f7f23f08] crash_nmi_callback at c0113e9c #1 [f7f23f60] do_nmi at c010533d #2 [f7f23f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: f7f22000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: f7f22000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [f7f23fa4] default_idle at c0100d9e #4 [f7f23fa8] cpu_idle at c0100e40 PID: 0 TASK: c7945570 CPU: 4 COMMAND: "swapper" #0 [f7f45f08] crash_nmi_callback at c0113e9c #1 [f7f45f60] do_nmi at c010533d #2 [f7f45f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: f7f44000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: f7f44000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [f7f45fa4] default_idle at c0100d9e #4 [f7f45fa8] cpu_idle at c0100e40 PID: 0 TASK: c7945070 CPU: 5 COMMAND: "swapper" #0 [f7f65ec4] crash_kexec at c01408fd #1 [f7f65f18] panic at c01202cc #2 [f7f65f30] cpoint_default_exit at c03bb4dd #3 [f7f65f38] INT_HARDWARE_ENTRY_hook at c0145d1a #4 [f7f65f64] do_IRQ at c0105a2e #5 [f7f65f70] common_interrupt at c0103ad9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: f7f64000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: f7f64000 CS: 0060 EIP: c0100d9e ERR: ffffff00 EFLAGS: 00000246 #6 [f7f65fa4] default_idle at c0100d9e #7 [f7f65fa8] cpu_idle at c0100e40 PID: 0 TASK: c7947ab0 CPU: 6 COMMAND: "swapper" #0 [c7987f08] crash_nmi_callback at c0113e9c #1 [c7987f60] do_nmi at c010533d #2 [c7987f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: c7986000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: c7986000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [c7987fa4] default_idle at c0100d9e #4 [c7987fa8] cpu_idle at c0100e40 PID: 0 TASK: c79475b0 CPU: 7 COMMAND: "swapper" #0 [c79a7f08] crash_nmi_callback at c0113e9c #1 [c79a7f60] do_nmi at c010533d #2 [c79a7f70] nmi at c0103cd9 EAX: 00000000 EBX: c0100d70 ECX: 00000001 EDX: c79a6000 EBP: c05ce2c0 DS: 007b ESI: c05ce2a0 ES: 007b EDI: c79a6000 CS: 0060 EIP: c0100d9e ERR: 00000000 EFLAGS: 00000246 #3 [c79a7fa4] default_idle at c0100d9e #4 [c79a7fa8] cpu_idle at c0100e40 crash> crash> crash> crash> files PID: 0 TASK: c7945070 CPU: 5 COMMAND: "swapper" ROOT: / CWD: / No open files crash> help * files mod runq union alias foreach mount search vm ascii fuser net set vtop bt gdb p sig waitq btop help ps struct whatis dev irq pte swap wr dis kmem ptob sym q eval list ptov sys exit log rd task extend mach repeat timer crash version: 4.0-2.24 gdb version: 6.1 For help on any command above, enter "help <command>". For help on input options, enter "help input". For help on output options, enter "help output". crash> runq RUNQUEUES[0]: c7817580 ACTIVE PRIO_ARRAY: c7817a3c EXPIRED PRIO_ARRAY: c78175c4 RUNQUEUES[1]: c781f580 ACTIVE PRIO_ARRAY: c781f5c4 EXPIRED PRIO_ARRAY: c781fa3c RUNQUEUES[2]: c7827580 ACTIVE PRIO_ARRAY: c78275c4 EXPIRED PRIO_ARRAY: c7827a3c RUNQUEUES[3]: c782f580 ACTIVE PRIO_ARRAY: c782fa3c EXPIRED PRIO_ARRAY: c782f5c4 RUNQUEUES[4]: c7837580 ACTIVE PRIO_ARRAY: c78375c4 EXPIRED PRIO_ARRAY: c7837a3c RUNQUEUES[5]: c783f580 ACTIVE PRIO_ARRAY: c783f5c4 [115] PID: 3511 TASK: f7d3ea30 CPU: 5 COMMAND: "klogd" EXPIRED PRIO_ARRAY: c783fa3c RUNQUEUES[6]: c7847580 ACTIVE PRIO_ARRAY: c78475c4 EXPIRED PRIO_ARRAY: c7847a3c RUNQUEUES[7]: c784f580 ACTIVE PRIO_ARRAY: c784fa3c EXPIRED PRIO_ARRAY: c784f5c4