ssing + panic :
-------------------------
llm07:/home/murali/dtt_tools # ./ttutils set -p TIMERADD -t panic -c 100
llm07:/home/murali/dtt_tools # ./ttutils ls

use the 2.6.17-rc1 as the second kernel. while loading .

with 2.6.17-rc1
---------------

llm07:/proc # uname -a
Linux llm07 2.6.17-rc1 #4 Mon Apr 24 04:47:51 PDT 2006 x86_64 x86_64 x86_64 GNU/Linux


llm07:/proc # gdb /home/murali/src/linux-2.6.17-rc1/vmlinux vmcore
GNU gdb 6.1
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "x86_64-suse-linux"...Using host libthread_db library "/lib64/tls/libthread_db.so.1".

#0  0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
64      kexec.h: No such file or directory.
        in kexec.h
(gdb) info threads
  2 process 0  0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
* 1 process 10278  0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
(gdb) bt
#0  0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1  0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest")
    at kernel/panic.c:89
#2  0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
)
    at drivers/dtt/khdtt.c:306
#3  0x00000000ffffffff in ?? ()
#4  0xffffffff802461b6 in TIMERADD_hook () at kernel/hrtimer.c:458
#5  0xffffffff8023524c in do_setitimer (which=Variable "which" is not available.
) at kernel/itimer.c:238
#6  0xffffffff802355d6 in alarm_setitimer (seconds=Variable "seconds" is not available.
) at kernel/itimer.c:319
#7  0xffffffff8023a062 in sys_alarm (seconds=Variable "seconds" is not available.
) at kernel/timer.c:1193
#8  0xffffffff8020979a in system_call () at cpumask.h:183
#9  0x0000000000000246 in ?? ()
#10 0x00007fff4b1c0a70 in ?? ()
#11 0x000000000052e818 in ?? ()
#12 0x0000000000000004 in ?? ()
#13 0x0000000000000025 in ?? ()
#14 0x00002b7160682c67 in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x0000000000526548 in ?? ()
#17 0x000000000000014d in ?? ()
#18 0x0000000000000025 in ?? ()
#19 0x00002b7160664b89 in ?? ()
#20 0x0000000000000033 in ?? ()
---Type <return> to continue, or q <return> to quit---quit
Quit
(gdb) thread 2
[Switching to thread 2 (process 0)]#0  0xffffffff80251297 in crash_kexec (
    regs=0x0) at kexec.h:64
64      in kexec.h
(gdb) bt
#0  0xffffffff80251297 in crash_kexec (regs=0x0) at kexec.h:64
#1  0xffffffff80231162 in panic (fmt=0xffffffff80576308 "dumptest")
    at kernel/panic.c:89
#2  0xffffffff80472d3f in cpoint_default_exit (hook=Variable "hook" is not available.
)
    at drivers/dtt/khdtt.c:306
#3  0x00000000ffffffff in ?? ()
#4  0xffffffff802461b6 in TIMERADD_hook () at kernel/hrtimer.c:458
#5  0xffffffff8023524c in do_setitimer (which=Variable "which" is not available.
) at kernel/itimer.c:238
#6  0xffffffff802355d6 in alarm_setitimer (seconds=Variable "seconds" is not available.
) at kernel/itimer.c:319
#7  0xffffffff8023a062 in sys_alarm (seconds=Variable "seconds" is not available.
) at kernel/timer.c:1193
#8  0xffffffff8020979a in system_call () at cpumask.h:183
#9  0x0000000000000246 in ?? ()
#10 0x00007fff4b1c0a70 in ?? ()
#11 0x000000000052e818 in ?? ()
#12 0x0000000000000004 in ?? ()
#13 0x0000000000000025 in ?? ()
#14 0x00002b7160682c67 in ?? ()
#15 0x0000000000000001 in ?? ()
#16 0x0000000000526548 in ?? ()
#17 0x000000000000014d in ?? ()
#18 0x0000000000000025 in ?? ()
#19 0x00002b7160664b89 in ?? ()
#20 0x0000000000000033 in ?? ()
---Type <return> to continue, or q <return> to quit---quti
Quit
(gdb) info registers
rax            0x0      0
rbx            0xffff8100bd48fc00       -139634801050624
rcx            0xffffffff805aaaa8       -2141541720
rdx            0xffffffff805aaaa8       -2141541720
rsi            0x46     70
rdi            0x0      0
rbp            0xffff81000c004ec0       0xffff81000c004ec0
rsp            0xffff810136fadcd8       0xffff810136fadcd8
r8             0xffffffff805aaaa8       -2141541720
r9             0x0      0
r10            0x7fff4b1c0a70   140734453516912
r11            0xffff810136fadca8       -139632759350104
r12            0xffff81013b3ea3b0       -139632687799376
r13            0xffff81000c004ec0       -139637775380800
r14            0xe2ca7ed2b0     974059918000
r15            0x0      0
rip            0xffffffff80251297       0xffffffff80251297 <crash_kexec+185>
eflags         0x46     70
cs             0x10     16
ss             0x18     24
ds             0x0      0
es             0x0      0
fs             0x0      0
---Type <return> to continue, or q <return> to quit---quit
Quit
(gdb)



with 2.6.16-mm2
-----------------

llm07:~ # Kernel panic - not syncing: dumptest
 Bootdata ok (command line is root=/dev/sda1 vga=0x314 selinux=0 console=tty0 console=ttyS0,3840)Linux version 2.6.16-mm2 (root@llm07) (gcc version 3.3.3 (SuSE Linux)) #6 Wed Mar 29 04:59:08 PS6BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000100 - 000000000009ac00 (usable)
 BIOS-e820: 000000000009ac00 - 00000000000a0000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000fbf70000 (usable)
 BIOS-e820: 00000000fbf70000 - 00000000fbf7b000 (ACPI data)
 BIOS-e820: 00000000fbf7b000 - 00000000fbf80000 (ACPI NVS)
 BIOS-e820: 00000000fbf80000 - 00000000fc000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec00400 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
user-defined physical RAM map:
 user: 0000000000000000 - 00000000000a0000 (usable)
 user: 0000000001000000 - 0000000001544000 (usable)
 user: 00000000015e4400 - 0000000005000000 (usable)
 user: 00000000fbf70000 - 00000000fbf7b000 (ACPI data)
DMI present.
ACPI: PM-Timer IO Port: 0x8008
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:5 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 15:5 APIC version 16
WARNING: NR_CPUS limit of 1 reached. Processor ignored.
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x03] address[0xfc000000] gsi_base[24])
IOAPIC[1]: apic_id 3, version 17, address 0xfc000000, GSI 24-27
ACPI: IOAPIC (id[0x04] address[0xfc001000] gsi_base[28])
IOAPIC[2]: apic_id 4, version 17, address 0xfc001000, GSI 28-31
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
Setting APIC routing to flat
ACPI: HPET id: 0x102282a0 base: 0xfed00000
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at 10000000 (gap: 5000000:f6f70000)
Checking aperture...
CPU 0: aperture @ 8000000 size 64 MB
CPU 1: aperture @ 8000000 size 64 MB
Built 1 zonelists
Kernel command line: root=/dev/sda1 vga=0x314 selinux=0 console=tty0 console=ttyS0,38400 init 3 KInitializing CPU#0
PID hash table entries: 256 (order: 8, 2048 bytes)
time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer.
time.c: Detected 2193.434 MHz processor.
Console: colour dummy device 80x25
time.c: Lost 177 timer tick(s)! rip 10:start_kernel+0x102/0x1e1
last clier 0x0 caller 0x0
time.c: Lost 5 timer tick(s)! rip 10:__do_softirq+0x39/0xa4
last clier 0x0 caller 0x0
unexpected IRQ trap at vector 29
Dentry cache hash table entries: 8192 (order: 4, 65536 bytes)
time.c: Lost 3 timer tick(s)! rip 10:release_console_sem+0x13c/0x1af
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f
Inode-cache hash table entries: 4096 (order: 3, 32768 bytes)
Memory: 58848k/81920k available (2940k kernel code, 6620k reserved, 1597k data, 196k init)
Calibrating delay using timer specific routine.. 4392.85 BogoMIPS (lpj=8785714)
Mount-cache hash table entries: 256
8 compiled-in crash points registered
Crash dump test tools' module successfully loaded
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 1024K (64 bytes/line)
CPU: AMD Opteron(tm) Processor 248 stepping 08
Using local APIC timer interrupts.
result 12462714
Detected 12.462 MHz APIC timer.
NMI Watchdog detected LOCKUP on CPU 0
CPU 0
Modules linked in:
Pid: 1, comm: swapper Not tainted 2.6.16-mm2 #6
RIP: 0010:[<ffffffff81014297>] <ffffffff81014297>{setup_APIC_timer+53}
RSP: 0000:ffff810001747e88  EFLAGS: 00000012
RAX: 00000000054aec4e RBX: 00000000000c2bad RCX: 0000000000000000
RDX: 0000000001046d5a RSI: 00000000000000fa RDI: ffffffff81511903
RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000000
R10: 0000000000000000 R11: ffffffff814892d9 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffffffff814fb000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00002ab4d4e28000 CR3: 0000000001001000 CR4: 00000000000006e0
Process swapper (pid: 1, threadinfo ffff810001746000, task ffff810001745530)
Stack: 0000000000000000 0000000000000012 000000000be2a7a0 ffffffff81511903
       000030ae00000000 0000000000000000 0000000000000000 ffffffff81511ccd
       0000000000000001 0000000000000000
Call Trace: <ffffffff81511903>{setup_boot_APIC_clock+289}
       <ffffffff81511ccd>{APIC_init_uniprocessor+215} <ffffffff81007078>{init+61}
       <ffffffff8100a09e>{child_rip+8} <ffffffff8113821e>{acpi_ds_init_one_object+0}
       <ffffffff8100703b>{init+0} <ffffffff8100a096>{child_rip+0}

Code: 39 d0 73 f5 8b 04 25 f0 e0 5f ff 39 d0 72 f5 eb 3f 31 c0 e6
console shuts up ...
 <4>time.c: Lost 1360 timer tick(s)! rip 10:__down_read+0x85/0x8c
last clier setup_boot_APIC_clock+0x41/0x128 caller APIC_init_uniprocessor+0xd7/0xe4
Kernel panic - not syncing: Aiee, killing interrupt handler!
time.c: Lost 3 timer tick(s)! rip 10:release_console_sem+0x13c/0x1af
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f
 BUG: warning at kernel/panic.c:138/panic()

Call Trace: <NMI> <ffffffff810271f4>{panic+528} <ffffffff812d9be3>{__down_read+133}
       <ffffffff812d9b71>{__down_read+19} <ffffffff810331b1>{blocking_notifier_call_chain+53}
       <ffffffff81029e0a>{do_exit+151} <ffffffff81168227>{do_unblank_screen+24}
       <ffffffff812da8fe>{__die+0} <ffffffff812dad38>{nmi_watchdog_tick+168}
       <ffffffff812da750>{default_do_nmi+122} <ffffffff812dac7b>{do_nmi+61}
       <ffffffff812da35f>{nmi+127} <ffffffff81511903>{setup_boot_APIC_clock+289}
       <ffffffff81014297>{setup_APIC_timer+53} <EOE> <ffffffff81511903>{setup_boot_APIC_clock+28}       <ffffffff81511ccd>{APIC_init_uniprocessor+215} <ffffffff81007078>{init+61}
       <ffffffff8100a09e>{child_rip+8} <ffffffff8113821e>{acpi_ds_init_one_object+0}
       <ffffffff8100703b>{init+0} <ffffffff8100a096>{child_rip+0}
time.c: Lost 3 timer tick(s)! rip 10:__delay+0x8/0x10
last clier release_console_sem+0x1a/0x1af caller vprintk+0x24e/0x26f