___________________________________________________________________________________________
System: Linux elm3b96.eng 2.5.5-dj2 #7 SMP Mon Mar 4 14:24:48 PST 2002 i686
Total counts
All (8) CPUs
Start time: Mon Mar 4 14:38:05 2002
End time: Mon Mar 4 14:55:28 2002
Delta Time: 1042.90 sec.
Hash table slots in use: 292.
Global read lock slots in use: 999.
*************************** Warnings! ******************************
Read Lock table overflowed.
The data in this report may be in error due to this.
************************ End of Warnings! **************************
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
SPINLOCKS HOLD WAIT
UTIL CON MEAN( MAX ) MEAN( MAX )(% CPU) TOTAL NOWAIT SPIN RJECT NAME
6.5% 0.8us( 17ms) 9.3us( 15ms)( 2.7%) 368233965 93.5% 6.5% 0.00% *TOTAL*
0.00% 0% 0.3us( 0.3us) 0us 1 100% 0% 0% [0xf7040c28]
0.00% 0% 0.3us( 0.3us) 0us 1 100% 0% 0% read_chan+0x604
0.00% 0% 4.6us( 9.4us) 0us 88 100% 0% 0% [0xf73ea92c]
0.00% 0% 2.3us( 4.5us) 0us 16 100% 0% 0% unmap_fixup+0x8c
0.00% 0% 5.1us( 9.4us) 0us 72 100% 0% 0% unmap_fixup+0x134
0.00% 0% 0.4us( 0.4us) 0us 1 100% 0% 0% [0xf7759df8]
0.00% 0% 0.4us( 0.4us) 0us 1 100% 0% 0% find_lock_page_helper+0x3c
0.00% 0% 44us( 52us) 0us 2 100% 0% 0% [0xf7acecec]
0.00% 0% 44us( 52us) 0us 2 100% 0% 0% ip_send_reply+0xbc
0.00% 0% 2.2us( 9.3us) 0us 8342 100% 0% 0% [0xf7aeba40]
0.00% 0% 1.0us( 5.7us) 0us 4171 100% 0% 0% rh_int_timer_do+0x70
0.00% 0% 3.3us( 9.3us) 0us 4171 100% 0% 0% rh_send_irq+0x40
0.00% 0% 2.2us( 8.1us) 0us 4171 100% 0% 0% [0xf7b756f4]
0.00% 0% 2.2us( 8.1us) 0us 4171 100% 0% 0% rh_int_timer_do+0x48
0.03% 0.13% 3.7us( 374us) 10us( 33us)(0.00%) 86760 99.9% 0.13% 0% [0xf7b75888]
0.01% 0.31% 5.1us( 34us) 5.9us( 19us)(0.00%) 16748 99.7% 0.31% 0% __make_request+0x8c
0.01% 0.05% 6.9us( 374us) 3.7us( 8.5us)(0.00%) 13554 100% 0.05% 0% ahc_linux_isr+0x2f8
0.00% 0.13% 14us( 30us) 0.8us( 0.8us)(0.00%) 782 99.9% 0.13% 0% generic_unplug_device+0x14
0.00% 0% 0.5us( 2.8us) 0us 36 100% 0% 0% get_request_wait+0xa8
0.00% 0.32% 2.4us( 46us) 16us( 33us)(0.00%) 15269 99.7% 0.32% 0% scsi_dispatch_cmd+0xf8
0.00% 0% 0.8us( 5.8us) 0us 13457 100% 0% 0% scsi_finish_command+0x18
0.00% 0.02% 2.2us( 12us) 10us( 17us)(0.00%) 13457 100% 0.02% 0% scsi_queue_next_request+0x18
0.00% 0% 3.7us( 12us) 0us 13457 100% 0% 0% scsi_request_fn+0x3ec
0.00% 0% 4.8us( 9.8us) 0us 110 100% 0% 0% [0xf7b980d4]
0.00% 0% 4.8us( 9.8us) 0us 110 100% 0% 0% qdisc_restart+0x2c
0.00% 0% 2.2us( 7.5us) 0us 220 100% 0% 0% [0xf7b980dc]
0.00% 0% 3.4us( 7.5us) 0us 110 100% 0% 0% dev_queue_xmit+0x12c
0.00% 0% 0.9us( 1.6us) 0us 110 100% 0% 0% qdisc_restart+0x90
0.00% 0% 3.7us( 10us) 0us 219 100% 0% 0% [0xf7b984e4]
0.00% 0% 5.0us( 10us) 0us 109 100% 0% 0% tulip_interrupt+0xe8
0.00% 0% 2.3us( 5.9us) 0us 110 100% 0% 0% tulip_start_xmit+0x1c
0.00% 0% 0.1us( 0.4us) 0us 320 100% 0% 0% [0xf7db48fc]
0.00% 0% 0.1us( 0.1us) 0us 80 100% 0% 0% shmem_delete_inode+0x64
0.00% 0% 0.1us( 0.1us) 0us 80 100% 0% 0% shmem_get_inode+0x1c
0.00% 0% 0.1us( 0.2us) 0us 80 100% 0% 0% shmem_getpage_locked+0x1e0
0.00% 0% 0.1us( 0.4us) 0us 80 100% 0% 0% shmem_recalc_inode+0x44
0.08% 0.02% 0.3us( 74us) 1.8us( 54us)(0.00%) 2704426 100% 0.02% 0% arbitration_lock
0.00% 0% 0.2us( 1.1us) 0us 1453 100% 0% 0% deny_write_access+0xc
0.08% 0.02% 0.3us( 74us) 1.8us( 54us)(0.00%) 2702973 100% 0.02% 0% get_write_access+0xc
0.02% 0% 13us(2508us) 0us 18549 100% 0% 0% call_lock
0.02% 0% 13us(2508us) 0us 18549 100% 0% 0% smp_call_function+0x58
4.1% 3.4% 2.0us( 660us) 3.6us( 649us)(0.03%) 20934668 96.6% 3.4% 0% dcache_lock
0.02% 3.1% 0.2us( 13us) 4.1us( 117us)(0.00%) 892700 96.9% 3.1% 0% d_alloc+0x12c
0.02% 8.3% 0.3us( 58us) 3.9us( 498us)(0.00%) 699920 91.7% 8.3% 0% d_delete+0x10
0.01% 1.9% 0.2us( 44us) 3.5us( 43us)(0.00%) 699920 98.1% 1.9% 0% d_delete+0x94
0.03% 8.4% 0.2us( 54us) 3.9us( 398us)(0.01%) 1592628 91.6% 8.4% 0% d_instantiate+0x24
0.34% 3.4% 1.0us( 88us) 3.3us( 88us)(0.00%) 3614437 96.6% 3.4% 0% d_lookup+0x14
0.04% 8.4% 2.6us( 61us) 4.1us( 59us)(0.00%) 140400 91.6% 8.4% 0% d_move+0x3c
0.02% 2.3% 0.2us( 35us) 3.1us( 94us)(0.00%) 892620 97.7% 2.3% 0% d_rehash+0x48
0.21% 3.4% 0.5us( 534us) 3.9us( 596us)(0.01%) 4122129 96.6% 3.4% 0% dput+0x30
0.00% 0% 0.4us( 0.7us) 0us 81 100% 0% 0% link_path_walk+0x1b0
0.00% 0.91% 1.4us( 3.8us) 5.0us( 6.3us)(0.00%) 219 99.1% 0.91% 0% link_path_walk+0x418
0.00% 0.48% 3.5us( 20us) 5.2us( 24us)(0.00%) 6712 99.5% 0.48% 0% path_lookup+0xc0
3.4% 2.3% 4.3us( 190us) 3.2us( 649us)(0.01%) 8207231 97.7% 2.3% 0% path_lookup+0x108
0.00% 12.2% 2.3us( 23us) 8.8us( 33us)(0.00%) 761 87.8% 12.2% 0% prune_dcache+0x14
0.00% 1.4% 0.9us( 221us) 3.5us( 29us)(0.00%) 55513 98.6% 1.4% 0% prune_dcache+0x138
0.01% 1.8% 8.6us( 660us) 3.8us( 27us)(0.00%) 9397 98.2% 1.8% 0% select_parent+0x20
0.00% 0% 1.7us( 17us) 0us 26914 100% 0% 0% device_request_lock
0.00% 0% 0.5us( 5.5us) 0us 13457 100% 0% 0% __scsi_release_command+0x14
0.00% 0% 2.9us( 17us) 0us 13457 100% 0% 0% scsi_allocate_device+0x30
0.62% 1.9% 0.8us( 99us) 2.1us( 50us)(0.00%) 7847049 98.1% 1.9% 0% files_lock
0.00% 0% 0.3us( 0.6us) 0us 160 100% 0% 0% check_tty_count+0x10
0.12% 2.8% 0.5us( 91us) 2.1us( 27us)(0.00%) 2615195 97.2% 2.8% 0% file_move+0x18
0.08% 1.6% 0.3us( 69us) 2.0us( 50us)(0.00%) 2615675 98.4% 1.6% 0% fput+0x80
0.43% 1.3% 1.7us( 99us) 1.9us( 46us)(0.00%) 2615675 98.7% 1.3% 0% get_empty_filp+0xc
0.00% 2.9% 1.1us( 4.7us) 1.9us( 6.7us)(0.00%) 344 97.1% 2.9% 0% get_empty_filp+0xe0
0.12% 0.17% 9.8us(2041us) 0us 127024 99.8% 0% 0.17% global_bh_lock
0.12% 0.17% 9.8us(2041us) 0us 127024 99.8% 0% 0.17% bh_action+0x18
0.09% 0% 8.6us( 20us) 0us 104291 100% 0% 0% i8253_lock
0.09% 0% 8.6us( 20us) 0us 104291 100% 0% 0% timer_interrupt+0x2c
0.03% 0% 2.7us( 10us) 0us 104291 100% 0% 0% i8259A_lock
0.03% 0% 2.7us( 10us) 0us 104291 100% 0% 0% timer_interrupt+0x90
0.00% 0% 1.1us( 1.9us) 0us 9 100% 0% 0% inet_peer_unused_lock
0.00% 0% 1.1us( 1.9us) 0us 9 100% 0% 0% cleanup_once+0x24
0.19% 0.34% 0.6us( 71us) 2.1us( 66us)(0.00%) 3187987 99.7% 0.34% 0% inode_lock
0.04% 0.23% 0.5us( 71us) 2.2us( 18us)(0.00%) 849313 99.8% 0.23% 0% __mark_inode_dirty+0x48
0.00% 0.75% 0.6us( 2.4us) 2.3us( 2.3us)(0.00%) 133 99.2% 0.75% 0% get_new_inode+0x28
0.01% 0.40% 2.4us( 49us) 2.1us(10.0us)(0.00%) 50830 99.6% 0.40% 0% iget4+0x3c
0.03% 0.37% 0.4us( 41us) 2.0us( 8.4us)(0.00%) 699928 99.6% 0.37% 0% insert_inode_hash+0x44
0.05% 0.40% 0.7us( 63us) 2.3us( 66us)(0.00%) 745972 99.6% 0.40% 0% iput+0x68
0.04% 0.39% 0.6us( 68us) 2.0us( 26us)(0.00%) 700248 99.6% 0.39% 0% new_inode+0x1c
0.00% 0.97% 8.5us( 19us) 2.2us( 2.9us)(0.00%) 207 99.0% 0.97% 0% sync_unlocked_inodes+0x10
0.02% 0.33% 1.5us( 29us) 2.1us( 10us)(0.00%) 141356 99.7% 0.33% 0% sync_unlocked_inodes+0x110
1.1% 0.52% 1.6us( 17ms) 345us( 15ms)(0.15%) 7185937 99.5% 0.52% 0% kernel_flag
0.00% 0% 12us( 13us) 0us 80 100% 0% 0% chrdev_open+0x50
0.00% 0.83% 0.6us( 3.8us) 22us( 22us)(0.00%) 120 99.2% 0.83% 0% de_put+0x2c
0.31% 7.2% 3372us( 17ms) 2725us( 10ms)(0.00%) 962 92.8% 7.2% 0% do_exit+0xe4
0.04% 0.62% 0.2us( 50us) 633us( 15ms)(0.09%) 1956002 99.4% 0.62% 0% ext2_free_blocks+0x24c
0.04% 0.70% 0.3us( 108us) 331us( 12ms)(0.05%) 1667643 99.3% 0.70% 0% ext2_new_block+0x9c
0.02% 0.19% 0.1us( 54us) 7.6us(2656us)(0.00%) 1659643 99.8% 0.19% 0% ext2_new_block+0x104
0.05% 0.44% 0.3us( 65us) 67us(9587us)(0.01%) 1667643 99.6% 0.44% 0% ext2_new_block+0x608
0.00% 0% 3.8us( 4.3us) 0us 80 100% 0% 0% get_chrfops+0x8c
0.46% 1.7% 52us( 788us) 172us(8316us)(0.00%) 92162 98.3% 1.7% 0% notify_change+0x58
0.00% 0% 1.0us( 1.0us) 0us 2 100% 0% 0% permission+0x34
0.00% 2.5% 20us( 48us) 1.2us( 1.4us)(0.00%) 121 97.5% 2.5% 0% proc_lookup+0x38
0.00% 0.85% 0.6us( 2.4us) 1.2us( 1.2us)(0.00%) 117 99.1% 0.85% 0% proc_root_lookup+0x2c
0.02% 6.6% 646us(7892us) 456us(4917us)(0.00%) 396 93.4% 6.6% 0% schedule+0x378
0.09% 1.4% 4477us( 11ms) 1974us(5896us)(0.00%) 207 98.6% 1.4% 0% sync_old_buffers+0x1c
0.00% 5.0% 6.8us( 22us) 3.9us( 3.9us)(0.00%) 20 95.0% 5.0% 0% sys_ioctl+0x44
0.00% 2.5% 12us( 20us) 9.1us( 12us)(0.00%) 120 97.5% 2.5% 0% tty_read+0xc4
0.00% 0% 11us( 12us) 0us 80 100% 0% 0% tty_release+0x1c
0.00% 0% 21us( 35us) 0us 121 100% 0% 0% tty_write+0x228
0.06% 0.94% 4.1us( 71us) 237us(8135us)(0.00%) 140400 99.1% 0.94% 0% vfs_rename_other+0xa0
0.00% 0% 7.6us( 11us) 0us 18 100% 0% 0% vfs_statfs+0x50
5.6% 10.1% 0.4us(2701us) 5.1us(2719us)(0.84%) 136496494 89.9% 10.1% 0% kmap_lock
3.5% 10.8% 0.5us(2701us) 5.1us(2138us)(0.45%) 68248247 89.2% 10.8% 0% kmap_high+0x10
2.1% 9.4% 0.3us( 145us) 5.1us(2719us)(0.40%) 68248247 90.6% 9.4% 0% kunmap_high+0xc
0.00% 0% 0.3us( 1.3us) 0us 962 100% 0% 0% lastpid_lock
0.00% 0% 0.3us( 1.3us) 0us 962 100% 0% 0% get_pid+0x28
0.00% 0% 3.2us( 15us) 0us 6 100% 0% 0% logbuf_lock
0.00% 0% 8.6us( 15us) 0us 2 100% 0% 0% printk+0x58
0.00% 0% 0.5us( 1.8us) 0us 4 100% 0% 0% release_console_sem+0x1c
5.7% 15.4% 1.2us( 10ms) 17us( 10ms)( 1.6%) 51588853 84.6% 15.4% 0% lru_list_lock
0.36% 5.2% 0.3us( 100us) 7.0us(9918us)(0.07%) 15057710 94.8% 5.2% 0% buffer_insert_list+0x10
0.02% 11.3% 0.3us( 96us) 12us( 683us)(0.01%) 692362 88.7% 11.3% 0% inode_has_buffers+0x10
0.02% 11.2% 0.4us( 41us) 12us(9795us)(0.01%) 692240 88.8% 11.2% 0% invalidate_inode_buffers+0x10
0.00% 5.8% 39us( 169us) 7.3us( 33us)(0.00%) 207 94.2% 5.8% 0% kupdate+0xe8
2.0% 19.5% 1.2us( 10ms) 17us( 10ms)(0.72%) 17714459 80.5% 19.5% 0% refile_buffer+0xc
1.2% 20.0% 1.4us( 94us) 18us( 962us)(0.38%) 8706240 80.0% 20.0% 0% remove_from_queues+0xc
0.00% 7.6% 18us( 43us) 8.7us( 63us)(0.00%) 675 92.4% 7.6% 0% sync_old_buffers+0x78
2.1% 20.8% 2.5us( 186us) 18us( 879us)(0.40%) 8724960 79.2% 20.8% 0% try_to_free_buffers+0x3c
0.00% 0% 0.4us( 5.3us) 0us 1924 100% 0% 0% mmlist_lock
0.00% 0% 0.1us( 0.7us) 0us 962 100% 0% 0% copy_mm+0x120
0.00% 0% 0.6us( 5.3us) 0us 962 100% 0% 0% mmput+0x28
0.00% 0% 0.6us( 1.5us) 0us 1223 100% 0% 0% page_uptodate_lock.0
0.00% 0% 0.6us( 1.5us) 0us 1223 100% 0% 0% end_buffer_io_async+0x38
0.81% 1.2% 0.5us( 97us) 1.6us( 86us)(0.00%) 18554317 98.8% 1.2% 0% pagemap_lru_lock
0.10% 3.3% 1.1us( 66us) 1.9us( 84us)(0.00%) 964970 96.7% 3.3% 0% activate_page+0xc
0.38% 1.6% 0.4us( 94us) 1.5us( 86us)(0.00%) 8832962 98.4% 1.6% 0% lru_cache_add+0x1c
0.33% 0.69% 0.4us( 97us) 1.9us( 70us)(0.00%) 8756385 99.3% 0.69% 0% lru_cache_del+0xc
0.00% 0% 1.5us( 13us) 0us 1111 100% 0% 0% sb_lock
0.00% 0% 0.2us( 1.3us) 0us 207 100% 0% 0% drop_super+0x24
0.00% 0% 0.9us( 6.2us) 0us 414 100% 0% 0% sync_supers+0x70
0.00% 0% 5.2us( 13us) 0us 207 100% 0% 0% sync_unlocked_inodes+0x18
0.00% 0% 0.4us( 2.9us) 0us 283 100% 0% 0% sync_unlocked_inodes+0x194
0.00% 0% 0.4us( 6.8us) 0us 42350 100% 0% 0% scsi_bhqueue_lock
0.00% 0% 0.2us( 6.7us) 0us 27081 100% 0% 0% scsi_bottom_half_handler+0x1c
0.00% 0% 0.6us( 6.8us) 0us 15269 100% 0% 0% scsi_done+0x3c
0.09% 1.6% 0.6us( 8.9us) 2.1us( 27us)(0.00%) 1472299 98.4% 1.6% 0% semaphore_lock
0.02% 2.2% 0.3us( 8.9us) 2.1us( 27us)(0.00%) 578529 97.8% 2.2% 0% __down+0x48
0.07% 1.3% 0.8us( 8.4us) 2.0us( 21us)(0.00%) 893744 98.7% 1.3% 0% __down+0x7c
0.00% 0% 1.0us( 3.4us) 0us 20 100% 0% 0% __down_interruptible+0x4c
0.00% 0% 0.5us( 1.0us) 0us 6 100% 0% 0% __down_interruptible+0x98
0.00% 0% 1.0us( 6.0us) 0us 1920 100% 0% 0% shm_ids+0x24
0.00% 0% 0.6us( 1.2us) 0us 80 100% 0% 0% ipc_addid+0x98
0.00% 0% 1.9us( 6.0us) 0us 800 100% 0% 0% shm_close+0x54
0.00% 0% 0.2us( 0.3us) 0us 80 100% 0% 0% shm_mmap+0x5c
0.00% 0% 0.3us( 1.9us) 0us 720 100% 0% 0% shm_open+0x3c
0.00% 0% 1.5us( 2.7us) 0us 80 100% 0% 0% sys_shmat+0xb8
0.00% 0% 0.2us( 0.4us) 0us 80 100% 0% 0% sys_shmat+0x264
0.00% 0% 1.0us( 1.6us) 0us 80 100% 0% 0% sys_shmctl+0x684
0.00% 0% 0.1us( 0.5us) 0us 160 100% 0% 0% shmem_ilock
0.00% 0% 0.1us( 0.5us) 0us 80 100% 0% 0% shmem_delete_inode+0x34
0.00% 0% 0.1us( 0.1us) 0us 80 100% 0% 0% shmem_get_inode+0x14c
0.03% 0% 4356us(4509us) 0us 80 100% 0% 0% swaplock
0.03% 0% 4356us(4509us) 0us 80 100% 0% 0% si_swapinfo+0x18
0.02% 0.01% 1.2us( 9.1us) 2.6us( 7.9us)(0.00%) 152642 100% 0.01% 0% timerlist_lock
0.00% 0.03% 0.6us( 9.1us) 2.8us( 5.2us)(0.00%) 21578 100% 0.03% 0% add_timer+0x10
0.00% 0.05% 0.7us( 6.0us) 3.1us( 7.9us)(0.00%) 15271 100% 0.05% 0% del_timer+0x14
0.00% 0.03% 0.8us( 4.7us) 0.9us( 0.9us)(0.00%) 3092 100% 0.03% 0% del_timer_sync+0x1c
0.00% 0% 1.2us( 6.1us) 0us 1323 100% 0% 0% mod_timer+0x18
0.02% 0.00% 1.5us( 9.0us) 1.9us( 3.4us)(0.00%) 104291 100% 0.00% 0% timer_bh+0xcc
0.00% 0.01% 0.3us( 5.5us) 2.5us( 2.5us)(0.00%) 7087 100% 0.01% 0% timer_bh+0x254
0.00% 0% 0.4us( 6.4us) 0us 19448 100% 0% 0% tqueue_lock
0.00% 0% 0.4us( 5.7us) 0us 9724 100% 0% 0% __run_task_queue+0x14
0.00% 0% 0.5us( 6.4us) 0us 8978 100% 0% 0% batch_entropy_store+0x7c
0.00% 0% 0.7us( 4.9us) 0us 746 100% 0% 0% blk_plug_device+0x3c
0.87% 0.79% 0.5us( 179us) 2.4us( 162us)(0.00%) 17526497 99.2% 0.79% 0% unused_list_lock
0.41% 1.0% 0.5us( 110us) 2.7us( 162us)(0.00%) 8801537 99.0% 1.0% 0% get_unused_buffer_head+0x8
0.46% 0.53% 0.6us( 179us) 1.8us( 41us)(0.00%) 8724960 99.5% 0.53% 0% try_to_free_buffers+0x74
0.00% 0% 2.9us( 4.1us) 0us 6 100% 0% 0% vga_lock
0.00% 0% 3.0us( 4.1us) 0us 3 100% 0% 0% vgacon_cursor+0x5c
0.00% 0% 2.5us( 2.6us) 0us 2 100% 0% 0% vgacon_cursor+0xb0
0.00% 0% 3.2us( 3.2us) 0us 1 100% 0% 0% vgacon_scroll+0x1c4
0.68% 2.1% 0.8us( 17us) 2.0us( 29us)(0.00%) 8763747 97.9% 2.1% 0% __free_pages_ok+0x114
0.65% 0.22% 0.7us( 55us) 2.1us( 32us)(0.00%) 10049635 99.8% 0.22% 0% __wake_up+0x1c
1.0% 0.00% 1.2us( 166us) 0.8us( 2.8us)(0.00%) 8707596 100% 0.00% 0% add_to_page_cache+0x18
0.00% 0.00% 0.2us( 5.1us) 1.4us( 1.4us)(0.00%) 31649 100% 0.00% 0% add_wait_queue+0x10
0.01% 9.9% 0.2us(10.0us) 4.7us( 62us)(0.00%) 578630 90.1% 9.9% 0% add_wait_queue_exclusive+0x10
0.02% 0.08% 9.3us( 13ms) 3.9us( 9.7us)(0.00%) 27110 100% 0.08% 0% ahc_linux_isr+0x28
0.00% 0% 0.9us( 3.1us) 0us 406 100% 0% 0% change_protection+0x40
0.00% 0% 25us( 51us) 0us 1204 100% 0% 0% clear_page_tables+0x1c
0.00% 0.07% 0.1us( 0.9us) 1.1us( 1.9us)(0.00%) 10678 100% 0.07% 0% copy_mm+0x1f8
0.00% 0% 1.6us( 84us) 0us 14844 100% 0% 0% copy_mm+0x22c
0.00% 0% 1.7us( 84us) 0us 14844 100% 0% 0% copy_page_range+0xe8
0.01% 0% 0.7us( 7.6us) 0us 118266 100% 0% 0% do_IRQ+0x40
0.00% 0% 0.4us( 6.0us) 0us 118266 100% 0% 0% do_IRQ+0xc0
0.00% 0% 1.5us( 9.7us) 0us 8805 100% 0% 0% do_anonymous_page+0xc4
0.00% 0% 0.3us( 0.6us) 0us 242 100% 0% 0% do_brk+0x1e0
0.00% 0% 0.1us( 3.8us) 0us 962 100% 0% 0% do_exit+0x100
0.00% 0% 0.1us( 0.9us) 0us 962 100% 0% 0% do_exit+0x130
0.00% 0% 0.1us( 0.5us) 0us 962 100% 0% 0% do_exit+0x1dc
0.00% 0% 0.2us( 2.6us) 0us 962 100% 0% 0% do_exit+0x8c
0.54% 0.00% 0.6us( 124us) 1.5us( 4.5us)(0.00%) 9664259 100% 0.00% 0% do_generic_file_read+0x170
0.00% 0% 1.2us( 22us) 0us 18730 100% 0% 0% do_generic_file_read+0x31c
0.00% 0.02% 0.8us( 3.2us) 0.9us( 0.9us)(0.00%) 4034 100% 0.02% 0% do_mmap_pgoff+0x41c
0.00% 0% 0.5us( 4.5us) 0us 5761 100% 0% 0% do_mmap_pgoff+0x428
0.00% 0.11% 0.2us( 0.5us) 1.2us( 1.2us)(0.00%) 892 99.9% 0.11% 0% do_munmap+0x1b8
0.00% 0% 0.9us( 4.3us) 0us 2221 100% 0% 0% do_munmap+0xe0
0.00% 0% 0.2us( 7.2us) 0us 57450 100% 0% 0% do_no_page+0x1a4
0.00% 0% 0.5us( 4.6us) 0us 1123 100% 0% 0% do_page_fault+0xf0
0.00% 0% 0.5us( 6.2us) 0us 3231 100% 0% 0% do_sigaction+0x58
0.00% 0% 0.3us( 2.6us) 0us 660 100% 0% 0% do_sigaction+0xe0
0.00% 0% 3.1us( 9.9us) 0us 918 100% 0% 0% do_signal+0x54
0.00% 0% 1.9us( 17us) 0us 20680 100% 0% 0% do_wp_page+0x1f4
0.00% 0% 0.2us( 3.2us) 0us 1204 100% 0% 0% exit_mmap+0x18
0.00% 0.06% 0.3us( 7.2us) 1.8us( 3.1us)(0.00%) 14470 100% 0.06% 0% exit_mmap+0x88
0.00% 0% 1.9us( 41us) 0us 962 100% 0% 0% exit_sighand+0x18
0.00% 0.00% 0.1us( 8.4us) 1.7us( 2.4us)(0.00%) 141356 100% 0.00% 0% filemap_fdatasync+0x24
0.00% 0.00% 0.1us( 6.5us) 1.4us( 1.9us)(0.00%) 141356 100% 0.00% 0% filemap_fdatawait+0x14
0.10% 0.01% 0.4us( 75us) 1.5us( 4.8us)(0.00%) 2639704 100% 0.01% 0% find_get_page+0x14
1.3% 0.00% 0.5us( 154us) 1.2us( 1.3us)(0.00%) 27143440 100% 0.00% 0% find_lock_page+0xc
0.01% 0.04% 1.5us( 12us) 2.5us( 10us)(0.00%) 75341 100% 0.04% 0% find_or_create_page+0x10
0.01% 0.02% 1.9us( 87us) 2.2us( 6.5us)(0.00%) 75340 100% 0.02% 0% find_or_create_page+0x40
0.15% 0.00% 31us( 172us) 15us( 15us)(0.00%) 52009 100% 0.00% 0% free_block+0x1c
0.00% 0% 0.5us( 14us) 0us 102188 100% 0% 0% handle_mm_fault+0x34
0.00% 0% 0.5us( 4.3us) 0us 918 100% 0% 0% handle_signal+0xb0
0.00% 0% 0.4us( 2.0us) 0us 242 100% 0% 0% insert_vm_struct+0x64
0.09% 0.14% 14us( 111us) 9.8us( 24us)(0.00%) 64307 99.9% 0.14% 0% kmem_cache_alloc_batch+0x20
0.00% 0.06% 0.4us( 6.1us) 2.6us( 3.8us)(0.00%) 6541 100% 0.06% 0% kmem_cache_grow+0x1e4
0.00% 0% 0.8us( 7.2us) 0us 6541 100% 0% 0% kmem_cache_grow+0x8c
0.10% 1.7% 2.1us( 16us) 0us 502382 98.3% 0% 1.7% load_balance+0x110
0.00% 61.4% 2.6us( 14us) 2.9us( 51us)(0.00%) 4432 38.6% 61.4% 0% load_balance+0x12c
0.00% 4.3% 4.4us( 37us) 2.8us( 7.3us)(0.00%) 4432 95.7% 4.3% 0% load_balance+0x134
0.00% 67.9% 1.8us( 14us) 2.9us( 46us)(0.00%) 4276 32.1% 67.9% 0% load_balance+0x168
0.00% 0% 1.1us( 2.3us) 0us 406 100% 0% 0% mprotect_fixup+0x2a8
0.00% 0% 0.6us( 0.9us) 0us 406 100% 0% 0% mprotect_fixup+0x2b4
0.00% 0.27% 0.4us( 1.6us) 0.8us( 0.8us)(0.00%) 365 99.7% 0.27% 0% n_tty_chars_in_buffer+0x18
0.00% 0% 0.4us( 1.6us) 0us 449 100% 0% 0% n_tty_receive_buf+0x44
0.00% 0% 0.1us( 0.3us) 0us 14 100% 0% 0% n_tty_receive_buf+0x854
0.00% 6.3% 0.2us( 0.9us) 1.1us( 2.7us)(0.00%) 2253 93.7% 6.3% 0% page_cache_read+0x20
0.00% 0% 2.7us( 45us) 0us 3612 100% 0% 0% pte_alloc_map+0xdc
0.00% 0% 0.2us( 0.5us) 0us 242 100% 0% 0% put_dirty_page+0x3c
0.00% 0% 0.1us( 0.4us) 0us 120 100% 0% 0% read_chan+0x504
0.00% 0% 0.1us( 0.1us) 0us 120 100% 0% 0% read_chan+0x568
0.00% 0% 0.1us( 0.1us) 0us 120 100% 0% 0% read_chan+0x5a4
0.47% 0% 0.6us( 128us) 0us 8725040 100% 0% 0% remove_inode_page+0x20
0.02% 15.8% 0.3us( 6.6us) 4.3us( 40us)(0.01%) 610279 84.2% 15.8% 0% remove_wait_queue+0x10
1.6% 3.0% 1.9us( 23us) 2.3us( 29us)(0.01%) 8846865 97.0% 3.0% 0% rmqueue+0x28
0.65% 1.4% 4.4us( 63us) 2.3us( 24us)(0.00%) 1545828 98.6% 1.4% 0% schedule+0x8c
0.05% 0.04% 0.7us( 22us) 3.0us( 16us)(0.00%) 668526 100% 0.04% 0% scheduler_tick+0x10c
0.03% 0.10% 2.1us( 26us) 3.2us( 8.0us)(0.00%) 166052 100% 0.10% 0% scheduler_tick+0x80
0.00% 0% 2.1us( 13us) 0us 2038 100% 0% 0% send_sig_info+0x4c
0.00% 0% 0.3us( 1.4us) 0us 80 100% 0% 0% set_page_dirty+0x24
0.00% 0% 0.8us( 1.1us) 0us 80 100% 0% 0% shmem_getpage_locked+0xa4
0.00% 0% 2.9us( 6.5us) 0us 160 100% 0% 0% shmem_truncate+0x44
0.00% 0% 0.1us( 0.2us) 0us 500 100% 0% 0% sys_rt_sigprocmask+0x1ac
0.00% 0% 0.3us( 4.2us) 0us 8133 100% 0% 0% sys_rt_sigprocmask+0x98
0.00% 0% 0.3us( 2.8us) 0us 918 100% 0% 0% sys_sigreturn+0x80
0.00% 0% 1.7us( 2.7us) 0us 14 100% 0% 0% tcp_delack_timer+0x18
0.00% 0% 0.2us( 0.2us) 0us 14 100% 0% 0% tcp_recvmsg+0x40
0.00% 0% 0.2us( 0.6us) 0us 14 100% 0% 0% tcp_recvmsg+0x7e4
0.00% 0% 0.3us( 0.6us) 0us 106 100% 0% 0% tcp_sendmsg+0x1074
0.00% 0% 0.5us( 1.2us) 0us 106 100% 0% 0% tcp_sendmsg+0x3c
0.00% 0.82% 28us( 328us) 69us( 69us)(0.00%) 122 99.2% 0.82% 0% tcp_v4_rcv+0x2dc
0.00% 0% 3.1us( 71us) 0us 85 100% 0% 0% tcp_write_timer+0x18
0.04% 0% 0.9us( 48us) 0us 437122 100% 0% 0% truncate_inode_pages+0x38
0.32% 0% 0.4us( 110us) 0us 8725040 100% 0% 0% truncate_list_pages+0x1f0
0.20% 9.1% 2.2us( 15us) 4.5us( 42us)(0.00%) 958188 90.9% 9.1% 0% try_to_wake_up+0x3c
0.00% 0% 1.3us( 2.5us) 0us 244 100% 0% 0% unmap_fixup+0xa8
0.00% 0% 0.7us( 1.4us) 0us 245 100% 0% 0% unmap_fixup+0xb8
0.00% 0% 0.2us( 1.6us) 0us 1304 100% 0% 0% vma_merge+0x54
0.00% 0% 0.4us( 14us) 0us 92162 100% 0% 0% vmtruncate+0x4c
0.00% 9.3% 0.3us( 3.1us) 2.8us( 9.8us)(0.00%) 962 90.7% 9.3% 0% wait_task_inactive+0x6c
0.00% 0.10% 0.5us( 3.0us) 1.7us( 1.7us)(0.00%) 962 99.9% 0.10% 0% wake_up_forked_process+0x30
0.02% 0% 10.0us( 201us) 0us 21828 100% 0% 0% zap_page_range+0x58
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
RWLOCK READS HOLD MAX RDR BUSY PERIOD WAIT
UTIL CON MEAN RDRS MEAN( MAX ) MEAN( MAX )( %CPU) TOTAL NOWAIT SPIN NAME
0.56% 3.0us( 116us)(0.01%) 40057139 99.4% 0.56% *TOTAL*
0.00% 0% 8.2us 1 8.2us( 8.2us) 0us 1 100% 0% [0xf709ed84]
0% 0us 1 100% 0% sock_def_readable+0x14
0.00% 0% 0.7us 1 0.7us( 1.8us) 0us 110 100% 0% [0xf7b977f4]
0% 0us 110 100% 0% ip_output+0x68
0.00% 0% 1.5us 1 1.5us( 5.5us) 0us 113 100% 0% arp_tbl+0xc4
0% 0us 113 100% 0% neigh_lookup+0x40
0.00% 0% 0.5us 1 0.5us( 1.3us) 0us 244 100% 0% binfmt_lock
0% 0us 243 100% 0% search_binary_handler+0x38
0% 0us 1 100% 0% search_binary_handler+0xe0
0.00% 0% 0.6us 1 0.6us( 1.2us) 0us 80 100% 0% chrdevs_lock
0% 0us 80 100% 0% get_chrfops+0x28
0.76% 0.02% 0.4us 3 0.4us( 170us) 1.7us( 26us)(0.00%) 21021604 100% 0.02% dparent_lock
0% 0us 92162 100% 0% notify_change+0xf8
0.02% 1.7us( 6.8us)(0.00%) 4134972 100% 0.02% sys_read+0xac
0.02% 1.7us( 26us)(0.00%) 16794470 100% 0.02% sys_write+0xac
0.00% 0% 0.4us 1 0.4us( 1.3us) 0us 382 100% 0% fasync_lock
0% 0us 382 100% 0% kill_fasync+0x18
0.00% 0% 0.3us 2 0.3us( 8.3us) 0us 33424 100% 0% gendisk_lock
0% 0us 33424 100% 0% get_gendisk+0x10
1.2% 1.4% 0.8us 5 0.8us( 164us) 3.0us( 116us)(0.01%) 16332191 98.6% 1.4% hash_table_lock
1.4% 3.0us( 116us)(0.01%) 16332191 98.6% 1.4% __get_hash_table+0x58
0.00% 0% 9.8us 2 9.8us( 87us) 0us 4237 100% 0% tasklist_lock
0% 0us 208 100% 0% count_active_tasks+0xc
0% 0us 962 100% 0% exit_notify+0x18
0% 0us 2 100% 0% exit_notify+0xe4
0% 0us 80 100% 0% kill_pg_info+0x20
0% 0us 8 100% 0% session_of_pgrp+0x14
0% 0us 4 100% 0% sys_setpgid+0x3c
0% 0us 2971 100% 0% sys_wait4+0x90
0% 0us 2 100% 0% will_become_orphaned_pgrp+0x14
0.00% 0% 5.8us 1 5.8us( 7.5us) 0us 7 100% 0% udp_hash_lock
0% 0us 7 100% 0% udp_v4_mcast_deliver+0x10
0.00% 0.09% 1.2us 1 1.2us( 6.6us) 8.8us( 12us)(0.00%) 2120 100% 0.09% xtime_lock
0.09% 8.8us( 12us)(0.00%) 2120 100% 0.09% do_gettimeofday+0x14
0% 0us 176 100% 0% copy_files+0x100
0% 0us 2 100% 0% copy_files+0x158
0% 0us 176 100% 0% do_fork+0x37c
0% 0us 1425 100% 0% do_select+0x28
0% 0us 346976 100% 0% ext2_get_branch+0x84
0% 0us 1946607 100% 0% fget+0x1c
0% 0us 125 100% 0% ip_route_input+0x88
0% 0us 12 100% 0% link_path_walk+0x180
0% 0us 221 100% 0% net_rx_action+0x48
0% 0us 1913 100% 0% path_lookup+0x30
0% 0us 364873 100% 0% path_lookup+0xfc
0% 0us 120 100% 0% tcp_v4_rcv+0x1b0
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
RWLOCK WRITES HOLD WAIT (ALL) WAIT (WW)
UTIL CON MEAN( MAX ) MEAN( MAX )( %CPU) MEAN( MAX ) TOTAL NOWAIT SPIN( WW ) NAME
0.44% 0.3us( 184us) 2.1us( 82us)(0.01%) 0.7us( 24us) 59118974 99.6% 0.40%(0.04%) *TOTAL*
0.00% 0% 2.0us( 6.4us) 0us 0us 40 100% 0%( 0%) [0xf70cff64]
0.00% 0% 1.5us( 4.1us) 0us 0us 34 100% 0%( 0%) neigh_periodic_timer__thr+0xa8
0.00% 0% 4.5us( 6.4us) 0us 0us 6 100% 0%( 0%) neigh_update+0x3c
0.00% 0% 0.3us( 0.3us) 0us 0us 2 100% 0%( 0%) [0xf70ebac4]
0.00% 0% 0.3us( 0.3us) 0us 0us 2 100% 0%( 0%) copy_files+0x12c
0.00% 0% 9.2us( 15us) 0us 0us 34 100% 0%( 0%) arp_tbl+0xc4
0.00% 0% 9.2us( 15us) 0us 0us 34 100% 0%( 0%) neigh_periodic_timer__thr+0x20
0.00% 0% 0.8us( 1.4us) 0us 0us 161 100% 0%( 0%) dn_lock
0.00% 0% 0.8us( 1.4us) 0us 0us 161 100% 0%( 0%) fcntl_dirnotify+0xa0
0.00% 2.1% 0.4us( 60us) 2.0us( 27us)(0.00%) 0.3us( 4.0us) 140400 97.9% 1.9%(0.25%) dparent_lock
0.00% 2.1% 0.4us( 60us) 2.0us( 27us)(0.00%) 0.3us( 4.0us) 140400 97.9% 1.9%(0.25%) d_move+0xe0
0.00% 0% 0.6us( 1.1us) 0us 0us 80 100% 0%( 0%) fasync_lock
0.00% 0% 0.6us( 1.1us) 0us 0us 80 100% 0%( 0%) fasync_helper+0x68
1.6% 1.5% 1.0us( 184us) 2.1us( 82us)(0.01%) 0.7us( 24us) 17498541 98.5% 1.3%(0.12%) hash_table_lock
0.01% 4.5% 1.2us( 15us) 3.6us( 19us)(0.00%) 2.6us( 13us) 67341 95.5% 2.6%( 1.9%) hash_page_buffers+0x38
0.26% 1.5% 0.3us( 79us) 2.0us( 79us)(0.00%) 0.5us( 24us) 8706240 98.5% 1.4%(0.15%) remove_from_queues+0x18
1.4% 1.4% 1.6us( 184us) 2.2us( 82us)(0.00%) 0.7us( 12us) 8724960 98.6% 1.3%(0.07%) try_to_free_buffers+0x44
0.00% 0% 3.7us( 22us) 0us 0us 2886 100% 0%( 0%) tasklist_lock
0.00% 0% 0.5us( 3.2us) 0us 0us 962 100% 0%( 0%) do_fork+0x58c
0.00% 0% 9.6us( 22us) 0us 0us 962 100% 0%( 0%) exit_notify+0x1a0
0.00% 0% 0.9us( 4.5us) 0us 0us 962 100% 0%( 0%) release_task+0x40
0.18% 0.00% 9.2us( 42us) 2.4us( 2.4us)(0.00%) 0us 208582 100% 0.00%( 0%) xtime_lock
0.02% 0.00% 1.8us( 13us) 2.4us( 2.4us)(0.00%) 0us 104291 100% 0.00%( 0%) timer_bh+0xc
0.17% 0% 17us( 42us) 0us 0us 104291 100% 0%( 0%) timer_interrupt+0x10
0.00% 0% 0.0us( 5.8us) 0us 0us 720 100% 0%( 0%) expand_fd_array+0x13c
0.00% 0% 0.2us( 12us) 0us 0us 722 100% 0%( 0%) expand_fd_array+0x88
0.01% 0% 0.0us( 17us) 0us 0us 8857528 100% 0%( 0%) ext2_alloc_block+0x18
0.01% 0.00% 0.0us( 7.9us) 2.6us( 1.3us)(0.00%) 1.3us( 1.3us) 5460951 100% 0%(0.00%) ext2_discard_prealloc+0x10
0.01% 0% 0.0us( 16us) 0us 0us 8714248 100% 0%( 0%) ext2_get_block+0x118
0.01% 0% 0.0us( 11us) 0us 0us 8714248 100% 0%( 0%) ext2_get_block+0x274
0.00% 0% 0.0us( 6.7us) 0us 0us 1667643 100% 0%( 0%) ext2_new_block+0x4e4
0.00% 0% 0.0us( 7.3us) 0us 0us 2615352 100% 0%( 0%) fd_install+0x20
0.00% 0% 0.1us( 0.7us) 0us 0us 242 100% 0%( 0%) flush_old_exec+0x244
0.00% 0% 0.1us( 0.1us) 0us 0us 82 100% 0%( 0%) flush_old_exec+0x2ac
0.00% 0% 0.0us( 12us) 0us 0us 2615754 100% 0%( 0%) get_unused_fd+0x24
0.00% 0% 0.0us( 0.1us) 0us 0us 402 100% 0%( 0%) put_unused_fd+0x1c
0.00% 0% 0.0us( 1.5us) 0us 0us 8753 100% 0%( 0%) rt_check_expire__thr+0x64
0.00% 0% 0.1us( 0.7us) 0us 0us 171 100% 0%( 0%) set_close_on_exec+0x1c
0.00% 0% 0.0us( 6.4us) 0us 0us 2611192 100% 0%( 0%) sys_close+0x20
0.00% 0% 0.2us( 3.0us) 0us 0us 240 100% 0%( 0%) sys_dup2+0x2c
_________________________________________________________________________________________________________________________
Number of read locks found=12