Running 24 clients Throughput 199.76 MB/sec (NB=249.7 MB/sec 1997.6 MBit/sec) Throughput 209.687 MB/sec (NB=262.109 MB/sec 2096.87 MBit/sec) Throughput 204.101 MB/sec (NB=255.127 MB/sec 2041.01 MBit/sec) Throughput 198.814 MB/sec (NB=248.518 MB/sec 1988.14 MBit/sec) Throughput 202.624 MB/sec (NB=253.28 MB/sec 2026.24 MBit/sec) Throughput 173.118 MB/sec (NB=216.397 MB/sec 1731.18 MBit/sec) Throughput 170.384 MB/sec (NB=212.98 MB/sec 1703.84 MBit/sec) Throughput 171.366 MB/sec (NB=214.207 MB/sec 1713.66 MBit/sec) Throughput 153.566 MB/sec (NB=191.957 MB/sec 1535.66 MBit/sec) Throughput 164.748 MB/sec (NB=205.934 MB/sec 1647.48 MBit/sec) ___________________________________________________________________________________________ System: Linux elm3b96.eng 2.4.16 #2 SMP Mon Dec 17 19:06:38 PST 2001 i686 Total counts All (6) CPUs Start time: Mon Dec 17 19:44:32 2001 End time: Mon Dec 17 19:47:36 2001 Delta Time: 183.54 sec. Hash table slots in use: 287. Global read lock slots in use: 999. *************************** Warnings! ****************************** Read Lock table overflowed. The data in this report may be in error due to this. ************************ End of Warnings! ************************** - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - SPINLOCKS HOLD WAIT UTIL CON MEAN( MAX ) MEAN( MAX )(% CPU) TOTAL NOWAIT SPIN RJECT NAME 12.4% 0.9us( 23ms) 7.4us( 21ms)(11.8%) 141864035 87.6% 12.4% 0.00% *TOTAL* 0.00% 0% 0.4us( 0.6us) 0us 2 100% 0% 0% [0xc301d1c4] 0.00% 0% 0.4us( 0.6us) 0us 2 100% 0% 0% link_path_walk+0x6d4 0.00% 0% 0.1us( 0.2us) 0us 47 100% 0% 0% [0xf708c658] 0.00% 0% 0.1us( 0.2us) 0us 47 100% 0% 0% sys_rt_sigprocmask+0x18c 0.00% 0% 0.1us( 0.8us) 0us 264 100% 0% 0% [0xf70fb6c4] 0.00% 0% 0.1us( 0.8us) 0us 264 100% 0% 0% do_fork+0x380 0.00% 0% 1.7us( 2.2us) 0us 24 100% 0% 0% [0xf7a9471c] 0.00% 0% 1.7us( 2.2us) 0us 24 100% 0% 0% unmap_fixup+0xa8 0.00% 0% 0.2us( 1.4us) 0us 861 100% 0% 0% [0xf7ac2f24] 0.00% 0% 0.1us( 0.7us) 0us 264 100% 0% 0% do_fork+0x348 0.00% 0% 0.2us( 1.4us) 0us 597 100% 0% 0% path_init+0xe4 0.00% 0% 1.4us( 5.2us) 0us 734 100% 0% 0% [0xf7b2be2c] 0.00% 0% 1.4us( 5.2us) 0us 734 100% 0% 0% rh_int_timer_do+0x4c 0.00% 0% 4.8us( 8.7us) 0us 46 100% 0% 0% [0xf7b9c0d0] 0.00% 0% 4.8us( 8.7us) 0us 46 100% 0% 0% dev_watchdog+0x14 0.00% 0% 0.5us( 0.5us) 0us 1 100% 0% 0% [0xf7ba8658] 0.00% 0% 0.5us( 0.5us) 0us 1 100% 0% 0% kupdate+0xdc 0.00% 0% 0.1us( 0.2us) 0us 40 100% 0% 0% [0xf7bdbedc] 0.00% 0% 0.1us( 0.1us) 0us 10 100% 0% 0% shmem_delete_inode+0x68 0.00% 0% 0.1us( 0.1us) 0us 10 100% 0% 0% shmem_get_inode+0x1c 0.00% 0% 0.1us( 0.2us) 0us 10 100% 0% 0% shmem_getpage_locked+0x274 0.00% 0% 0.1us( 0.1us) 0us 10 100% 0% 0% shmem_recalc_inode+0x48 0.00% 0% 8.6us( 41us) 0us 539 100% 0% 0% [0xf7bde6f0] 0.00% 0% 8.6us( 41us) 0us 539 100% 0% 0% ahc_linux_queue+0x38 0.00% 0% 1.0us( 4.4us) 0us 183 100% 0% 0% allocator_request_lock 0.00% 0% 1.9us( 4.4us) 0us 50 100% 0% 0% scsi_free+0x1c 0.00% 0% 0.7us( 1.8us) 0us 133 100% 0% 0% scsi_malloc+0x48 0.09% 0.02% 0.2us( 71us) 1.9us( 32us)(0.00%) 901122 100% 0.02% 0% arbitration_lock 0.00% 0% 0.3us( 1.8us) 0us 145 100% 0% 0% deny_write_access+0xc 0.09% 0.02% 0.2us( 71us) 1.9us( 32us)(0.00%) 900977 100% 0.02% 0% get_write_access+0xc 0.03% 0% 1.7us(1253us) 0us 27603 100% 0% 0% bdev_lock 0.03% 0% 1.7us(1253us) 0us 27603 100% 0% 0% bdget+0x34 0.04% 0% 12us( 51us) 0us 6224 100% 0% 0% call_lock 0.04% 0% 12us( 51us) 0us 6224 100% 0% 0% smp_call_function+0x58 0.91% 0.82% 0.7us(5585us) 23us(5608us)(0.04%) 2497630 99.2% 0.82% 0% dcache_lock 0.02% 1.5% 0.2us( 18us) 21us(1752us)(0.00%) 155419 98.5% 1.5% 0% d_alloc+0x144 0.03% 0.35% 0.2us( 7.7us) 44us(4553us)(0.00%) 233290 99.6% 0.35% 0% d_delete+0x10 0.00% 0.12% 0.7us( 4.1us) 4.0us( 8.3us)(0.00%) 5050 99.9% 0.12% 0% d_delete+0x98 0.03% 0.34% 0.1us( 40us) 31us(3264us)(0.00%) 388710 99.7% 0.34% 0% d_instantiate+0x1c 0.04% 0.30% 1.6us( 28us) 16us( 853us)(0.00%) 46800 99.7% 0.30% 0% d_move+0x38 0.01% 0.15% 0.1us( 3.9us) 2.3us( 21us)(0.00%) 155409 99.9% 0.15% 0% d_rehash+0x40 0.00% 0.71% 0.8us( 5.0us) 2.5us( 6.2us)(0.00%) 1680 99.3% 0.71% 0% d_vfs_unhash+0x44 0.54% 0.94% 0.7us( 49us) 25us(5608us)(0.03%) 1393824 99.1% 0.94% 0% dput+0x30 0.00% 0% 0.4us( 3.8us) 0us 110 100% 0% 0% link_path_walk+0x2d8 0.00% 0% 1.5us( 1.7us) 0us 2 100% 0% 0% link_path_walk+0x678 0.01% 6.9% 6.6us(4511us) 4.1us( 20us)(0.00%) 3796 93.1% 6.9% 0% prune_dcache+0x14 0.08% 2.1% 1.4us(5585us) 3.3us( 209us)(0.00%) 106866 97.9% 2.1% 0% prune_dcache+0x150 0.14% 1.2% 38us(3994us) 13us( 422us)(0.00%) 6674 98.8% 1.2% 0% select_parent+0x24 0.00% 0% 1.9us( 10us) 0us 917 100% 0% 0% device_request_lock 0.00% 0% 0.5us( 3.0us) 0us 378 100% 0% 0% __scsi_release_command+0x14 0.00% 0% 2.9us( 10us) 0us 539 100% 0% 0% scsi_allocate_device+0x30 0.00% 0% 2.6us( 16us) 0us 1061 100% 0% 0% emergency_lock 0.00% 0% 2.6us( 16us) 0us 1061 100% 0% 0% bounce_end_io_read+0xb0 1.4% 4.4% 1.0us( 264us) 2.6us( 163us)(0.03%) 2613104 95.6% 4.4% 0% files_lock 0.00% 0% 0.3us( 0.5us) 0us 2 100% 0% 0% check_tty_count+0x10 0.21% 6.5% 0.4us( 34us) 2.6us( 30us)(0.01%) 870858 93.5% 6.5% 0% file_move+0x18 0.25% 4.6% 0.5us( 264us) 2.7us( 163us)(0.01%) 870887 95.4% 4.6% 0% fput+0x80 0.93% 2.2% 2.0us( 75us) 2.6us( 92us)(0.00%) 870887 97.8% 2.2% 0% get_empty_filp+0xc 0.00% 3.4% 1.5us( 4.0us) 1.8us( 2.8us)(0.00%) 470 96.6% 3.4% 0% get_empty_filp+0xdc 0.11% 0.03% 11us(2783us) 0us 19076 100% 0% 0.03% global_bh_lock 0.11% 0.03% 11us(2783us) 0us 19076 100% 0% 0.03% bh_action+0x18 0.09% 0% 8.7us( 22us) 0us 18354 100% 0% 0% i8253_lock 0.09% 0% 8.7us( 22us) 0us 18354 100% 0% 0% timer_interrupt+0x2c 0.03% 0% 2.7us( 7.5us) 0us 18354 100% 0% 0% i8259A_lock 0.03% 0% 2.7us( 7.5us) 0us 18354 100% 0% 0% timer_interrupt+0x90 0.00% 0% 0.9us( 0.9us) 0us 1 100% 0% 0% inet_peer_unused_lock 0.00% 0% 0.9us( 0.9us) 0us 1 100% 0% 0% cleanup_once+0x24 0.39% 0.20% 0.7us( 38us) 1.7us( 21us)(0.00%) 1041682 99.8% 0.20% 0% inode_lock 0.06% 0% 0.5us( 37us) 0us 233356 100% 0% 0% __mark_inode_dirty+0x48 0.16% 0.23% 1.3us( 38us) 1.6us( 9.3us)(0.00%) 233503 99.8% 0.23% 0% get_empty_inode+0x24 0.00% 0% 1.0us( 3.4us) 0us 34 100% 0% 0% get_new_inode+0x34 0.06% 0% 2.0us( 23us) 0us 52543 100% 0% 0% iget4+0x3c 0.03% 0.00% 0.3us( 16us) 1.0us( 1.0us)(0.00%) 233291 100% 0.00% 0% insert_inode_hash+0x44 0.08% 0.53% 0.5us( 36us) 1.7us( 21us)(0.00%) 288911 99.5% 0.53% 0% iput+0x68 0.00% 0% 6.9us( 6.9us) 0us 1 100% 0% 0% sync_unlocked_inodes+0x10 0.00% 0% 1.0us( 2.0us) 0us 43 100% 0% 0% sync_unlocked_inodes+0x10c 0.01% 0.38% 4.1us( 46us) 8.9us( 25us)(0.00%) 4178 99.6% 0.38% 0% io_request_lock 0.00% 0% 0.1us( 0.1us) 0us 2 100% 0% 0% __get_request_wait+0x90 0.00% 0.37% 2.3us( 22us) 7.0us( 14us)(0.00%) 1632 99.6% 0.37% 0% __make_request+0xc8 0.00% 0.53% 7.1us( 18us) 11us( 18us)(0.00%) 378 99.5% 0.53% 0% ahc_linux_isr+0x2ec 0.00% 0.90% 9.7us( 28us) 5.3us( 6.9us)(0.00%) 332 99.1% 0.90% 0% generic_unplug_device+0x10 0.00% 0.56% 10.0us( 46us) 16us( 25us)(0.00%) 539 99.4% 0.56% 0% scsi_dispatch_cmd+0x11c 0.00% 0.26% 0.7us( 3.1us) 4.5us( 4.5us)(0.00%) 378 99.7% 0.26% 0% scsi_finish_command+0x18 0.00% 0% 3.4us( 11us) 0us 378 100% 0% 0% scsi_queue_next_request+0x18 0.00% 0.19% 1.4us( 6.9us) 8.3us( 8.3us)(0.00%) 539 99.8% 0.19% 0% scsi_request_fn+0x31c 23.2% 24.4% 3.6us( 23ms) 15us( 21ms)( 3.8%) 11712397 75.6% 24.4% 0% kernel_flag 0.00% 0% 25us( 25us) 0us 1 100% 0% 0% chrdev_open+0x4c 0.00% 7.7% 0.5us( 1.5us) 13us( 13us)(0.00%) 13 92.3% 7.7% 0% de_put+0x28 0.51% 19.7% 3571us( 23ms) 301us( 11ms)(0.00%) 264 80.3% 19.7% 0% do_exit+0xd8 3.0% 24.6% 24us(1321us) 29us( 21ms)(0.15%) 230880 75.4% 24.6% 0% ext2_delete_inode+0x20 0.52% 27.8% 0.8us( 68us) 12us(8563us)(0.35%) 1154845 72.2% 27.8% 0% ext2_discard_prealloc+0x20 10.7% 29.5% 6.7us(1937us) 15us( 15ms)( 1.2%) 2909375 70.5% 29.5% 0% ext2_get_block+0x54 0.00% 0% 3.3us( 3.3us) 0us 1 100% 0% 0% get_chrfops+0x88 0.82% 26.4% 11us(3272us) 24us( 12ms)(0.08%) 132748 73.6% 26.4% 0% lookup_hash+0x7c 0.11% 22.5% 6.5us( 129us) 15us(8982us)(0.01%) 30722 77.5% 22.5% 0% notify_change+0x50 0.00% 0% 0.9us( 1.0us) 0us 2 100% 0% 0% permission+0x38 0.15% 23.0% 12us( 737us) 31us(5178us)(0.01%) 22651 77.0% 23.0% 0% real_lookup+0x64 0.03% 59.1% 68us(4394us) 33us( 320us)(0.00%) 842 40.9% 59.1% 0% schedule+0x518 0.00% 0% 292us( 292us) 0us 1 100% 0% 0% sync_old_buffers+0x1c 0.00% 0% 9.3us( 19us) 0us 9 100% 0% 0% sys_ioctl+0x4c 0.00% 0% 0.5us( 0.8us) 0us 6 100% 0% 0% sys_llseek+0x88 2.1% 21.5% 0.6us(8991us) 14us(8995us)( 1.9%) 6716400 78.5% 21.5% 0% sys_lseek+0x70 0.62% 21.3% 24us(1071us) 14us(2349us)(0.01%) 46800 78.7% 21.3% 0% sys_rename+0x19c 0.00% 0% 11us( 11us) 0us 1 100% 0% 0% tty_release+0x1c 0.00% 0% 21us( 26us) 0us 12 100% 0% 0% tty_write+0x1c8 3.0% 29.7% 24us(3205us) 11us(3084us)(0.07%) 230641 70.3% 29.7% 0% vfs_create+0x84 0.16% 62.9% 112us( 468us) 17us( 177us)(0.00%) 2650 37.1% 62.9% 0% vfs_mkdir+0x80 0.00% 0% 14us( 34us) 0us 10 100% 0% 0% vfs_readdir+0x68 0.02% 21.2% 15us( 329us) 52us(4699us)(0.00%) 2880 78.8% 21.2% 0% vfs_rmdir+0x188 0.00% 0% 7.9us( 8.6us) 0us 3 100% 0% 0% vfs_statfs+0x4c 1.6% 23.5% 12us( 386us) 13us(3449us)(0.07%) 230640 76.5% 23.5% 0% vfs_unlink+0x108 11.9% 19.4% 0.5us(2071us) 4.7us(2083us)( 3.8%) 45209892 80.6% 19.4% 0% kmap_lock 7.3% 19.9% 0.6us(2071us) 4.7us(2083us)( 1.9%) 22604946 80.1% 19.9% 0% kmap_high+0x10 4.6% 18.9% 0.4us( 372us) 4.7us(2066us)( 1.8%) 22604946 81.1% 18.9% 0% kunmap_high+0xc 0.00% 0% 0.2us( 1.9us) 0us 264 100% 0% 0% lastpid_lock 0.00% 0% 0.2us( 1.9us) 0us 264 100% 0% 0% get_pid+0x20 12.9% 17.6% 1.4us(1932us) 13us(2282us)( 3.6%) 17206964 82.4% 17.6% 0% lru_list_lock 0.96% 9.7% 0.6us( 74us) 6.1us( 868us)(0.16%) 2904740 90.3% 9.7% 0% buffer_insert_inode_data_queue+0x10 0.25% 14.4% 0.2us( 60us) 7.4us(1003us)(0.20%) 2114400 85.6% 14.4% 0% buffer_insert_inode_queue+0x14 0.03% 14.7% 0.2us( 46us) 11us(1186us)(0.03%) 233517 85.3% 14.7% 0% inode_has_buffers+0x10 0.04% 14.6% 0.3us( 38us) 11us(1046us)(0.03%) 233310 85.4% 14.6% 0% invalidate_inode_buffers+0x10 0.00% 0% 0.7us( 0.7us) 0us 1 100% 0% 0% kupdate+0x98 3.9% 22.6% 1.2us(1053us) 14us(2282us)( 1.7%) 5905286 77.4% 22.6% 0% refile_buffer+0xc 2.1% 17.1% 1.4us(1932us) 16us(1241us)(0.72%) 2904730 82.9% 17.1% 0% remove_from_queues+0xc 0.00% 0% 25us( 33us) 0us 10 100% 0% 0% sync_old_buffers+0x64 5.5% 18.6% 3.5us( 219us) 16us(1729us)(0.78%) 2910970 81.4% 18.6% 0% try_to_free_buffers+0x1c 0.00% 0% 0.4us( 3.2us) 0us 528 100% 0% 0% mmlist_lock 0.00% 0% 0.2us( 1.3us) 0us 264 100% 0% 0% copy_mm+0x120 0.00% 0% 0.7us( 3.2us) 0us 264 100% 0% 0% mmput+0x28 0.00% 0% 0.7us( 2.6us) 0us 1055 100% 0% 0% page_uptodate_lock.0 0.00% 0% 0.7us( 2.6us) 0us 1055 100% 0% 0% end_buffer_io_async+0x38 7.2% 9.9% 0.6us( 433us) 2.3us( 737us)(0.46%) 21962046 90.1% 9.9% 0% pagecache_lock 0.15% 10.7% 0.4us( 52us) 2.2us( 375us)(0.02%) 728641 89.3% 10.7% 0% __find_get_page+0x18 2.5% 10.6% 0.5us( 228us) 2.3us( 737us)(0.20%) 9047781 89.4% 10.6% 0% __find_lock_page+0xc 0.00% 0% 1.0us( 1.3us) 0us 10 100% 0% 0% add_to_page_cache+0x18 2.0% 9.5% 1.2us( 96us) 2.4us( 228us)(0.06%) 2903145 90.5% 9.5% 0% add_to_page_cache_unique+0x18 1.1% 10.6% 0.6us( 88us) 2.3us( 100us)(0.07%) 3220966 89.4% 10.6% 0% do_generic_file_read+0x1a4 0.00% 11.1% 1.4us( 5.4us) 2.4us( 22us)(0.00%) 6251 88.9% 11.1% 0% do_generic_file_read+0x370 0.00% 0% 0.1us( 0.4us) 0us 43 100% 0% 0% filemap_fdatasync+0x1c 0.00% 0% 0.1us( 0.3us) 0us 43 100% 0% 0% filemap_fdatawait+0x10 0.01% 10.4% 0.7us( 24us) 2.5us( 42us)(0.00%) 30253 89.6% 10.4% 0% find_or_create_page+0x38 0.03% 10.1% 2.0us( 35us) 2.4us( 25us)(0.00%) 30253 89.9% 10.1% 0% find_or_create_page+0x7c 0.01% 10.7% 0.6us( 5.8us) 3.5us( 47us)(0.00%) 24348 89.3% 10.7% 0% page_cache_read+0x48 1.0% 7.9% 0.7us( 433us) 2.2us( 416us)(0.05%) 2910980 92.1% 7.9% 0% remove_inode_page+0x18 0.00% 0% 0.4us( 1.1us) 0us 10 100% 0% 0% set_page_dirty+0x24 0.07% 13.3% 0.8us( 46us) 2.1us( 66us)(0.00%) 148342 86.7% 13.3% 0% truncate_inode_pages+0x38 0.40% 9.3% 0.3us( 43us) 2.3us( 66us)(0.06%) 2910980 90.7% 9.3% 0% truncate_list_pages+0x1cc 1.8% 2.7% 0.5us( 252us) 1.6us( 264us)(0.02%) 6194509 97.3% 2.7% 0% pagemap_lru_lock 0.24% 4.4% 1.3us( 49us) 1.8us( 170us)(0.00%) 327244 95.6% 4.4% 0% activate_page+0xc 0.97% 4.0% 0.6us( 137us) 1.6us( 240us)(0.02%) 2947965 96.0% 4.0% 0% lru_cache_add+0x1c 0.58% 1.2% 0.4us( 252us) 1.9us( 264us)(0.01%) 2919300 98.8% 1.2% 0% lru_cache_del+0xc 0.01% 0% 0.8us( 34us) 0us 22577 100% 0% 0% rcu_ctrlblk 0.00% 0% 0.7us( 4.8us) 0us 7397 100% 0% 0% rcu_check_callbacks+0xc0 0.01% 0% 0.9us( 34us) 0us 15180 100% 0% 0% rcu_check_quiescent_state+0x50 0.24% 1.0% 6.5us( 29us) 4.7us( 53us)(0.00%) 69200 99.0% 1.0% 0% runqueue_lock 0.04% 1.3% 7.0us( 29us) 4.7us( 30us)(0.00%) 10441 98.7% 1.3% 0% __wake_up+0x5c 0.00% 13.6% 0.3us( 1.5us) 3.0us( 6.9us)(0.00%) 257 86.4% 13.6% 0% deliver_signal+0x48 0.00% 0% 7.7us( 26us) 0us 327 100% 0% 0% process_timeout+0x14 0.00% 61.2% 1.7us( 3.1us) 2.6us( 6.5us)(0.00%) 67 38.8% 61.2% 0% schedule_tail+0x58 0.14% 1.1% 7.3us( 28us) 4.7us( 53us)(0.00%) 35067 98.9% 1.1% 0% schedule+0xa0 0.00% 0.58% 1.5us( 16us) 5.4us( 14us)(0.00%) 1028 99.4% 0.58% 0% schedule+0x264 0.06% 0.38% 5.3us( 22us) 6.1us( 23us)(0.00%) 21476 99.6% 0.38% 0% schedule+0x4d8 0.00% 0.93% 2.4us( 14us) 3.3us( 4.4us)(0.00%) 537 99.1% 0.93% 0% wake_up_process+0x14 0.00% 0% 1.0us( 3.4us) 0us 6 100% 0% 0% sb_lock 0.00% 0% 0.1us( 0.1us) 0us 1 100% 0% 0% drop_super+0x24 0.00% 0% 0.7us( 1.2us) 0us 2 100% 0% 0% sync_supers+0x6c 0.00% 0% 3.4us( 3.4us) 0us 1 100% 0% 0% sync_unlocked_inodes+0x18 0.00% 0% 0.5us( 0.8us) 0us 2 100% 0% 0% sync_unlocked_inodes+0x18c 0.00% 0% 0.3us( 1.6us) 0us 1134 100% 0% 0% scsi_bhqueue_lock 0.00% 0% 0.1us( 1.3us) 0us 756 100% 0% 0% scsi_bottom_half_handler+0x1c 0.00% 0% 0.5us( 1.6us) 0us 378 100% 0% 0% scsi_done+0x3c 0.00% 1.3% 0.7us( 3.7us) 2.1us( 6.7us)(0.00%) 1650 98.7% 1.3% 0% semaphore_lock 0.00% 2.0% 0.2us( 3.0us) 2.2us( 6.7us)(0.00%) 751 98.0% 2.0% 0% __down+0x44 0.00% 0.68% 1.0us( 3.7us) 2.0us( 4.3us)(0.00%) 876 99.3% 0.68% 0% __down+0x78 0.00% 0% 1.1us( 3.0us) 0us 15 100% 0% 0% __down_interruptible+0x48 0.00% 0% 1.2us( 2.5us) 0us 8 100% 0% 0% __down_interruptible+0x88 0.00% 0% 0.9us( 6.3us) 0us 540 100% 0% 0% shm_ids+0x24 0.00% 0% 0.7us( 0.9us) 0us 10 100% 0% 0% ipc_addid+0x94 0.00% 0% 1.5us( 6.3us) 0us 250 100% 0% 0% shm_close+0x54 0.00% 0% 0.1us( 0.2us) 0us 10 100% 0% 0% shm_mmap+0x54 0.00% 0% 0.4us( 2.0us) 0us 240 100% 0% 0% shm_open+0x3c 0.00% 0% 1.4us( 1.6us) 0us 10 100% 0% 0% sys_shmat+0xc0 0.00% 0% 0.2us( 0.6us) 0us 10 100% 0% 0% sys_shmat+0x1e0 0.00% 0% 1.0us( 1.3us) 0us 10 100% 0% 0% sys_shmctl+0x684 0.00% 0% 0.2us( 0.7us) 0us 20 100% 0% 0% shmem_ilock 0.00% 0% 0.2us( 0.7us) 0us 10 100% 0% 0% shmem_delete_inode+0x38 0.00% 0% 0.1us( 0.1us) 0us 10 100% 0% 0% shmem_get_inode+0x154 0.00% 0% 0.7us( 0.7us) 0us 1 100% 0% 0% swaplock 0.00% 0% 0.7us( 0.7us) 0us 1 100% 0% 0% si_swapinfo+0x18 0.02% 0.00% 1.5us( 11us) 2.6us( 2.6us)(0.00%) 22335 100% 0.00% 0% timerlist_lock 0.00% 0.06% 1.1us( 4.9us) 2.6us( 2.6us)(0.00%) 1607 100% 0.06% 0% add_timer+0x10 0.00% 0% 0.1us( 1.8us) 0us 378 100% 0% 0% del_timer+0x14 0.00% 0% 0.7us( 3.9us) 0us 598 100% 0% 0% del_timer_sync+0x1c 0.00% 0% 1.4us( 4.0us) 0us 165 100% 0% 0% mod_timer+0x18 0.02% 0% 1.6us( 11us) 0us 18354 100% 0% 0% timer_bh+0xcc 0.00% 0% 0.2us( 3.0us) 0us 1233 100% 0% 0% timer_bh+0x254 0.00% 0% 5.3us( 8.3us) 0us 23 100% 0% 0% tlbstate_lock 0.00% 0% 5.3us( 8.3us) 0us 23 100% 0% 0% flush_tlb_others+0x4c 0.00% 0.07% 0.2us( 2.2us) 1.3us( 1.3us)(0.00%) 1339 100% 0.07% 0% tqueue_lock 0.00% 0.15% 0.1us( 2.2us) 1.3us( 1.3us)(0.00%) 670 99.9% 0.15% 0% __run_task_queue+0x14 0.00% 0% 0.3us( 1.1us) 0us 324 100% 0% 0% batch_entropy_store+0x7c 0.00% 0% 0.1us( 0.8us) 0us 330 100% 0% 0% generic_plug_device+0x34 0.00% 0% 0.3us( 0.5us) 0us 15 100% 0% 0% rs_sched_event+0x34 2.1% 1.9% 0.6us( 135us) 2.5us( 100us)(0.02%) 5850605 98.1% 1.9% 0% unused_list_lock 0.97% 2.8% 0.6us( 77us) 2.7us( 100us)(0.02%) 2939635 97.2% 2.8% 0% get_unused_buffer_head+0x8 1.1% 0.96% 0.7us( 135us) 2.1us( 75us)(0.01%) 2910970 99.0% 0.96% 0% try_to_free_buffers+0x54 1.3% 2.4% 0.8us( 18us) 2.2us( 22us)(0.01%) 2921086 97.6% 2.4% 0% __free_pages_ok+0xbc 0.68% 0.00% 0.4us( 38us) 1.5us( 3.1us)(0.00%) 2931468 100% 0.00% 0% __wake_up+0x24 0.00% 0% 0.1us( 2.8us) 0us 9803 100% 0% 0% add_wait_queue+0x10 0.00% 2.4% 0.2us( 2.8us) 5.4us( 12us)(0.00%) 847 97.6% 2.4% 0% add_wait_queue_exclusive+0x10 0.00% 0% 8.8us( 35us) 0us 756 100% 0% 0% ahc_linux_isr+0x24 0.00% 0% 1.5us( 2.5us) 0us 26 100% 0% 0% change_protection+0x34 0.00% 0% 28us( 70us) 0us 288 100% 0% 0% clear_page_tables+0x1c 0.00% 0% 0.1us( 1.2us) 0us 2202 100% 0% 0% copy_mm+0x1e8 0.01% 0% 3.5us( 68us) 0us 3260 100% 0% 0% copy_mm+0x230 0.01% 0% 3.0us( 68us) 0us 3260 100% 0% 0% copy_page_range+0x100 0.02% 0.00% 0.3us( 19us) 1.9us( 2.7us)(0.00%) 155419 100% 0.00% 0% d_alloc+0x118 0.00% 0% 0.2us( 3.2us) 0us 5050 100% 0% 0% d_delete+0xa0 1.1% 0.14% 0.2us( 74us) 1.7us( 38us)(0.00%) 12559460 99.9% 0.14% 0% d_lookup+0xec 0.00% 0% 0.2us( 9.0us) 0us 46800 100% 0% 0% d_move+0x60 0.00% 0.10% 0.2us( 3.1us) 1.4us( 2.9us)(0.00%) 2880 99.9% 0.10% 0% d_vfs_unhash+0x14 0.00% 0% 0.1us( 2.6us) 0us 1680 100% 0% 0% d_vfs_unhash+0x4c 0.01% 0% 1.0us( 6.5us) 0us 18749 100% 0% 0% do_IRQ+0x40 0.00% 0% 0.2us( 4.2us) 0us 18749 100% 0% 0% do_IRQ+0xc0 0.00% 0% 2.6us( 13us) 0us 2053 100% 0% 0% do_anonymous_page+0xb4 0.00% 0% 0.2us( 0.5us) 0us 46 100% 0% 0% do_brk+0x1d4 0.00% 0% 0.1us( 0.1us) 0us 264 100% 0% 0% do_exit+0x124 0.00% 0% 0.5us( 2.8us) 0us 264 100% 0% 0% do_exit+0x84 0.00% 0% 0.1us( 2.3us) 0us 264 100% 0% 0% do_exit+0xf4 0.00% 0% 0.9us( 2.5us) 0us 314 100% 0% 0% do_mmap_pgoff+0x40c 0.00% 0% 1.1us( 11us) 0us 714 100% 0% 0% do_mmap_pgoff+0x418 0.00% 0% 0.2us( 0.2us) 0us 74 100% 0% 0% do_munmap+0x1b8 0.00% 0% 1.1us( 4.4us) 0us 450 100% 0% 0% do_munmap+0xe4 0.00% 0% 0.2us( 2.9us) 0us 10375 100% 0% 0% do_no_page+0x1ac 0.00% 0% 0.2us( 1.3us) 0us 277 100% 0% 0% do_page_fault+0x128 0.00% 0% 0.4us( 0.8us) 0us 10 100% 0% 0% do_pipe+0x100 0.00% 0% 1.1us( 5.6us) 0us 447 100% 0% 0% do_sigaction+0x58 0.00% 0% 0.8us( 1.7us) 0us 27 100% 0% 0% do_sigaction+0xd8 0.00% 0% 6.2us( 20us) 0us 270 100% 0% 0% do_signal+0x54 0.01% 0% 2.8us( 71us) 0us 6073 100% 0% 0% do_wp_page+0x204 0.19% 0% 0.3us( 31us) 0us 1393824 100% 0% 0% dput+0x5c 0.00% 0% 0.2us( 2.1us) 0us 288 100% 0% 0% exit_mmap+0x18 0.00% 0.04% 0.3us( 2.5us) 2.9us( 2.9us)(0.00%) 2492 100% 0.04% 0% exit_mmap+0x88 0.00% 0% 1.8us( 2.7us) 0us 264 100% 0% 0% exit_sighand+0x18 0.28% 0.01% 30us( 130us) 15us( 27us)(0.00%) 17462 100% 0.01% 0% free_block+0x1c 0.01% 0% 0.7us( 13us) 0us 22102 100% 0% 0% handle_mm_fault+0x34 0.00% 0% 0.4us( 1.6us) 0us 270 100% 0% 0% handle_signal+0xb0 0.00% 0% 1.7us( 3.3us) 0us 24 100% 0% 0% insert_vm_struct+0x60 0.18% 0.41% 13us( 114us) 9.2us( 30us)(0.00%) 25612 99.6% 0.41% 0% kmem_cache_alloc_batch+0x20 0.00% 0.67% 0.2us( 2.4us) 3.0us( 6.3us)(0.00%) 4659 99.3% 0.67% 0% kmem_cache_grow+0x1d4 0.00% 0.26% 0.7us( 3.4us) 3.5us( 7.6us)(0.00%) 4659 99.7% 0.26% 0% kmem_cache_grow+0x80 0.00% 0% 0.2us( 0.8us) 0us 110 100% 0% 0% link_path_walk+0x334 0.00% 0% 1.9us( 2.9us) 0us 26 100% 0% 0% mprotect_fixup+0x2a8 0.00% 0% 0.7us( 1.0us) 0us 26 100% 0% 0% mprotect_fixup+0x2b4 0.27% 0.65% 0.2us( 53us) 1.6us( 40us)(0.00%) 2735558 99.4% 0.65% 0% path_init+0x150 0.00% 0% 0.6us( 1.3us) 0us 96 100% 0% 0% proc_pid_stat+0x64 0.02% 0.00% 0.2us( 23us) 3.1us( 3.3us)(0.00%) 184087 100% 0.00% 0% prune_dcache+0x38 0.00% 0% 2.6us( 24us) 0us 95 100% 0% 0% pte_alloc+0x8c 0.00% 0% 2.1us( 3.3us) 0us 24 100% 0% 0% put_dirty_page+0x3c 0.00% 0.74% 0.4us( 2.8us) 0.8us( 1.2us)(0.00%) 269 99.3% 0.74% 0% release_task+0x3c 0.00% 0.44% 0.3us( 4.2us) 6.2us( 23us)(0.00%) 10649 99.6% 0.44% 0% remove_wait_queue+0x10 3.6% 8.6% 2.3us( 24us) 3.2us( 29us)(0.07%) 2954471 91.4% 8.6% 0% rmqueue+0x28 0.08% 0% 4.5us( 103us) 0us 33633 100% 0% 0% schedule+0x488 0.00% 0% 1.6us( 11us) 0us 264 100% 0% 0% schedule_tail+0x20 0.03% 0.00% 0.1us( 26us) 1.5us( 2.5us)(0.00%) 323896 100% 0.00% 0% select_parent+0x50 0.00% 0% 4.3us( 31us) 0us 542 100% 0% 0% send_sig_info+0x4c 0.00% 0% 0.9us( 1.1us) 0us 10 100% 0% 0% shmem_getpage_locked+0xd4 0.00% 0% 3.0us( 4.8us) 0us 20 100% 0% 0% shmem_truncate+0x38 0.00% 0% 0.3us( 2.4us) 0us 507 100% 0% 0% sys_rt_sigprocmask+0x98 0.00% 0% 0.4us( 1.8us) 0us 270 100% 0% 0% sys_sigreturn+0x84 0.00% 0% 0.5us( 1.0us) 0us 96 100% 0% 0% task_dumpable+0x18 0.00% 0% 0.9us( 1.0us) 0us 24 100% 0% 0% unmap_fixup+0xb8 0.00% 0% 0.1us( 0.5us) 0us 53 100% 0% 0% vma_merge+0x54 0.00% 0% 0.2us( 36us) 0us 30722 100% 0% 0% vmtruncate+0x50 0.03% 0% 14us( 155us) 0us 4094 100% 0% 0% zap_page_range+0x48 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - RWLOCK READS HOLD MAX RDR BUSY PERIOD WAIT UTIL CON MEAN RDRS MEAN( MAX ) MEAN( MAX )( %CPU) TOTAL NOWAIT SPIN NAME 0.95% 3.4us(1929us)(0.04%) 14206117 99.0% 0.95% *TOTAL* 0.00% 0% 1.9us 1 1.9us( 23us) 0us 9 100% 0% [0xf7771c84] 0% 0us 9 100% 0% do_fcntl+0x104 0.00% 0% 0.5us 1 0.5us( 1.1us) 0us 26 100% 0% binfmt_lock 0% 0us 25 100% 0% search_binary_handler+0x38 0% 0us 1 100% 0% search_binary_handler+0xdc 0.00% 0% 0.8us 1 0.8us( 0.8us) 0us 1 100% 0% chrdevs_lock 0% 0us 1 100% 0% get_chrfops+0x28 2.3% 2.5% 0.7us 4 0.8us( 148us) 3.4us(1929us)(0.04%) 5410760 97.5% 2.5% hash_table_lock 2.5% 3.4us(1929us)(0.04%) 5410760 97.5% 2.5% get_hash_table+0x60 0.02% 0% 19.7us 3 20us( 225us) 0us 2278 100% 0% tasklist_lock 0% 0us 36 100% 0% count_active_tasks+0xc 0% 0us 264 100% 0% exit_notify+0x1c 0% 0us 2 100% 0% exit_notify+0xd0 0% 0us 8 100% 0% get_pid_list+0x14 0% 0us 10 100% 0% kill_pg_info+0x20 0% 0us 2 100% 0% kill_something_info+0xc8 0% 0us 96 100% 0% proc_pid_lookup+0x11c 0% 0us 96 100% 0% proc_pid_stat+0x134 0% 0us 1028 100% 0% schedule+0x218 0% 0us 6 100% 0% session_of_pgrp+0x14 0% 0us 4 100% 0% sys_setpgid+0x3c 0% 0us 724 100% 0% sys_wait4+0x8c 0% 0us 2 100% 0% will_become_orphaned_pgrp+0x14 0.00% 0% 0.7us 1 0.7us( 1.1us) 0us 43 100% 0% xtime_lock 0% 0us 43 100% 0% do_gettimeofday+0x14 0% 0us 120 100% 0% copy_files+0x100 0% 0us 24 100% 0% copy_files+0x158 0% 0us 120 100% 0% do_fork+0x324 0% 0us 220 100% 0% do_select+0x24 0% 0us 7401659 100% 0% fget+0x1c 0% 0us 1390571 100% 0% path_init+0x124 0% 0us 286 100% 0% path_init+0x38 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - RWLOCK WRITES HOLD WAIT (ALL) WAIT (WW) UTIL CON MEAN( MAX ) MEAN( MAX )( %CPU) MEAN( MAX ) TOTAL NOWAIT SPIN( WW ) NAME 1.7% 1.1us( 216us) 2.7us( 55us)(0.04%) 1.1us( 15us) 8494994 98.3% 1.3%(0.38%) *TOTAL* 0% 0% 0us 0us 6 100% 0%( 0%) [0xf74e3f64] 0% 0% 0us 0us 6 100% 0%( 0%) neigh_periodic_timer__thr+0xa8 0.00% 0% 0.3us( 1.4us) 0us 0us 28 100% 0%( 0%) [0xf7771c84] 0.00% 0% 0.2us( 0.3us) 0us 0us 10 100% 0%( 0%) do_pipe+0x180 0.00% 0% 0.1us( 0.1us) 0us 0us 10 100% 0%( 0%) do_pipe+0x1b0 0.00% 0% 0.4us( 0.6us) 0us 0us 3 100% 0%( 0%) dupfd+0x50 0.00% 0% 0.1us( 0.1us) 0us 0us 2 100% 0%( 0%) flush_old_exec+0x29c 0.00% 0% 1.0us( 1.4us) 0us 0us 3 100% 0%( 0%) locate_fd+0x14 0% 0% 0us 0us 1 100% 0%( 0%) [0xf7aa29b4] 0% 0% 0us 0us 1 100% 0%( 0%) rt_intern_hash+0x64 0% 0% 0us 0us 6 100% 0%( 0%) arp_tbl+0xc4 0% 0% 0us 0us 6 100% 0%( 0%) neigh_periodic_timer__thr+0x20 0.00% 0% 0.8us( 1.4us) 0us 0us 13 100% 0%( 0%) dn_lock 0.00% 0% 0.8us( 1.4us) 0us 0us 13 100% 0%( 0%) fcntl_dirnotify+0x90 0.00% 0% 0.4us( 0.4us) 0us 0us 1 100% 0%( 0%) fasync_lock 0.00% 0% 0.4us( 0.4us) 0us 0us 1 100% 0%( 0%) fasync_helper+0x68 4.5% 2.5% 1.4us( 216us) 2.7us( 55us)(0.04%) 1.1us( 15us) 5843303 97.5% 1.9%(0.56%) hash_table_lock 0.02% 1.9% 1.5us( 14us) 7.2us( 15us)(0.00%) 3.6us( 15us) 27603 98.1% 0.00%( 1.9%) hash_page_buffers+0x48 0.52% 2.5% 0.3us( 54us) 2.7us( 53us)(0.02%) 1.1us( 12us) 2904730 97.5% 2.0%(0.58%) remove_from_queues+0x18 3.9% 2.4% 2.5us( 216us) 2.6us( 55us)(0.02%) 1.0us( 11us) 2910970 97.6% 1.9%(0.53%) try_to_free_buffers+0x28 0.00% 0% 4.4us( 17us) 0us 0us 792 100% 0%( 0%) tasklist_lock 0.00% 0% 1.0us( 3.1us) 0us 0us 264 100% 0%( 0%) do_fork+0x530 0.00% 0% 11us( 17us) 0us 0us 264 100% 0%( 0%) exit_notify+0x190 0.00% 0% 1.7us( 4.9us) 0us 0us 264 100% 0%( 0%) release_task+0x7c 0.19% 0% 9.3us( 42us) 0us 0us 36708 100% 0%( 0%) xtime_lock 0.02% 0% 2.2us( 13us) 0us 0us 18354 100% 0%( 0%) timer_bh+0xc 0.17% 0% 17us( 42us) 0us 0us 18354 100% 0%( 0%) timer_interrupt+0x10 0.00% 0% 0.1us( 1.0us) 0us 0us 24 100% 0%( 0%) copy_files+0x12c 0.00% 0% 0.1us( 0.2us) 0us 0us 6 100% 0%( 0%) do_fcntl+0x140 0.00% 0% 0.2us( 1.5us) 0us 0us 240 100% 0%( 0%) expand_fd_array+0x13c 0.00% 0% 2.6us( 14us) 0us 0us 264 100% 0%( 0%) expand_fd_array+0x88 0.00% 0% 0.3us( 1.0us) 0us 0us 24 100% 0%( 0%) flush_old_exec+0x22c 0.10% 0% 0.2us( 47us) 0us 0us 870898 100% 0%( 0%) get_unused_fd+0x24 0.00% 0% 0.1us( 0.1us) 0us 0us 24 100% 0%( 0%) load_elf_binary+0x18c 0.00% 0% 0.1us( 1.3us) 0us 0us 2507 100% 0%( 0%) rt_check_expire__thr+0x64 0.06% 0% 0.1us( 106us) 0us 0us 869258 100% 0%( 0%) sys_close+0x1c 0.00% 0% 0.6us( 4.1us) 0us 0us 37 100% 0%( 0%) sys_dup2+0x2c 0.04% 0% 0.1us( 21us) 0us 0us 870808 100% 0%( 0%) sys_open+0x60 0.00% 0% 0.1us( 0.2us) 0us 0us 46 100% 0%( 0%) sys_open+0xa8 _________________________________________________________________________________________________________________________ Number of read locks found=6