系統(tǒng)宕機(jī),請(qǐng)高手幫忙分析下日志

luckyttl

Sep 28 23:18:32 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:18:33 linux-2gcm kernel:
Sep 28 23:18:33 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff80145aa2>{autoremove_wake_function+0}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff8016329c>{__alloc_pages+552} <ffffffff80164a9f>{__do_page_cache_readahead+149}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff801f1cae>{vsnprintf+1361} <ffffffff801609af>{filemap_nopage+323}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff8016b2eb>{__handle_mm_fault+511} <ffffffff801968e4>{d_alloc+355}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff802dc44e>{do_page_fault+965} <ffffffff8013aec9>{__mod_timer+173}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff80277fda>{lock_sock+163} <ffffffff80279139>{sock_setsockopt+1201}
Sep 28 23:18:33 linux-2gcm kernel:        <ffffffff80277ea0>{release_sock+19} <ffffffff8010bc15>{error_exit+0}
Sep 28 23:18:33 linux-2gcm kernel: Mem-info:
Sep 28 23:18:33 linux-2gcm kernel: Node 0 DMA per-cpu:
Sep 28 23:18:33 linux-2gcm kernel: cpu 0 hot: high 0, batch 1 used:0
Sep 28 23:18:33 linux-2gcm kernel: cpu 0 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 1 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 1 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 2 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 2 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 3 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 3 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 4 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 4 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 5 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 5 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 6 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 6 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 7 hot: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: cpu 7 cold: high 0, batch 1 used:0
Sep 28 23:18:35 linux-2gcm kernel: Node 0 DMA32 per-cpu:
Sep 28 23:18:36 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:173
Sep 28 23:18:36 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:21
Sep 28 23:18:36 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:164
Sep 28 23:18:36 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:25
Sep 28 23:18:36 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:160
Sep 28 23:18:36 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:46
Sep 28 23:18:36 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:155
Sep 28 23:18:36 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:22
Sep 28 23:18:36 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:31
Sep 28 23:18:36 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:14
Sep 28 23:18:36 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:182
Sep 28 23:18:36 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:52
Sep 28 23:18:36 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:38
Sep 28 23:18:36 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:40
Sep 28 23:18:37 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:167
Sep 28 23:19:04 linux-2gcm /usr/sbin/cron[1331]: (root) CMD (/home/ica/bin/check_service.sh >> /dev/null)
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:51
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:53
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:175
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:98
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:153
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:126
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:185
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:89
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:33
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:159
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:41
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem per-cpu: empty
Sep 28 23:19:06 linux-2gcm kernel: Free pages:       23312kB (0kB HighMem)
Sep 28 23:19:06 linux-2gcm kernel: Active:700821 inactive:38364 dirty:0 writeback:0 unstable:0 free:5828 slab:70478 mapped:98 pagetables:90071
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA free:12296kB min:20kB low:24kB high:28kB active:0kB inactive:0kB present:11928kB pages_scanned:128870 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 3254 4012 4012
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 free:9548kB min:6564kB low:8204kB high:9844kB active:2454920kB inactive:128kB present:3332660kB pages_scanned:5037471 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 757 757
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal free:1468kB min:1524kB low:1904kB high:2284kB active:348364kB inactive:153328kB present:775680kB pages_scanned:1370879 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA: 8*4kB 5*8kB 4*16kB 6*32kB 3*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12296kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32: 175*4kB 0*8kB 1*16kB 32*32kB 2*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 9548kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal: 27*4kB 6*8kB 4*16kB 9*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1468kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem: empty
Sep 28 23:19:06 linux-2gcm kernel: Swap cache: add 2252450, delete 2252453, find 6919743/7076467, race 293+97
Sep 28 23:19:06 linux-2gcm kernel: Free swap  = 0kB
Sep 28 23:19:06 linux-2gcm kernel: Total swap = 2101160kB
Sep 28 23:19:06 linux-2gcm kernel: Free swap:            0kB
Sep 28 23:19:06 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:19:06 linux-2gcm kernel:
Sep 28 23:19:06 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff8016329c>{__alloc_pages+552}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff80164a9f>{__do_page_cache_readahead+149} <ffffffff802d9b7f>{__wait_on_bit_lock+91}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8015e307>{__lock_page+94} <ffffffff801609af>{filemap_nopage+323}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016b2eb>{__handle_mm_fault+511} <ffffffff802dc44e>{do_page_fault+965}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801734a8>{free_pages_and_swap_cache+115} <ffffffff8016dab9>{unmap_region+278}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016db38>{remove_vma+105} <ffffffff8010bc15>{error_exit+0}
Sep 28 23:19:06 linux-2gcm kernel: Mem-info:
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:173
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:21
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:164
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:160
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:46
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:155
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:22
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:31
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:14
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:182
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:38
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:40
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:167
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:51
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:53
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:175
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:98
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:153
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:126
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:185
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:89
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:33
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:159
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:41
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem per-cpu: empty
Sep 28 23:19:06 linux-2gcm kernel: Free pages:       23312kB (0kB HighMem)
Sep 28 23:19:06 linux-2gcm kernel: Active:700821 inactive:38364 dirty:0 writeback:0 unstable:0 free:5828 slab:70478 mapped:98 pagetables:90071
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA free:12296kB min:20kB low:24kB high:28kB active:0kB inactive:0kB present:11928kB pages_scanned:128870 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 3254 4012 4012
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 free:9548kB min:6564kB low:8204kB high:9844kB active:2454920kB inactive:128kB present:3332660kB pages_scanned:5037735 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 757 757
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal free:1468kB min:1524kB low:1904kB high:2284kB active:348364kB inactive:153328kB present:775680kB pages_scanned:1370879 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA: 8*4kB 5*8kB 4*16kB 6*32kB 3*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12296kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32: 175*4kB 0*8kB 1*16kB 32*32kB 2*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 9548kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal: 27*4kB 6*8kB 4*16kB 9*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1468kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem: empty
Sep 28 23:19:06 linux-2gcm kernel: Swap cache: add 2252450, delete 2252453, find 6919743/7076467, race 293+97
Sep 28 23:19:06 linux-2gcm kernel: Free swap  = 0kB
Sep 28 23:19:06 linux-2gcm kernel: Total swap = 2101160kB
Sep 28 23:19:06 linux-2gcm kernel: Free swap:            0kB
Sep 28 23:19:06 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:19:06 linux-2gcm kernel:
Sep 28 23:19:06 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff80145aa2>{autoremove_wake_function+0}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016329c>{__alloc_pages+552} <ffffffff80164a9f>{__do_page_cache_readahead+149}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff80163332>{__alloc_pages+702} <ffffffff801f07e8>{__up_read+19}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff802dc482>{do_page_fault+1017} <ffffffff801609af>{filemap_nopage+323}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016b2eb>{__handle_mm_fault+511} <ffffffff802dc44e>{do_page_fault+965}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801f221f>{copy_user_generic+63} <ffffffff8019f643>{seq_read+531}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8010bc15>{error_exit+0}
Sep 28 23:19:06 linux-2gcm kernel: Mem-info:
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:173
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:21
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:164
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:160
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:46
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:155
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:22
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:31
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:14
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:182
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:38
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:40
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:167
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:51
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:53
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:175
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:98
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:153
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:126
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:185
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:89
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:33
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:159
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:41
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem per-cpu: empty
Sep 28 23:19:06 linux-2gcm kernel: Free pages:       23312kB (0kB HighMem)
Sep 28 23:19:06 linux-2gcm kernel: Active:700821 inactive:38364 dirty:0 writeback:0 unstable:0 free:5828 slab:70478 mapped:98 pagetables:90071
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA free:12296kB min:20kB low:24kB high:28kB active:0kB inactive:0kB present:11928kB pages_scanned:128870 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 3254 4012 4012
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 free:9548kB min:6564kB low:8204kB high:9844kB active:2454920kB inactive:128kB present:3332660kB pages_scanned:5037966 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 757 757
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal free:1468kB min:1524kB low:1904kB high:2284kB active:348364kB inactive:153328kB present:775680kB pages_scanned:1370879 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA: 8*4kB 5*8kB 4*16kB 6*32kB 3*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12296kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32: 175*4kB 0*8kB 1*16kB 32*32kB 2*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 9548kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal: 27*4kB 6*8kB 4*16kB 9*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1468kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem: empty
Sep 28 23:19:06 linux-2gcm kernel: Swap cache: add 2252450, delete 2252453, find 6919743/7076467, race 293+97
Sep 28 23:19:06 linux-2gcm kernel: Free swap  = 0kB
Sep 28 23:19:06 linux-2gcm kernel: Total swap = 2101160kB
Sep 28 23:19:06 linux-2gcm kernel: Free swap:            0kB
Sep 28 23:19:06 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:19:06 linux-2gcm kernel:
Sep 28 23:19:06 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff8016329c>{__alloc_pages+552}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8012bec3>{__wake_up+56} <ffffffff80164a9f>{__do_page_cache_readahead+149}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801f1ff3>{find_next_bit+85} <ffffffff80129f83>{find_busiest_group+356}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801609af>{filemap_nopage+323} <ffffffff8016b2eb>{__handle_mm_fault+511}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff802dc44e>{do_page_fault+965} <ffffffff80132f16>{do_syslog+410}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff80145aa2>{autoremove_wake_function+0} <ffffffff8010bc15>{error_exit+0}
Sep 28 23:19:06 linux-2gcm kernel: Mem-info:
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:173
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:21
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:164
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:160
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:46
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:155
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:22
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:31
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:14
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:182
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:38
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:40
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:167
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:51
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:53
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:175
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:98
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:57
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:153
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:52
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:126
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:185
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:16
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:89
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:33
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:159
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:41
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem per-cpu: empty
Sep 28 23:19:06 linux-2gcm kernel: Free pages:       23312kB (0kB HighMem)
Sep 28 23:19:06 linux-2gcm kernel: Active:700605 inactive:38612 dirty:0 writeback:0 unstable:0 free:5828 slab:70478 mapped:98 pagetables:90071
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA free:12296kB min:20kB low:24kB high:28kB active:0kB inactive:0kB present:11928kB pages_scanned:128870 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 3254 4012 4012
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 free:9548kB min:6564kB low:8204kB high:9844kB active:2454232kB inactive:944kB present:3332660kB pages_scanned:5039200 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 757 757
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal free:1468kB min:1524kB low:1904kB high:2284kB active:348188kB inactive:153504kB present:775680kB pages_scanned:1370925 all_unreclaimable? yes
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 0 0 0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA: 8*4kB 5*8kB 4*16kB 6*32kB 3*64kB 2*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12296kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32: 175*4kB 0*8kB 1*16kB 32*32kB 2*64kB 0*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 1*4096kB = 9548kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 Normal: 27*4kB 6*8kB 4*16kB 9*32kB 1*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1468kB
Sep 28 23:19:06 linux-2gcm kernel: Node 0 HighMem: empty
Sep 28 23:19:06 linux-2gcm kernel: Swap cache: add 2252450, delete 2252453, find 6919743/7076467, race 293+97
Sep 28 23:19:06 linux-2gcm kernel: Free swap  = 0kB
Sep 28 23:19:06 linux-2gcm kernel: Total swap = 2101160kB
Sep 28 23:19:06 linux-2gcm kernel: Free swap:            0kB
Sep 28 23:19:06 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:19:06 linux-2gcm kernel:
Sep 28 23:19:06 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff80145aa2>{autoremove_wake_function+0}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016329c>{__alloc_pages+552} <ffffffff80164a9f>{__do_page_cache_readahead+149}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff80162ffe>{get_page_from_freelist+853} <ffffffff801609af>{filemap_nopage+323}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8016b2eb>{__handle_mm_fault+511} <ffffffff802dc44e>{do_page_fault+965}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801ef648>{prio_tree_insert+328} <ffffffff8010bc15>{error_exit+0}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801f2e3e>{__clear_user+46} <ffffffff801f2e22>{__clear_user+18}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff801ad174>{padzero+27} <ffffffff801ae566>{load_elf_binary+4016}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8018a2e4>{copy_strings+365} <ffffffff8018a4e6>{search_binary_handler+195}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8018c3e7>{do_execve+420} <ffffffff801099c9>{sys_execve+54}
Sep 28 23:19:06 linux-2gcm kernel:        <ffffffff8010b0f7>{stub_execve+103}
Sep 28 23:19:06 linux-2gcm kernel: Mem-info:
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 4 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 5 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 6 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 hot: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: cpu 7 cold: high 0, batch 1 used:0
Sep 28 23:19:06 linux-2gcm kernel: Node 0 DMA32 per-cpu:
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:173
Sep 28 23:19:06 linux-2gcm kernel: cpu 0 cold: high 62, batch 15 used:21
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 hot: high 186, batch 31 used:164
Sep 28 23:19:06 linux-2gcm kernel: cpu 1 cold: high 62, batch 15 used:25
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 hot: high 186, batch 31 used:160
Sep 28 23:19:06 linux-2gcm kernel: cpu 2 cold: high 62, batch 15 used:46
Sep 28 23:19:06 linux-2gcm kernel: cpu 3 hot: high 186, batch 31 used:155
Sep 28 23:19:07 linux-2gcm kernel: cpu 3 cold: high 62, batch 15 used:22
Sep 28 23:19:07 linux-2gcm kernel: cpu 4 hot: high 186, batch 31 used:31
Sep 28 23:19:07 linux-2gcm kernel: cpu 4 cold: high 62, batch 15 used:14
Sep 28 23:19:07 linux-2gcm kernel: cpu 5 hot: high 186, batch 31 used:182
Sep 28 23:19:07 linux-2gcm kernel: cpu 5 cold: high 62, batch 15 used:52
Sep 28 23:19:07 linux-2gcm kernel: cpu 6 hot: high 186, batch 31 used:38
Sep 28 23:19:08 linux-2gcm kernel: cpu 6 cold: high 62, batch 15 used:40
Sep 28 23:19:08 linux-2gcm kernel: cpu 7 hot: high 186, batch 31 used:167
Sep 28 23:19:08 linux-2gcm kernel: cpu 7 cold: high 62, batch 15 used:51
Sep 28 23:19:09 linux-2gcm kernel: Node 0 Normal per-cpu:
Sep 28 23:19:09 linux-2gcm kernel: cpu 0 hot: high 186, batch 31 used:16

惟吾無為

Sep 28 23:19:06 linux-2gcm kernel: Free swap:            0kB
Sep 28 23:19:06 linux-2gcm kernel: oom-killer: gfp_mask=0x201d2, order=0
Sep 28 23:19:06 linux-2gcm kernel:
Sep 28 23:19:06 linux-2gcm kernel: Call Trace: <ffffffff801613f5>{out_of_memory+93} <ffffffff80145aa2>

內(nèi)存用盡。加swap，加內(nèi)存，查泄漏。

milujite

Sep 28 23:19:06 linux-2gcm kernel: lowmem_reserve[]: 0 3254 4012 4012

Sep 28 23:19:06 linux-2gcm kernel: Free swap  = 0kB

內(nèi)存資源被耗光了。。。swap也沒空間了。查下什么東西資源占用這么高把。