Trace number 4390160

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.02 2400.2

General information on the benchmark

NameSubisomorphism/Subisomorphism-m1-SF/
Subisomorphism-F-20.xml
MD5SUM82ee18a9f0b9eb8094027018544c12e6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark233.201
Satisfiable
(Un)Satisfiability was proved
Number of variables270
Number of constraints5395
Number of domains1
Minimum domain size300
Maximum domain size300
Distribution of domain sizes[{"size":300,"count":270}]
Minimum variable degree16
Maximum variable degree224
Distribution of variable degrees[{"degree":16,"count":1},{"degree":17,"count":7},{"degree":18,"count":6},{"degree":19,"count":13},{"degree":20,"count":22},{"degree":21,"count":13},{"degree":23,"count":10},{"degree":24,"count":13},{"degree":25,"count":12},{"degree":26,"count":12},{"degree":27,"count":11},{"degree":28,"count":11},{"degree":29,"count":8},{"degree":30,"count":4},{"degree":31,"count":7},{"degree":32,"count":10},{"degree":33,"count":3},{"degree":34,"count":8},{"degree":35,"count":5},{"degree":36,"count":7},{"degree":37,"count":4},{"degree":38,"count":2},{"degree":39,"count":5},{"degree":40,"count":2},{"degree":41,"count":2},"...",{"degree":69,"count":2}, {"degree":71,"count":1}, {"degree":72,"count":1}, {"degree":77,"count":1}, {"degree":78,"count":1}, {"degree":95,"count":1}, {"degree":97,"count":1}, {"degree":100,"count":2}, {"degree":103,"count":1}, {"degree":105,"count":1}, {"degree":107,"count":1}, {"degree":110,"count":1}, {"degree":111,"count":1}, {"degree":122,"count":1}, {"degree":124,"count":1}, {"degree":131,"count":2}, {"degree":133,"count":1}, {"degree":137,"count":1}, {"degree":142,"count":1}, {"degree":167,"count":1}, {"degree":173,"count":1}, {"degree":183,"count":1}, {"degree":187,"count":1}, {"degree":220,"count":1}, {"degree":224,"count":1}]
Minimum constraint arity1
Maximum constraint arity270
Distribution of constraint arities[{"arity":1,"count":208},{"arity":2,"count":5186},{"arity":270,"count":1}]
Number of extensional constraints5394
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":5394},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.21/0.28	c root propagations     : 32891       
0.21/0.28	c restarts enabled, print stats at every restarts
0.21/0.28	c
0.21/0.28	c
0.21/0.28	c
0.21/0.28	c This is cosoco 2.00 --  
0.21/0.28	c
0.21/0.28	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390160-1568340430.xml 
0.21/0.28	c ========================================[ Problem Statistics ]===========================================
0.21/0.28	c |                                                                                                       
0.21/0.28	c |  Parse time        :         0.12 s 
0.21/0.28	c |
0.21/0.28	c |               Variables: 270
0.21/0.28	c |            Domain Sizes: 300..300
0.21/0.28	c |
0.21/0.28	c |             Constraints: 5395
0.21/0.28	c |                   Arity: 1..270  -- Unary: 208  -- Binary: 5186
0.21/0.28	c | 
0.21/0.28	c |                   Types: 
0.21/0.28	c |                          All Different: 1
0.21/0.28	c |                          Extension: 5186  (nb tuples: 13136..13136) -- (shared: 5344)
0.21/0.28	c |                          Unary: 208
0.21/0.28	c |                          
0.21/0.28	c =========================================================================================================
0.21/0.28	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.51/0.58	c 101            185            541568         526898         266            0              9   12   10    
0.79/0.89	c 211            387            1146486        1084204        266            0              9   12   11    
1.19/1.21	c 332            588            1730600        1632727        266            0              9   12   10    
1.49/1.56	c 465            810            2353025        2262840        266            0              9   11   10    
1.89/1.99	c 611            1066           3098727        3057548        266            0              9   12   10    
2.39/2.43	c 771            1325           3902177        3787179        266            0              9   12   10    
2.89/2.97	c 947            1654           4925627        4681944        266            0              9   12   10    
3.39/3.49	c 1140           1978           5871544        5568689        266            0              8   12   10    
4.00/4.09	c 1352           2333           6969689        6594150        266            0              9   12   10    
4.69/4.72	c 1585           2757           8232368        7762308        266            0              8   12   10    
5.39/5.47	c 1841           3212           9682071        9161933        266            0              9   12   10    
6.39/6.40	c 2122           3831           11524191       10921936       266            0              7   12   10    
7.29/7.35	c 2431           4397           13451531       12606121       266            0              9   12   10    
8.19/8.23	c 2770           4974           15339388       14151631       266            0              9   12   10    
9.19/9.29	c 3142           5632           17507902       16029684       266            0              9   12   10    
10.19/10.28	c 3551           6315           19506716       17915445       266            0              8   12   10    
11.49/11.52	c 4000           7120           22087975       20185095       266            0              7   12   10    
12.59/12.64	c 4493           7934           24341693       22389693       266            0              8   12   10    
14.09/14.16	c 5035           8866           27352633       25276984       266            0              8   12   10    
15.59/15.68	c 5631           9912           30639344       28099542       266            0              9   12   10    
17.28/17.30	c 6286           11079          34133624       31195180       266            0              8   12   10    
19.28/19.30	c 7006           12408          38306642       34925901       266            0              7   12   10    
21.28/21.34	c 7798           13805          42405696       38972432       266            0              7   12   10    
23.28/23.32	c 8669           15295          46453495       42864377       266            0              7   12   10    
25.58/25.67	c 9627           16916          51229442       47419161       266            0              8   12   10    
28.38/28.49	c 10680          18781          57024996       52659216       266            0              8   12   10    
31.28/31.32	c 11838          20729          62702479       58385186       266            0              8   12   10    
34.58/34.69	c 13111          22920          69615425       65204102       266            0              8   12   10    
38.28/38.31	c 14511          25425          77187256       72160463       266            0              7   13   10    
43.09/43.11	c 16051          28741          87292718       80967581       266            0              6   13   10    
47.48/47.53	c 17745          31602          96092405       89910932       266            0              6   12   10    
52.18/52.25	c 19608          34904          105564936      99289815       266            0              6   12   10    
57.78/57.84	c 21657          38732          117308505      109592614      266            0              6   13   10    
64.28/64.36	c 23910          43079          131201021      121198542      266            0              7   13   10    
71.18/71.26	c 26388          47844          145832412      134690365      266            0              6   13   10    
77.88/77.92	c 29113          52486          159384537      147749689      266            0              6   12   10    
85.18/85.25	c 32110          57718          174508866      162272029      266            0              7   12   10    
94.48/94.52	c 35406          64040          194091219      179618551      266            0              6   12   10    
103.09/103.16	c 39031          70311          212060217      195969552      266            0              7   13   10    
115.48/115.57	c 43018          78212          237665363      219354903      266            0              6   14   10    
126.17/126.26	c 47403          86060          261044088      239762039      266            0              7   13   10    
139.57/139.63	c 52226          95563          290424439      265213147      266            0              6   13   11    
155.08/155.14	c 57531          106016         324693275      293872131      266            0              7   14   11    
171.27/171.34	c 63366          117114         358123261      323859585      266            0              6   12   10    
190.27/190.31	c 69784          129451         398038038      359711253      266            0              6   14   10    
211.27/211.32	c 76843          143331         441477104      396297614      266            0              7   13   10    
233.27/233.35	c 84607          158967         489090275      437910796      266            0              7   13   11    
256.26/256.36	c 93147          174376         537016581      481309960      266            0              7   13   10    
288.65/288.71	c 102541         196237         607477320      540379005      266            0              6   13   10    
316.15/316.25	c 112874         215971         666374018      593841798      266            0              5   12   10    
346.65/346.79	c 124240         237329         730383051      651799531      266            0              6   13   10    
382.95/383.08	c 136742         262795         810936783      717451387      266            0              6   13   11    
422.54/422.65	c 150494         290690         897224596      789355519      266            0              6   13   10    
470.65/470.76	c 165621         322348         998469308      875170425      266            0              5   18   10    
517.95/518.04	c 182260         353526         1095568318     965417121      266            0              5   12   10    
571.94/572.02	c 200562         388745         1208405321     1067032006     266            0              5   14   10    
632.22/632.34	c 220694         428048         1331138687     1181267096     266            0              6   13   10    
696.72/696.88	c 242839         470986         1463551148     1305829047     266            0              5   13   10    
768.31/768.46	c 267198         518968         1614630207     1438411563     266            0              5   13   10    
844.11/844.22	c 293992         568725         1768283758     1584786503     266            0              5   13   10    
927.39/927.54	c 323465         625299         1941146101     1739491858     266            0              6   13   10    
1022.89/1023.09	c 355885         693115         2141707251     1925817789     266            0              5   13   10    
1110.99/1111.17	c 391547         753901         2318134821     2092507428     266            0              5   12   10    
1219.37/1219.55	c 430775         825187         2536323673     2304929695     266            0              5   13   10    
1367.27/1367.47	c 473925         921919         2845127172     2584375302     266            0              6   13   10    
1496.66/1496.87	c 521390         1008716        3111607853     2830795981     266            0              5   13   10    
1657.15/1657.31	c 573601         1110827        3439083322     3128815084     266            0              4   13   10    
1828.04/1828.26	c 631033         1224282        3786636721     3442294117     266            0              5   12   10    
2020.63/2020.87	c 694208         1346882        4173120999     3815412683     266            0              4   13   10    
2221.83/2222.01	c 763700         1483648        4592581819     4179856233     266            0              5   13   10    
2400.01/2400.20	
2400.01/2400.20	c *** INTERRUPTED ***
2400.01/2400.20	c restarts              : 70          
2400.01/2400.20	c conflicts             : 824199       (343 /sec)
2400.01/2400.20	c decisions             : 1599826      (667 /sec)
2400.01/2400.20	c propagations          : 4513225154  (1880525 /sec)
2400.01/2400.20	c root propagations     : 32891       
2400.01/2400.20	c filter calls          : 4954581782     (2064425 /sec)
2400.01/2400.20	c useless filter calls  : 4538944604     (91 %)
2400.01/2400.20	c Memory used           : 47.77 MB
2400.01/2400.20	c CPU time              : 2399.98 s
2400.01/2400.20	c real time             : 2400.2 s
2400.01/2400.20	
2400.01/2400.20	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9197 MiB free)
  memory of node 1: 16384 MiB (15376 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390160-1568340430/watcher-4390160-1568340430 -o /tmp/evaluation-result-4390160-1568340430/solver-4390160-1568340430 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node104-1568318532-25085 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390160-1568340430.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29018, runsolver pid=29015

[startup+0.100105 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 29019
/proc/meminfo: memFree=25161924/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=33404 memory=9624 CPUtime=0.1 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 2678 0 0 0 10 0 0 0 20 0 1 0 410300274 34205696 2406 33554432000 4194304 6210612 140730938529600 140730938526136 140683398818789 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 8351 2406 817 493 0 1656 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 33404 KiB
Current children cumulated memory: 9624 KiB

[startup+0.209629 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 29019
/proc/meminfo: memFree=25142208/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25180 CPUtime=0.21 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 6687 0 0 0 21 0 0 0 20 0 1 0 410300274 50081792 6295 33554432000 4194304 6210612 140730938529600 140730938527864 5017232 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6295 820 493 0 5532 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25180 KiB

[startup+0.309692 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 29019
/proc/meminfo: memFree=25142208/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25180 CPUtime=0.31 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 6689 0 0 0 31 0 0 0 20 0 1 0 410300274 50081792 6295 33554432000 4194304 6210612 140730938529600 140730938527864 5017201 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6295 820 493 0 5532 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25180 KiB

[startup+0.700358 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 29019
/proc/meminfo: memFree=25142208/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25180 CPUtime=0.69 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 6698 0 0 0 69 0 0 0 20 0 1 0 410300274 50081792 6295 33554432000 4194304 6210612 140730938529600 140730938527864 5080987 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6295 820 493 0 5532 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25180 KiB

[startup+1.50036 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 29019
/proc/meminfo: memFree=25141916/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25180 CPUtime=1.49 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 6698 0 0 0 149 0 0 0 20 0 1 0 410300274 50081792 6295 33554432000 4194304 6210612 140730938529600 140730938527560 5397215 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6295 820 493 0 5532 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25180 KiB

[startup+3.1101 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29021
/proc/meminfo: memFree=25141156/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25432 CPUtime=3.09 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 12098 0 0 0 309 0 0 0 20 0 1 0 410300274 50081792 6358 33554432000 4194304 6210612 140730938529600 140730938527560 5017201 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6358 862 493 0 5532 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25432 KiB

[startup+6.30035 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29021
/proc/meminfo: memFree=25140992/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=6.29 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 17504 0 0 0 628 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017108 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+12.7003 s]
/proc/loadavg: 2.08 2.03 2.05 4/198 29021
/proc/meminfo: memFree=25141228/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=12.69 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 18842 0 0 0 1268 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5008459 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+25.5004 s]
/proc/loadavg: 2.06 2.03 2.05 4/198 29021
/proc/meminfo: memFree=25141540/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=25.48 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 20497 0 0 0 2547 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017201 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+51.1097 s]
/proc/loadavg: 1.97 2.01 2.04 3/198 29023
/proc/meminfo: memFree=25141128/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=51.09 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 20813 0 0 0 5108 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017050 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+102.3 s]
/proc/loadavg: 2.04 2.03 2.05 4/198 29028
/proc/meminfo: memFree=25140740/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=102.28 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 21129 0 0 0 10227 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017005 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 2.05 4/198 29032
/proc/meminfo: memFree=25140952/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=162.27 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 21447 0 0 0 16226 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017201 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.01 2.05 4/199 29044
/proc/meminfo: memFree=25140684/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=222.27 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 21764 0 0 0 22226 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5017108 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/200 29194
/proc/meminfo: memFree=25143076/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=282.26 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 22081 0 0 0 28225 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5392175 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 29198
/proc/meminfo: memFree=25143392/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=342.25 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 22398 0 0 0 34224 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 29202
/proc/meminfo: memFree=25143544/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=402.24 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 22715 0 0 0 40223 1 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5016899 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 29208
/proc/meminfo: memFree=25143004/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25440 CPUtime=462.25 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 23035 0 0 0 46223 2 0 0 20 0 1 0 410300274 50081792 6360 33554432000 4194304 6210612 140730938529600 140730938527560 5016899 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6360 862 493 0 5532 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25440 KiB


################
# More data... #
################

/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1602.16 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1662.3 s]
/proc/loadavg: 2.46 2.24 2.12 4/199 29498
/proc/meminfo: memFree=25141312/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1662.15 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 29334 0 0 0 166212 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5017104 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1662.15 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1722.3 s]
/proc/loadavg: 2.17 2.20 2.12 4/199 29505
/proc/meminfo: memFree=25141052/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1722.15 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 29640 0 0 0 172212 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5185926 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1782.3 s]
/proc/loadavg: 2.06 2.16 2.11 4/199 29509
/proc/meminfo: memFree=25141160/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1782.15 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 29947 0 0 0 178212 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5016880 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1782.15 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.13 2.11 4/199 29513
/proc/meminfo: memFree=25141224/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1842.14 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 30266 0 0 0 184211 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5017249 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1842.14 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.11 2.10 4/199 29520
/proc/meminfo: memFree=25141864/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1902.14 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 30573 0 0 0 190211 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5389268 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1902.14 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.09 2.09 4/199 29524
/proc/meminfo: memFree=25140688/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=1962.13 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 30880 0 0 0 196210 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5017104 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 1962.13 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.07 2.09 4/199 29533
/proc/meminfo: memFree=25140288/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2022.13 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 31199 0 0 0 202210 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5397215 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2022.13 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.06 2.08 4/199 29539
/proc/meminfo: memFree=25140340/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2082.13 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 31505 0 0 0 208210 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5016914 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2082.13 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.05 2.08 4/199 29543
/proc/meminfo: memFree=25140296/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2142.12 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 31811 0 0 0 214209 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5017104 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2142.12 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.04 2.07 4/199 29547
/proc/meminfo: memFree=25140944/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2202.12 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 32118 0 0 0 220209 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5016909 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2202.12 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2262.3 s]
/proc/loadavg: 2.40 2.13 2.10 4/199 29553
/proc/meminfo: memFree=25140716/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2262.11 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 32437 0 0 0 226208 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5397215 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2262.11 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2322.3 s]
/proc/loadavg: 2.25 2.15 2.11 4/199 29557
/proc/meminfo: memFree=25140740/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2322.11 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 32744 0 0 0 232208 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5079072 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2322.11 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

[startup+2382.3 s]
/proc/loadavg: 2.09 2.12 2.10 3/200 29604
/proc/meminfo: memFree=25137884/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2382.11 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 33051 0 0 0 238208 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5389268 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2382.11 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 1.98 2.10 2.09 4/200 29606
/proc/meminfo: memFree=25138964/32770624 swapFree=66977612/67108860
[pid=29018] ppid=29015 vsize=48908 memory=25444 CPUtime=2400.01 cores=1,3,5,7
/proc/29018/stat : 29018 (cosoco) R 29015 29018 25053 0 -1 4202496 33357 0 0 0 239998 3 0 0 20 0 1 0 410300274 50081792 6361 33554432000 4194304 6210612 140730938529600 140730938527560 5016884 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 41500672 140730938536971 140730938537073 140730938537073 140730938539982 0
/proc/29018/statm: 12227 6361 862 493 0 5532 0
Current children cumulated CPU time: 2400.01 s
Current children cumulated vsize: 48908 KiB
Current children cumulated memory: 25444 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 29018 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.98 s, system=0.036997 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.2
CPU time (s): 2400.02
CPU user time (s): 2399.98
CPU system time (s): 0.036997
CPU usage (%): 99.9924
Max. virtual memory (cumulated for all children) (KiB): 48908
Max. memory (cumulated for all children) (KiB): 25444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.98
system time used= 0.036997
maximum resident set size= 25512
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33408
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 1552


# summary of solver processes directly reported to runsolver:
#   pid: 29018
#   total CPU time (s): 2400.02
#   total CPU user time (s): 2399.98
#   total CPU system time (s): 0.036997

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.6058 second user time and 13.4159 second system time

The end

Launcher Data 

Begin job on node104 at 2019-09-13 02:56:53
IDJOB=4390160
IDBENCH=131293
IDSOLVER=2830
FILE ID=node104/4390160-1568340430
RUNJOBID= node104-1568318532-25085
PBS_JOBID= 21701142
Free space on /tmp= 56572 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Subisomorphism/Subisomorphism-m1-SF/Subisomorphism-F-20.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390160-1568340430/watcher-4390160-1568340430 -o /tmp/evaluation-result-4390160-1568340430/solver-4390160-1568340430 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node104-1568318532-25085 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390160-1568340430.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 82ee18a9f0b9eb8094027018544c12e6
RANDOM SEED=1405106571

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25163732 kB
MemAvailable:   31824884 kB
Buffers:          136280 kB
Cached:          6738532 kB
SwapCached:        31864 kB
Active:          1768320 kB
Inactive:        5146832 kB
Active(anon):       7360 kB
Inactive(anon):    74764 kB
Active(file):    1760960 kB
Inactive(file):  5072068 kB
Unevictable:      107804 kB
Mlocked:          107804 kB
SwapTotal:      67108860 kB
SwapFree:       66977612 kB
Dirty:              3484 kB
Writeback:             0 kB
AnonPages:         46360 kB
Mapped:            45004 kB
Shmem:             32780 kB
Slab:             286332 kB
SReclaimable:     256584 kB
SUnreclaim:        29748 kB
KernelStack:        3808 kB
PageTables:         5440 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     522324 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56568 MiB
End job on node104 at 2019-09-13 03:36:53