Trace number 4299719

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2519.76 2520.01

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-10-11_c18.xml
MD5SUM6eb53458083bb5bfd537601a03885fcf
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables110
Number of constraints21
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":110}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":110}]
Minimum constraint arity10
Maximum constraint arity11
Distribution of constraint arities[{"arity":10,"count":11},{"arity":11,"count":10}]
Number of extensional constraints21
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":21}]
Optimization problemNO
Type of objective

Solver Data 

2.09/2.19	c root propagations     : 0           
2.09/2.19	c restarts enabled, print stats at every restarts
2.09/2.19	c
2.09/2.19	c
2.09/2.19	c
2.09/2.19	c This is cosoco 1.12 --  
2.09/2.19	c
2.09/2.19	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4299719-1532817721.xml 
2.09/2.19	c ========================================[ Problem Statistics ]===========================================
2.09/2.19	c |                                                                                                       
2.09/2.19	c |  Parse time        :         2.08 s 
2.09/2.19	c |
2.09/2.19	c |               Variables: 110
2.09/2.19	c |            Domain Sizes: 26..26
2.09/2.19	c |
2.09/2.19	c |             Constraints: 21
2.09/2.19	c |                   Arity: 10..11
2.09/2.19	c | 
2.09/2.19	c |                   Types: 
2.09/2.19	c |                          Extension: 21  (nb tuples: 99333..104909) -- (shared: 19)
2.09/2.19	c |                          
2.09/2.19	c =========================================================================================================
2.09/2.19	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
2.79/2.81	c 101            177            8523           119750         0              0              24   32   27   
4.00/4.06	c 211            386            17331          264373         0              0              22   31   23   
5.68/5.73	c 332            623            26520          418519         0              0              21   31   23   
7.99/8.04	c 465            902            36744          586455         0              0              23   29   24   
9.59/9.68	c 611            1164           50385          784385         0              0              22   30   23   
10.99/11.03	c 771            1454           60667          956551         0              0              22   31   27   
12.68/12.71	c 947            1918           77413          1185591        0              0              22   39   31   
14.99/15.06	c 1140           2365           93495          1442479        0              0              17   32   25   
17.38/17.50	c 1352           2807           115188         1721916        0              0              24   32   26   
19.48/19.59	c 1585           3393           135413         2012960        0              0              22   34   27   
21.98/22.03	c 1841           3811           152573         2324256        0              0              22   31   23   
25.48/25.55	c 2122           4739           177826         2747890        0              0              15   33   24   
27.18/27.24	c 2431           5580           209389         3100351        0              0              23   35   30   
29.48/29.55	c 2770           6287           235501         3485161        0              0              22   32   26   
32.28/32.37	c 3142           7145           263473         3906864        0              0              22   33   27   
35.28/35.32	c 3551           7831           294565         4416466        0              0              22   31   25   
38.58/38.68	c 4000           8825           338975         5027178        0              0              21   32   25   
42.28/42.32	c 4493           10232          391690         5691342        0              0              22   33   28   
45.38/45.42	c 5035           11640          443712         6319410        0              0              22   39   30   
50.28/50.35	c 5631           12963          492072         7121315        0              0              21   34   26   
53.28/53.32	c 6286           14608          562598         7971344        0              0              22   41   31   
60.58/60.68	c 7006           17015          634550         8875071        0              0              16   32   26   
64.67/64.79	c 7798           18874          711676         9855243        0              0              23   39   30   
69.98/70.03	c 8669           20885          797904         10917462       0              0              22   36   28   
75.67/75.75	c 9627           23246          886134         12162800       0              0              21   40   30   
80.77/80.80	c 10680          25991          984817         13355977       0              0              23   34   30   
94.67/94.75	c 11838          28404          1077704        14748616       0              0              14   32   23   
101.67/101.77	c 13111          31439          1191385        16176472       0              0              21   35   28   
113.67/113.72	c 14511          34408          1309925        18003352       0              0              14   32   24   
137.07/137.13	c 16051          38577          1446340        19889815       0              0              14   32   23   
152.56/152.66	c 17745          42148          1584394        22104213       0              0              22   35   26   
166.07/166.12	c 19608          46610          1737304        24310306       0              0              16   33   27   
184.46/184.59	c 21657          50681          1894966        27018410       0              0              21   34   25   
195.76/195.85	c 23910          56765          2067670        29250188       0              0              14   33   29   
214.96/215.07	c 26388          63634          2305439        32300912       0              0              17   33   27   
241.65/241.74	c 29113          70653          2568292        36340383       0              0              14   31   24   
271.55/271.62	c 32110          77918          2813806        40202197       0              0              15   34   24   
286.85/286.98	c 35406          85964          3127736        44104232       0              0              22   38   30   
301.55/301.61	c 39031          94781          3474191        48267431       0              0              22   41   31   
338.14/338.20	c 43018          102303         3821682        53473965       0              0              22   33   25   
370.95/371.10	c 47403          113118         4147572        58794024       0              0              15   32   23   
416.84/416.99	c 52226          124348         4609608        65276368       0              0              22   36   27   
452.83/452.97	c 57531          138227         5114513        71729909       0              0              21   34   28   
486.53/486.69	c 63366          153586         5667177        78929913       0              0              14   39   28   
584.02/584.13	c 69784          171034         6249517        87478432       0              0              12   33   23   
640.62/640.79	c 76843          192117         6852756        95187247       0              0              15   34   29   
703.11/703.21	c 84607          208167         7522532        104536598      0              0              16   35   26   
803.60/803.71	c 93147          224489         8174607        115470482      0              0              14   33   24   
857.70/857.88	c 102541         247424         9139620        127110547      0              0              21   34   28   
924.39/924.51	c 112874         270628         10087626       139343307      0              0              16   35   27   
981.08/981.26	c 124240         296111         11023441       153189169      0              0              15   39   28   
1043.27/1043.46	c 136742         325012         12098313       168859630      0              0              15   38   27   
1173.97/1174.18	c 150494         358724         13343043       186045140      0              0              14   36   28   
1239.56/1239.73	c 165621         391373         14709620       203365793      0              0              19   40   30   
1386.24/1386.46	c 182260         434198         16212648       222947591      0              0              15   34   27   
1501.23/1501.41	c 200562         483339         17802741       243867274      0              0              13   41   30   
1684.61/1684.80	c 220694         523859         19527020       269435378      0              0              17   36   27   
1816.60/1816.87	c 242839         574756         21450303       295931557      0              0              22   45   29   
2024.68/2024.94	c 267198         633401         23630853       326152834      0              0              16   41   29   
2142.78/2143.06	c 293992         691994         25700508       354896434      0              0              15   41   31   
2437.95/2438.24	c 323465         749711         27926682       390659222      0              0              15   37   25   
2519.75/2520.01	
2519.75/2520.01	c *** INTERRUPTED ***
2519.75/2520.01	c restarts              : 61          
2519.75/2520.01	c conflicts             : 332113       (132 /sec)
2519.75/2520.01	c decisions             : 772061       (306 /sec)
2519.75/2520.01	c propagations          : 402301412   (159665 /sec)
2519.75/2520.01	c root propagations     : 0           
2519.75/2520.01	c filter calls          : 28670472       (11379 /sec)
2519.75/2520.01	c useless filter calls  : 6570746        (22 %)
2519.75/2520.01	c Memory used           : 58.51 MB
2519.75/2520.01	c CPU time              : 2519.67 s
2519.75/2520.01	
2519.75/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10345 MiB free)
  memory of node 1: 16384 MiB (15790 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299719-1532817721/watcher-4299719-1532817721 -o /tmp/evaluation-result-4299719-1532817721/solver-4299719-1532817721 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532812129-2125 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4299719-1532817721.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=2683, runsolver pid=2680

[startup+0.100105 s]*
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26761672/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=28224 memory=4256 CPUtime=0.1 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 1304 0 0 0 10 0 0 0 20 0 1 0 99335274 28901376 1064 33554432000 4194304 6142532 140730635602272 140730635598904 140182766558181 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 7056 1064 781 476 0 378 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28224 KiB
Current children cumulated memory: 4256 KiB

[startup+0.20945 s]*
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26760928/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=29268 memory=5220 CPUtime=0.21 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 1628 0 0 0 21 0 0 0 20 0 1 0 99335274 29970432 1305 33554432000 4194304 6142532 140730635602272 140730635598904 140182766558181 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 7317 1305 781 476 0 639 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29268 KiB
Current children cumulated memory: 5220 KiB

[startup+0.308872 s]*
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26760184/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=29928 memory=6012 CPUtime=0.31 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 1837 0 0 0 31 0 0 0 20 0 1 0 99335274 30646272 1503 33554432000 4194304 6142532 140730635602272 140730635598920 5800101 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 7482 1503 781 476 0 804 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 29928 KiB
Current children cumulated memory: 6012 KiB

[startup+0.700232 s]
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26758324/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=34476 memory=9184 CPUtime=0.69 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 3197 0 0 0 69 0 0 0 20 0 1 0 99335274 35303424 2296 33554432000 4194304 6142532 140730635602272 140730635598920 5801150 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 8619 2296 781 476 0 1941 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 34476 KiB
Current children cumulated memory: 9184 KiB

[startup+1.50024 s]
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26754192/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=47984 memory=23964 CPUtime=1.49 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 7843 0 0 0 148 1 0 0 20 0 1 0 99335274 49135616 5991 33554432000 4194304 6142532 140730635602272 140730635598920 5801870 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 11996 5991 791 476 0 5318 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 47984 KiB
Current children cumulated memory: 23964 KiB

[startup+3.10961 s]
/proc/loadavg: 2.05 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26730880/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=35724 CPUtime=3.1 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 17001 0 0 0 308 2 0 0 20 0 1 0 99335274 61345792 8931 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 8931 834 476 0 8299 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 35724 KiB

[startup+6.30032 s]
/proc/loadavg: 2.04 2.06 2.05 3/189 2684
/proc/meminfo: memFree=26730132/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=35724 CPUtime=6.28 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 26475 0 0 0 626 2 0 0 20 0 1 0 99335274 61345792 8931 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 8931 834 476 0 8299 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 35724 KiB

[startup+12.7003 s]
/proc/loadavg: 2.04 2.05 2.05 3/189 2684
/proc/meminfo: memFree=26729664/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=35724 CPUtime=12.68 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 34327 0 0 0 1265 3 0 0 20 0 1 0 99335274 61345792 8931 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 8931 834 476 0 8299 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 35724 KiB

[startup+25.5003 s]
/proc/loadavg: 2.03 2.05 2.05 3/189 2684
/proc/meminfo: memFree=26729836/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=25.48 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 39319 0 0 0 2544 4 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+51.1096 s]
/proc/loadavg: 2.02 2.05 2.05 3/189 2684
/proc/meminfo: memFree=26730392/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=51.09 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 40605 0 0 0 5105 4 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017759 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+102.3 s]
/proc/loadavg: 2.08 2.06 2.05 3/189 2685
/proc/meminfo: memFree=26730064/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=102.27 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 41559 0 0 0 10223 4 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017909 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/189 2686
/proc/meminfo: memFree=26730188/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=162.26 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 42512 0 0 0 16222 4 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5016565 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 2687
/proc/meminfo: memFree=26730468/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=222.25 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 43465 0 0 0 22221 4 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017909 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 2688
/proc/meminfo: memFree=26730228/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=282.25 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 44418 0 0 0 28220 5 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017740 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 2689
/proc/meminfo: memFree=26729980/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=342.24 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 45371 0 0 0 34219 5 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+402.3 s]
/proc/loadavg: 2.07 2.04 2.05 3/187 2690
/proc/meminfo: memFree=26729964/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=402.24 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 46324 0 0 0 40219 5 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 2691
/proc/meminfo: memFree=26729824/32770624 swapFree=67028444/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=462.23 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 47277 0 0 0 46218 5 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017806 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB


################
# More data... #
################

/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 1722.11 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 2770
/proc/meminfo: memFree=26727892/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=1782.1 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 66359 0 0 0 178203 7 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017759 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 1782.1 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 2771
/proc/meminfo: memFree=26728440/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=1842.09 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 67312 0 0 0 184202 7 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017759 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 1842.09 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2772
/proc/meminfo: memFree=26728564/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=1902.09 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 68109 0 0 0 190202 7 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 1902.09 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 2773
/proc/meminfo: memFree=26728440/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=1962.08 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 68797 0 0 0 196201 7 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017799 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 1962.08 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 2834
/proc/meminfo: memFree=26700756/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2022.08 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 69697 0 0 0 202200 8 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017759 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2022.08 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 2835
/proc/meminfo: memFree=26700668/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2082.07 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 70144 0 0 0 208199 8 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017816 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2082.07 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2142.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 2836
/proc/meminfo: memFree=26700040/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2142.07 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 70418 0 0 0 214199 8 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017979 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2142.07 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 2837
/proc/meminfo: memFree=26700040/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2202.06 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 71947 0 0 0 220198 8 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5016527 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2202.06 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 2838
/proc/meminfo: memFree=26700328/32770624 swapFree=67028464/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2262.06 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 72797 0 0 0 226198 8 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017767 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2262.06 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 2847
/proc/meminfo: memFree=26699312/32770624 swapFree=67028468/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2322.06 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 73647 0 0 0 232197 9 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017902 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2322.06 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 2848
/proc/meminfo: memFree=26699492/32770624 swapFree=67028468/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2382.05 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 74489 0 0 0 238196 9 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017759 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2382.05 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 2849
/proc/meminfo: memFree=26699676/32770624 swapFree=67028468/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2442.05 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 75442 0 0 0 244196 9 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017760 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2442.05 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 4/188 2850
/proc/meminfo: memFree=26699428/32770624 swapFree=67028468/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2502.04 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 76280 0 0 0 250195 9 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5017909 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2502.04 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 2851
/proc/meminfo: memFree=26699304/32770624 swapFree=67028468/67108860
[pid=2683] ppid=2680 vsize=59908 memory=36004 CPUtime=2519.75 cores=0,2,4,6
/proc/2683/stat : 2683 (cosoco) R 2680 2683 2093 0 -1 4202496 76912 0 0 0 251966 9 0 0 20 0 1 0 99335274 61345792 9001 33554432000 4194304 6142532 140730635602272 140730635599672 5016509 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8243016 8247936 38129664 140730635605126 140730635605256 140730635605256 140730635608014 0
/proc/2683/statm: 14977 9001 834 476 0 8299 0
Current children cumulated CPU time: 2519.75 s
Current children cumulated vsize: 59908 KiB
Current children cumulated memory: 36004 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 2683 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.67 s, system=0.094991 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.76
CPU user time (s): 2519.67
CPU system time (s): 0.094991
CPU usage (%): 99.9901
Max. virtual memory (cumulated for all children) (KiB): 59908
Max. memory (cumulated for all children) (KiB): 36004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.67
system time used= 0.094991
maximum resident set size= 36072
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 76961
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27
involuntary context switches= 2754


# summary of solver processes directly reported to runsolver:
#   pid: 2683
#   total CPU time (s): 2519.76
#   total CPU user time (s): 2519.67
#   total CPU system time (s): 0.094991

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.25809 second user time and 19.9633 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-29 00:42:01
IDJOB=4299719
IDBENCH=141436
IDSOLVER=2761
FILE ID=node102/4299719-1532817721
RUNJOBID= node102-1532812129-2125
PBS_JOBID= 21022490
Free space on /tmp= 52736 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-10-11_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299719-1532817721/watcher-4299719-1532817721 -o /tmp/evaluation-result-4299719-1532817721/solver-4299719-1532817721 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532812129-2125 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4299719-1532817721.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6eb53458083bb5bfd537601a03885fcf
RANDOM SEED=1159651902

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26763324 kB
MemAvailable:   31929136 kB
Buffers:          218620 kB
Cached:          5202580 kB
SwapCached:        53388 kB
Active:          1228388 kB
Inactive:        4278760 kB
Active(anon):      11824 kB
Inactive(anon):    99164 kB
Active(file):    1216564 kB
Inactive(file):  4179596 kB
Unevictable:        6628 kB
Mlocked:            6628 kB
SwapTotal:      67108860 kB
SwapFree:       67028444 kB
Dirty:              8248 kB
Writeback:             0 kB
AnonPages:         39912 kB
Mapped:            38776 kB
Shmem:             22220 kB
Slab:             199132 kB
SReclaimable:     170976 kB
SUnreclaim:        28156 kB
KernelStack:        3328 kB
PageTables:         5200 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     356156 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52728 MiB
End job on node102 at 2018-07-29 01:24:01