Trace number 4389645

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2519.95 2520.02

General information on the benchmark

NameSuperSolutions/SuperSolutions-Taillard-os20/
SuperTaillard-os-20-02.xml
MD5SUM0e3d16858c05bcbedaa7411f074a79f1
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark265.664
Satisfiable
(Un)Satisfiability was proved
Number of variables800
Number of constraints23200
Number of domains97
Minimum domain size1234
Maximum domain size1332
Distribution of domain sizes[{"size":1234,"count":10},{"size":1235,"count":4},{"size":1236,"count":18},{"size":1237,"count":8},{"size":1238,"count":10},{"size":1239,"count":8},{"size":1240,"count":4},{"size":1241,"count":6},{"size":1242,"count":10},{"size":1243,"count":8},{"size":1244,"count":2},{"size":1245,"count":16},{"size":1246,"count":6},{"size":1247,"count":4},{"size":1248,"count":6},{"size":1249,"count":14},{"size":1250,"count":8},{"size":1251,"count":16},{"size":1252,"count":10},{"size":1253,"count":4},{"size":1254,"count":16},{"size":1255,"count":14},{"size":1256,"count":2},{"size":1257,"count":8},{"size":1258,"count":10},"...",{"size":1307,"count":4}, {"size":1308,"count":10}, {"size":1309,"count":6}, {"size":1310,"count":14}, {"size":1311,"count":4}, {"size":1312,"count":6}, {"size":1313,"count":4}, {"size":1315,"count":10}, {"size":1316,"count":8}, {"size":1317,"count":16}, {"size":1318,"count":8}, {"size":1319,"count":10}, {"size":1320,"count":6}, {"size":1321,"count":4}, {"size":1322,"count":14}, {"size":1323,"count":4}, {"size":1324,"count":8}, {"size":1325,"count":6}, {"size":1326,"count":8}, {"size":1327,"count":18}, {"size":1328,"count":6}, {"size":1329,"count":10}, {"size":1330,"count":2}, {"size":1331,"count":6}, {"size":1332,"count":4}]
Minimum variable degree39
Maximum variable degree77
Distribution of variable degrees[{"degree":39,"count":400},{"degree":77,"count":400}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":23200}]
Number of extensional constraints0
Number of intensional constraints23200
Distribution of constraint types[{"type":"intension","count":23200}]
Optimization problemNO
Type of objective

Solver Data 

16.48/16.50	c root propagations     : 0           
16.48/16.50	c restarts enabled, print stats at every restarts
16.48/16.50	c
16.48/16.50	c
16.48/16.50	c
16.48/16.50	c This is cosoco 2.00 --  
16.48/16.50	c
16.48/16.50	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389645-1568358253.xml 
16.48/16.50	c ========================================[ Problem Statistics ]===========================================
16.48/16.50	c |                                                                                                       
16.48/16.50	c |  Parse time        :        15.90 s 
16.48/16.50	c |
16.48/16.50	c |               Variables: 800
16.48/16.50	c |            Domain Sizes: 1234..1332
16.48/16.50	c |
16.48/16.50	c |             Constraints: 23200
16.48/16.50	c |                   Arity: 2..2  -- Binary: 23200
16.48/16.50	c | 
16.48/16.50	c |                   Types: 
16.48/16.50	c |                          (X != Y): 400
16.48/16.50	c |                          Intension: 22800
16.48/16.50	c |                          
16.48/16.50	c =========================================================================================================
16.48/16.50	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
30.38/30.46	c 101            231            339169         895923         0              0              129   130   127
61.37/61.46	c 211            626            891066         2442688        0              0              279   281   277
72.57/72.69	c 332            808            1115230        3413029        0              0              53   54   52   
100.17/100.21	c 465            1188           1642641        4458119        0              0              238   238   236
113.67/113.73	c 611            1432           1944968        5401560        0              0              95   95   94   
127.66/127.72	c 771            1655           2222812        6097309        0              0              41   43   41   
140.96/141.09	c 947            1906           2479773        6997864        0              0              66   66   65   
154.15/154.25	c 1140           2167           2681235        8227826        0              0              63   63   62   
176.07/176.18	c 1352           2530           3072962        10081474       0              0              95   96   95   
191.07/191.11	c 1585           2803           3264965        11801847       0              0              37   37   36   
216.06/216.18	c 1841           3249           3701211        13950724       0              0              37   188   123 
239.65/239.79	c 2122           3633           4047587        16510846       0              0              94   95   94   
257.45/257.50	c 2431           4017           4287307        19098046       0              0              70   70   69   
278.75/278.80	c 2770           4456           4574595        22139515       0              0              97   97   96   
308.25/308.31	c 3142           5009           5158246        23996965       0              0              170   170   169
325.35/325.40	c 3551           5474           5381123        27124550       0              0              54   54   53   
352.54/352.69	c 4000           5987           5889468        29962426       0              0              21   23   21   
374.35/374.47	c 4493           6513           6110324        33460537       0              0              17   19   17   
402.24/402.34	c 5035           7105           6566209        36368076       0              0              19   20   19   
426.34/426.41	c 5631           7729           6744418        40691415       0              0              19   19   18   
453.44/453.58	c 6286           8468           7077995        44201466       0              0              36   68   64   
489.64/489.75	c 7006           9252           7577506        48859802       0              0              47   47   46   
529.44/529.53	c 7798           10101          7927906        54936103       0              0              43   43   42   
591.64/591.70	c 8669           11069          8463889        60866505       0              0              42   43   42   
665.34/665.44	c 9627           12180          9756915        67137280       0              0              30   36   35   
744.34/744.41	c 10680          13357          10718970       77202082       0              0              35   43   42   
797.44/797.58	c 11838          14585          11180047       85211415       0              0              17   19   18   
849.05/849.11	c 13111          15894          11540391       94625369       0              0              17   18   17   
928.64/928.73	c 14511          17395          12117241       105442236      0              0              21   39   38   
1007.96/1008.07	c 16051          19056          13148474       113455470      0              0              20   22   21   
1103.74/1103.81	c 17745          20872          14456783       123306554      0              0              19   20   19   
1205.34/1205.44	c 19608          22832          15358613       136842707      0              0              20   21   20   
1324.84/1324.91	c 21657          25041          17103584       150538487      0              0              16   18   17   
1442.53/1442.61	c 23910          27536          18618269       165711138      0              0              16   19   17   
1750.61/1750.71	c 26388          30249          21278194       199791325      0              0              15   17   16   
1904.41/1904.50	c 29113          33262          23016603       219508924      0              0              17   20   19   
2139.72/2139.84	c 32110          36377          24157106       247191453      0              0              16   17   16   
2256.93/2257.10	c 35406          39791          25077037       269306222      0              0              16   17   16   
2442.32/2442.40	c 39031          43579          27825618       290482266      0              0              17   21   20   
2519.93/2520.01	
2519.93/2520.01	c *** INTERRUPTED ***
2519.93/2520.01	c restarts              : 39          
2519.93/2520.01	c conflicts             : 40795        (16 /sec)
2519.93/2520.01	c decisions             : 45460        (18 /sec)
2519.93/2520.01	c propagations          : 303763305   (120619 /sec)
2519.93/2520.01	c root propagations     : 0           
2519.93/2520.01	c filter calls          : 28753661       (11418 /sec)
2519.93/2520.01	c useless filter calls  : 25224533       (87 %)
2519.93/2520.01	c Memory used           : 2133.24 MB
2519.93/2520.01	c CPU time              : 2518.37 s
2519.93/2520.01	c real time             : 2520.01 s
2519.93/2520.01	
2519.93/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13100 MiB free)
  memory of node 1: 16384 MiB (12172 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389645-1568358253/watcher-4389645-1568358253 -o /tmp/evaluation-result-4389645-1568358253/solver-4389645-1568358253 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568358213-18953 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389645-1568358253.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=18984, runsolver pid=18981

[startup+0.100198 s]*
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=25755036/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=36548 memory=12624 CPUtime=0.1 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 3341 0 0 0 10 0 0 0 20 0 1 0 411765464 37425152 3156 33554432000 4194304 6210612 140724292584416 140724292581688 139911223689344 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 9137 3156 796 493 0 2442 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 36548 KiB
Current children cumulated memory: 12624 KiB

[startup+0.209908 s]*
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=25586892/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=37260 memory=13176 CPUtime=0.21 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 3512 0 0 0 21 0 0 0 20 0 1 0 411765464 38154240 3294 33554432000 4194304 6210612 140724292584416 140724292581688 139911223672779 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 9315 3294 796 493 0 2620 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 37260 KiB
Current children cumulated memory: 13176 KiB

[startup+0.30937 s]*
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=25431768/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=37772 memory=13948 CPUtime=0.31 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 3664 0 0 0 31 0 0 0 20 0 1 0 411765464 38678528 3487 33554432000 4194304 6210612 140724292584416 140724292581688 5524435 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 9443 3487 796 493 0 2748 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 37772 KiB
Current children cumulated memory: 13948 KiB

[startup+0.70034 s]
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=25041912/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=40324 memory=16520 CPUtime=0.69 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 4379 0 0 0 69 0 0 0 20 0 1 0 411765464 41291776 4130 33554432000 4194304 6210612 140724292584416 140724292581688 139911220194277 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 10081 4130 796 493 0 3386 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 40324 KiB
Current children cumulated memory: 16520 KiB

[startup+1.50041 s]
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=24904644/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=88928 memory=64824 CPUtime=1.49 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 16635 0 0 0 147 2 0 0 20 0 1 0 411765464 91062272 16206 33554432000 4194304 6210612 140724292584416 140724292579512 139911220194277 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 22232 16206 815 493 0 15537 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 88928 KiB
Current children cumulated memory: 64824 KiB

[startup+3.10975 s]
/proc/loadavg: 3.77 4.78 4.50 3/201 18985
/proc/meminfo: memFree=24712852/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=244360 memory=220316 CPUtime=3.09 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 55824 0 0 0 301 8 0 0 20 0 1 0 411765464 250224640 55079 33554432000 4194304 6210612 140724292584416 140724292579512 5444624 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 61090 55079 815 493 0 54395 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 244360 KiB
Current children cumulated memory: 220316 KiB

[startup+6.30039 s]
/proc/loadavg: 3.63 4.73 4.49 3/201 18985
/proc/meminfo: memFree=24422260/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=553700 memory=529528 CPUtime=6.28 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 133282 0 0 0 609 19 0 0 20 0 1 0 411765464 566988800 132382 33554432000 4194304 6210612 140724292584416 140724292579448 139911220194277 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 138425 132382 815 493 0 131730 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 553700 KiB
Current children cumulated memory: 529528 KiB

[startup+12.7004 s]
/proc/loadavg: 3.50 4.68 4.47 3/201 18985
/proc/meminfo: memFree=23839068/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=1174828 memory=1150728 CPUtime=12.68 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 288687 0 0 0 1225 43 0 0 20 0 1 0 411765464 1203023872 287682 33554432000 4194304 6210612 140724292584416 140724292575640 139911220194277 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 293707 287682 815 493 0 287012 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 1174828 KiB
Current children cumulated memory: 1150728 KiB

[startup+25.5004 s]
/proc/loadavg: 3.17 4.55 4.43 3/201 18985
/proc/meminfo: memFree=23277364/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=1673856 memory=1650408 CPUtime=25.48 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 503518 0 0 0 2483 65 0 0 20 0 1 0 411765464 1714028544 412602 33554432000 4194304 6210612 140724292584416 140724292582072 5446119 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 418464 412602 858 493 0 411769 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 1673856 KiB
Current children cumulated memory: 1650408 KiB

[startup+51.1099 s]
/proc/loadavg: 2.77 4.35 4.37 3/201 18988
/proc/meminfo: memFree=23047488/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=1897464 memory=1873972 CPUtime=51.08 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 702734 0 0 0 5028 80 0 0 20 0 1 0 411765464 1943003136 468493 33554432000 4194304 6210612 140724292584416 140724292582072 5445966 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 474366 468493 861 493 0 467671 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 1897464 KiB
Current children cumulated memory: 1873972 KiB

[startup+102.3 s]
/proc/loadavg: 2.33 3.99 4.24 3/201 18992
/proc/meminfo: memFree=22906656/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2036856 memory=2013440 CPUtime=102.26 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 968217 0 0 0 10130 96 0 0 20 0 1 0 411765464 2085740544 503360 33554432000 4194304 6210612 140724292584416 140724292582072 5164490 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 509214 503360 861 493 0 502519 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 2036856 KiB
Current children cumulated memory: 2013440 KiB

[startup+162.3 s]
/proc/loadavg: 2.12 3.62 4.10 3/200 19057
/proc/meminfo: memFree=23812008/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2086092 memory=2062680 CPUtime=162.25 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1131825 0 0 0 16120 105 0 0 20 0 1 0 411765464 2136158208 515670 33554432000 4194304 6210612 140724292584416 140724292582072 5068613 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 521523 515670 861 493 0 514828 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 2086092 KiB
Current children cumulated memory: 2062680 KiB

[startup+222.3 s]
/proc/loadavg: 2.05 3.33 3.97 3/200 19063
/proc/meminfo: memFree=23762136/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2134536 memory=2111148 CPUtime=222.25 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1321991 0 0 0 22110 115 0 0 20 0 1 0 411765464 2185764864 527787 33554432000 4194304 6210612 140724292584416 140724292582072 5442804 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 533634 527787 861 493 0 526939 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 2134536 KiB
Current children cumulated memory: 2111148 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 3.09 3.85 3/200 19067
/proc/meminfo: memFree=23755784/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2140080 memory=2116616 CPUtime=282.25 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1434808 0 0 0 28104 121 0 0 20 0 1 0 411765464 2191441920 529154 33554432000 4194304 6210612 140724292584416 140724292582072 5476703 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 535020 529154 861 493 0 528325 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 2140080 KiB
Current children cumulated memory: 2116616 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.89 3.73 3/199 19071
/proc/meminfo: memFree=23728620/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2166480 memory=2143028 CPUtime=342.24 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1572612 0 0 0 34097 127 0 0 20 0 1 0 411765464 2218475520 535757 33554432000 4194304 6210612 140724292584416 140724292582072 5440914 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 541620 535757 861 493 0 534925 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 2166480 KiB
Current children cumulated memory: 2143028 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.73 3.62 3/199 19084
/proc/meminfo: memFree=23726520/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2168856 memory=2145428 CPUtime=402.24 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1627815 0 0 0 40095 129 0 0 20 0 1 0 411765464 2220908544 536357 33554432000 4194304 6210612 140724292584416 140724292582072 5065608 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 542214 536357 861 493 0 535519 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 2168856 KiB
Current children cumulated memory: 2145428 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.59 3.52 3/199 19089
/proc/meminfo: memFree=23722844/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2172420 memory=2149000 CPUtime=462.24 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 1759254 0 0 0 46088 136 0 0 20 0 1 0 411765464 2224558080 537250 33554432000 4194304 6210612 140724292584416 140724292582072 5453766 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 543105 537250 861 493 0 536410 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 2172420 KiB
Current children cumulated memory: 2149000 KiB


################
# More data... #
################

/proc/18984/statm: 545481 539630 861 493 0 538786 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 2181924 KiB
Current children cumulated memory: 2158520 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.06 2.40 3/199 19209
/proc/meminfo: memFree=23714364/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182056 memory=2158672 CPUtime=1782.21 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2155205 0 0 0 178066 155 0 0 20 0 1 0 411765464 2234425344 539668 33554432000 4194304 6210612 140724292584416 140724292582072 5453766 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545514 539668 861 493 0 538819 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 2182056 KiB
Current children cumulated memory: 2158672 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 2.37 3/200 19216
/proc/meminfo: memFree=23712804/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182188 memory=2158796 CPUtime=1842.21 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2156176 0 0 0 184066 155 0 0 20 0 1 0 411765464 2234560512 539699 33554432000 4194304 6210612 140724292584416 140724292582072 5454008 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545547 539699 861 493 0 538852 0
Current children cumulated CPU time: 1842.21 s
Current children cumulated vsize: 2182188 KiB
Current children cumulated memory: 2158796 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.04 2.35 3/199 19220
/proc/meminfo: memFree=23712484/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182320 memory=2158876 CPUtime=1902.21 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2157145 0 0 0 190066 155 0 0 20 0 1 0 411765464 2234695680 539719 33554432000 4194304 6210612 140724292584416 140724292582072 5446767 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545580 539719 861 493 0 538885 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 2182320 KiB
Current children cumulated memory: 2158876 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.03 2.33 3/199 19224
/proc/meminfo: memFree=23712644/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182584 memory=2159160 CPUtime=1962.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2158483 0 0 0 196066 156 0 0 20 0 1 0 411765464 2234966016 539790 33554432000 4194304 6210612 140724292584416 140724292582072 5452063 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545646 539790 861 493 0 538951 0
Current children cumulated CPU time: 1962.22 s
Current children cumulated vsize: 2182584 KiB
Current children cumulated memory: 2159160 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.31 3/199 19230
/proc/meminfo: memFree=23711728/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182584 memory=2159192 CPUtime=2022.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2159176 0 0 0 202066 156 0 0 20 0 1 0 411765464 2234966016 539798 33554432000 4194304 6210612 140724292584416 140724292582072 5446119 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545646 539798 861 493 0 538951 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 2182584 KiB
Current children cumulated memory: 2159192 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.29 3/199 19234
/proc/meminfo: memFree=23712000/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2182848 memory=2159380 CPUtime=2082.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2160162 0 0 0 208066 156 0 0 20 0 1 0 411765464 2235236352 539845 33554432000 4194304 6210612 140724292584416 140724292582072 5389663 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545712 539845 861 493 0 539017 0
Current children cumulated CPU time: 2082.22 s
Current children cumulated vsize: 2182848 KiB
Current children cumulated memory: 2159380 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.27 3/199 19238
/proc/meminfo: memFree=23711784/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183112 memory=2159600 CPUtime=2142.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2161460 0 0 0 214066 156 0 0 20 0 1 0 411765464 2235506688 539900 33554432000 4194304 6210612 140724292584416 140724292582072 5478158 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545778 539900 861 493 0 539083 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 2183112 KiB
Current children cumulated memory: 2159600 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.25 3/200 19252
/proc/meminfo: memFree=23712032/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183112 memory=2159720 CPUtime=2202.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2162334 0 0 0 220066 156 0 0 20 0 1 0 411765464 2235506688 539930 33554432000 4194304 6210612 140724292584416 140724292582072 5451264 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545778 539930 861 493 0 539083 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 2183112 KiB
Current children cumulated memory: 2159720 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.24 3/200 19256
/proc/meminfo: memFree=23711304/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183640 memory=2160196 CPUtime=2262.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2163971 0 0 0 226066 156 0 0 20 0 1 0 411765464 2236047360 540049 33554432000 4194304 6210612 140724292584416 140724292582072 5065479 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545910 540049 861 493 0 539215 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 2183640 KiB
Current children cumulated memory: 2160196 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.22 3/200 19260
/proc/meminfo: memFree=23711236/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183772 memory=2160324 CPUtime=2322.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2164753 0 0 0 232066 156 0 0 20 0 1 0 411765464 2236182528 540081 33554432000 4194304 6210612 140724292584416 140724292582072 5478158 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545943 540081 861 493 0 539248 0
Current children cumulated CPU time: 2322.22 s
Current children cumulated vsize: 2183772 KiB
Current children cumulated memory: 2160324 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.21 3/200 19266
/proc/meminfo: memFree=23710368/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183772 memory=2160408 CPUtime=2382.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2165757 0 0 0 238066 156 0 0 20 0 1 0 411765464 2236182528 540102 33554432000 4194304 6210612 140724292584416 140724292582072 5446033 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545943 540102 861 493 0 539248 0
Current children cumulated CPU time: 2382.22 s
Current children cumulated vsize: 2183772 KiB
Current children cumulated memory: 2160408 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.20 3/200 19270
/proc/meminfo: memFree=23710740/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2183904 memory=2160436 CPUtime=2442.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2166543 0 0 0 244066 156 0 0 20 0 1 0 411765464 2236317696 540109 33554432000 4194304 6210612 140724292584416 140724292582072 5068664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 545976 540109 861 493 0 539281 0
Current children cumulated CPU time: 2442.22 s
Current children cumulated vsize: 2183904 KiB
Current children cumulated memory: 2160436 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.19 3/199 19274
/proc/meminfo: memFree=23710000/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2184300 memory=2160860 CPUtime=2502.22 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2168100 0 0 0 250065 157 0 0 20 0 1 0 411765464 2236723200 540215 33554432000 4194304 6210612 140724292584416 140724292582072 139911229527200 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 546075 540215 861 493 0 539380 0
Current children cumulated CPU time: 2502.22 s
Current children cumulated vsize: 2184300 KiB
Current children cumulated memory: 2160860 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.22 2.06 2.20 3/199 19276
/proc/meminfo: memFree=23709540/32770624 swapFree=66959224/67108860
[pid=18984] ppid=18981 vsize=2184432 memory=2161036 CPUtime=2519.93 cores=0,2,4,6
/proc/18984/stat : 18984 (cosoco) R 18981 18984 18922 0 -1 4202496 2168589 0 0 0 251836 157 0 0 20 0 1 0 411765464 2236858368 540259 33554432000 4194304 6210612 140724292584416 140724292582072 5478192 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 20434944 140724292588555 140724292588657 140724292588657 140724292591566 0
/proc/18984/statm: 546108 540259 861 493 0 539413 0
Current children cumulated CPU time: 2519.93 s
Current children cumulated vsize: 2184432 KiB
Current children cumulated memory: 2161036 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 18984 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2518.37 s, system=1.57899 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.02
CPU time (s): 2519.95
CPU user time (s): 2518.37
CPU system time (s): 1.57899
CPU usage (%): 99.9971
Max. virtual memory (cumulated for all children) (KiB): 2184432
Max. memory (cumulated for all children) (KiB): 2161036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2518.37
system time used= 1.57899
maximum resident set size= 2161104
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2168631
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 83
involuntary context switches= 4260


# summary of solver processes directly reported to runsolver:
#   pid: 18984
#   total CPU time (s): 2519.95
#   total CPU user time (s): 2518.37
#   total CPU system time (s): 1.57899

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.2888 second user time and 17.9725 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-13 09:03:33
IDJOB=4389645
IDBENCH=138696
IDSOLVER=2829
FILE ID=node124/4389645-1568358253
RUNJOBID= node124-1568358213-18953
PBS_JOBID= 21701196
Free space on /tmp= 55364 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/SuperSolutions/SuperSolutions-Taillard-os20/SuperTaillard-os-20-02.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389645-1568358253/watcher-4389645-1568358253 -o /tmp/evaluation-result-4389645-1568358253/solver-4389645-1568358253 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node124-1568358213-18953 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389645-1568358253.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0e3d16858c05bcbedaa7411f074a79f1
RANDOM SEED=1751252668

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25883960 kB
MemAvailable:   31814500 kB
Buffers:          155244 kB
Cached:          6020712 kB
SwapCached:        45888 kB
Active:           998924 kB
Inactive:        5227156 kB
Active(anon):       3656 kB
Inactive(anon):    88200 kB
Active(file):     995268 kB
Inactive(file):  5138956 kB
Unevictable:      109008 kB
Mlocked:          109008 kB
SwapTotal:      67108860 kB
SwapFree:       66959224 kB
Dirty:              6324 kB
Writeback:             0 kB
AnonPages:        114316 kB
Mapped:            43280 kB
Shmem:             32744 kB
Slab:             253052 kB
SReclaimable:     224300 kB
SUnreclaim:        28752 kB
KernelStack:        3296 kB
PageTables:         5636 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     527532 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 55360 MiB
End job on node124 at 2019-09-13 09:45:33