Trace number 4398039

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.O parallel? (TO) 2520.79 2523.5

General information on the benchmark

NameBibd/Bibd-sum-stab1/
Bibd-sum-25-05-01.xml
MD5SUM8664f4f5c29eba7e0c756194721bfaf5
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark21.1993
Satisfiable
(Un)Satisfiability was proved
Number of variables750
Number of constraints356
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":750}]
Minimum variable degree27
Maximum variable degree27
Distribution of variable degrees[{"degree":27,"count":750}]
Minimum constraint arity25
Maximum constraint arity750
Distribution of constraint arities[{"arity":25,"count":30},{"arity":30,"count":25},{"arity":60,"count":300},{"arity":750,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":355}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14997 MiB free)
  memory of node 1: 16384 MiB (15532 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398039-1568601090/watcher-4398039-1568601090 -o /tmp/evaluation-result-4398039-1568601090/solver-4398039-1568601090 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1568595988-23581 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398039-1568601090.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog threadver pid=24183

Current StackSize limit: 8192 KiB


[startup+0.100155 s]*
/proc/loadavg: 9.10 8.54 8.35 2/192 24187
/proc/meminfo: memFree=31256800/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=33412 memory=9788 CPUtime=0.1 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 2644 0 0 0 10 0 0 0 20 0 1 0 436362026 34213888 2447 33554432000 4194304 6211092 140733844674656 140733844671192 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 8353 2447 842 493 0 1658 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 33412 KiB
Current children cumulated memory: 9788 KiB

[startup+0.209399 s]*
/proc/loadavg: 9.10 8.54 8.35 2/192 24187
/proc/meminfo: memFree=31255312/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=34760 memory=11108 CPUtime=0.21 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 2982 0 0 0 21 0 0 0 20 0 1 0 436362026 35594240 2777 33554432000 4194304 6211092 140733844674656 140733844671192 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 8690 2777 842 493 0 1995 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 34760 KiB
Current children cumulated memory: 11108 KiB

[startup+0.308553 s]*
/proc/loadavg: 9.10 8.54 8.35 2/192 24187
/proc/meminfo: memFree=31254196/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=36088 memory=12428 CPUtime=0.31 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 3289 0 0 0 31 0 0 0 20 0 1 0 436362026 36954112 3107 33554432000 4194304 6211092 140733844674656 140733844671192 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 9022 3107 842 493 0 2327 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 36088 KiB
Current children cumulated memory: 12428 KiB

[startup+0.700269 s]
/proc/loadavg: 9.10 8.54 8.35 2/192 24187
/proc/meminfo: memFree=31251592/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=40996 memory=17164 CPUtime=0.69 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 4488 0 0 0 69 0 0 0 20 0 1 0 436362026 41979904 4291 33554432000 4194304 6211092 140733844674656 140733844671192 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 10249 4291 842 493 0 3554 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 40996 KiB
Current children cumulated memory: 17164 KiB

[startup+1.50027 s]
/proc/loadavg: 9.10 8.54 8.35 2/192 24187
/proc/meminfo: memFree=31245468/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=51060 memory=27168 CPUtime=1.49 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6981 0 0 0 148 1 0 0 20 0 1 0 436362026 52285440 6792 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 12765 6792 842 493 0 6070 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 51060 KiB
Current children cumulated memory: 27168 KiB

[startup+3.10922 s]
/proc/loadavg: 8.45 8.42 8.31 2/192 24187
/proc/meminfo: memFree=31220960/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=70944 memory=47296 CPUtime=3.1 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 12122 0 0 0 308 2 0 0 20 0 1 0 436362026 72646656 11824 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 17736 11824 842 493 0 11041 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 70944 KiB
Current children cumulated memory: 47296 KiB

[startup+6.30026 s]
/proc/loadavg: 8.45 8.42 8.31 2/192 24187
/proc/meminfo: memFree=31184028/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=111140 memory=87004 CPUtime=6.28 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 22144 0 0 0 624 4 0 0 20 0 1 0 436362026 113807360 21751 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 27785 21751 842 493 0 21090 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 111140 KiB
Current children cumulated memory: 87004 KiB

[startup+12.7003 s]
/proc/loadavg: 7.86 8.29 8.27 2/192 24187
/proc/meminfo: memFree=31109536/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=191412 memory=166472 CPUtime=12.69 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 42118 0 0 0 1262 7 0 0 20 0 1 0 436362026 196005888 41618 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 47853 41618 842 493 0 41158 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 191412 KiB
Current children cumulated memory: 166472 KiB

[startup+25.5003 s]
/proc/loadavg: 6.34 7.93 8.15 2/192 24189
/proc/meminfo: memFree=30948728/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=354240 memory=326060 CPUtime=25.48 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 81654 0 0 0 2535 13 0 0 20 0 1 0 436362026 362741760 81515 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 88560 81515 842 493 0 81865 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 354240 KiB
Current children cumulated memory: 326060 KiB

[startup+51.1092 s]
/proc/loadavg: 4.52 7.38 7.96 2/192 24189
/proc/meminfo: memFree=30624360/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=678492 memory=645828 CPUtime=51.08 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 159090 0 0 0 5085 23 0 0 20 0 1 0 436362026 694775808 161457 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 169623 161457 842 493 0 162928 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 678492 KiB
Current children cumulated memory: 645828 KiB

[startup+102.3 s]
/proc/loadavg: 2.53 6.39 7.60 2/192 24192
/proc/meminfo: memFree=29986900/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=1310724 memory=1284056 CPUtime=102.25 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 312542 0 0 0 10184 41 0 0 20 0 1 0 436362026 1342181376 321014 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 327681 321014 842 493 0 320986 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 1310724 KiB
Current children cumulated memory: 1284056 KiB

[startup+162.3 s]
/proc/loadavg: 1.56 5.41 7.18 2/192 24197
/proc/meminfo: memFree=29241408/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=2092200 memory=2029152 CPUtime=162.24 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 492168 0 0 0 16159 65 0 0 20 0 1 0 436362026 2142412800 507288 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 523050 507288 842 493 0 516355 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 2092200 KiB
Current children cumulated memory: 2029152 KiB

[startup+222.3 s]
/proc/loadavg: 1.21 4.61 6.80 2/192 24200
/proc/meminfo: memFree=28493420/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=2805132 memory=2775396 CPUtime=222.21 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 670670 0 0 0 22137 84 0 0 20 0 1 0 436362026 2872455168 693849 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 701283 693849 842 493 0 694588 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2805132 KiB
Current children cumulated memory: 2775396 KiB

[startup+282.3 s]
/proc/loadavg: 1.08 3.95 6.43 2/191 24203
/proc/meminfo: memFree=27743868/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=3585156 memory=3523760 CPUtime=282.19 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 850178 0 0 0 28110 109 0 0 20 0 1 0 436362026 3671199744 880940 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 896289 880940 842 493 0 889594 0
Current children cumulated CPU time: 282.19 s
Current children cumulated vsize: 3585156 KiB
Current children cumulated memory: 3523760 KiB

[startup+342.3 s]
/proc/loadavg: 1.03 3.41 6.09 2/191 24208
/proc/meminfo: memFree=26994804/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=4297560 memory=4270972 CPUtime=342.17 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 1028444 0 0 0 34082 135 0 0 20 0 1 0 436362026 4400701440 1067743 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 1074390 1067743 842 493 0 1067695 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 4297560 KiB
Current children cumulated memory: 4270972 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.98 5.77 2/191 24211
/proc/meminfo: memFree=26247948/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=5093932 memory=5016512 CPUtime=402.15 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 1207388 0 0 0 40055 160 0 0 20 0 1 0 436362026 5216186368 1254128 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 1273483 1254128 842 493 0 1266788 0
Current children cumulated CPU time: 402.15 s
Current children cumulated vsize: 5093932 KiB
Current children cumulated memory: 5016512 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.62 5.48 2/191 24214
/proc/meminfo: memFree=25501076/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=5822476 memory=5762064 CPUtime=462.13 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 1385802 0 0 0 46031 182 0 0 20 0 1 0 436362026 5962215424 1440516 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 1455619 1440516 842 493 0 1448924 0
Current children cumulated CPU time: 462.13 s
Current children cumulated vsize: 5822476 KiB
Current children cumulated memory: 5762064 KiB


################
# More data... #
################

Current children cumulated vsize: 24006412 KiB
Current children cumulated memory: 23630628 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.90 2/193 24356
/proc/meminfo: memFree=6854224/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=24714196 memory=24371344 CPUtime=1961.63 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 5840808 0 0 0 194987 1176 0 0 20 0 1 0 436362026 25307336704 6092836 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 6178549 6092836 842 493 0 6171854 0
Current children cumulated CPU time: 1961.63 s
Current children cumulated vsize: 24714196 KiB
Current children cumulated memory: 24371344 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.84 2/192 24359
/proc/meminfo: memFree=6110568/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=25422112 memory=25114104 CPUtime=2021.6 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6018227 0 0 0 200926 1234 0 0 20 0 1 0 436362026 26032242688 6278526 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 6355528 6278526 842 493 0 6348833 0
Current children cumulated CPU time: 2021.6 s
Current children cumulated vsize: 25422112 KiB
Current children cumulated memory: 25114104 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.79 2/192 24363
/proc/meminfo: memFree=5368452/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=26129764 memory=25854548 CPUtime=2081.59 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6195556 0 0 0 206868 1291 0 0 20 0 1 0 436362026 26756878336 6463637 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 6532441 6463637 842 493 0 6525746 0
Current children cumulated CPU time: 2081.59 s
Current children cumulated vsize: 26129764 KiB
Current children cumulated memory: 25854548 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.74 2/191 24368
/proc/meminfo: memFree=4624320/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=26838208 memory=26597520 CPUtime=2141.57 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6373160 0 0 0 212807 1350 0 0 20 0 1 0 436362026 27482324992 6649380 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 6709552 6649380 842 493 0 6702857 0
Current children cumulated CPU time: 2141.57 s
Current children cumulated vsize: 26838208 KiB
Current children cumulated memory: 26597520 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.69 2/191 24371
/proc/meminfo: memFree=3880808/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=27546388 memory=27338764 CPUtime=2201.55 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6550637 0 0 0 218744 1411 0 0 20 0 1 0 436362026 28207501312 6834691 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 6886597 6834691 842 493 0 6879902 0
Current children cumulated CPU time: 2201.55 s
Current children cumulated vsize: 27546388 KiB
Current children cumulated memory: 27338764 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.65 2/191 24374
/proc/meminfo: memFree=3137084/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=28254304 memory=28081260 CPUtime=2261.54 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6728012 0 0 0 224678 1476 0 0 20 0 1 0 436362026 28932407296 7020315 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7063576 7020315 842 493 0 7056881 0
Current children cumulated CPU time: 2261.54 s
Current children cumulated vsize: 28254304 KiB
Current children cumulated memory: 28081260 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.61 2/191 24379
/proc/meminfo: memFree=2393336/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=28961956 memory=28823708 CPUtime=2321.52 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 6905446 0 0 0 230615 1537 0 0 20 0 1 0 436362026 29657042944 7205927 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7240489 7205927 842 493 0 7233794 0
Current children cumulated CPU time: 2321.52 s
Current children cumulated vsize: 28961956 KiB
Current children cumulated memory: 28823708 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.57 2/192 24390
/proc/meminfo: memFree=1652592/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=29668420 memory=29563100 CPUtime=2381.5 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 7082479 0 0 0 236548 1602 0 0 20 0 1 0 436362026 30380462080 7390775 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7417105 7390775 842 493 0 7410410 0
Current children cumulated CPU time: 2381.5 s
Current children cumulated vsize: 29668420 KiB
Current children cumulated memory: 29563100 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.54 2/192 24393
/proc/meminfo: memFree=908872/32770624 swapFree=66997024/67108860
[pid=24186] ppid=24183 vsize=30375148 memory=30304480 CPUtime=2441.48 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 7259657 0 0 0 242484 1664 0 0 20 0 1 0 436362026 31104151552 7576120 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7593787 7576120 842 493 0 7587092 0
Current children cumulated CPU time: 2441.48 s
Current children cumulated vsize: 30375148 KiB
Current children cumulated memory: 30304480 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.50 2/192 24398
/proc/meminfo: memFree=201304/32770624 swapFree=66997128/67108860
[pid=24186] ppid=24183 vsize=31081216 memory=31043348 CPUtime=2501.46 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 7436613 0 0 0 248415 1731 0 0 20 0 1 0 436362026 31827165184 7760837 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7770304 7760837 842 493 0 7763609 0
Current children cumulated CPU time: 2501.46 s
Current children cumulated vsize: 31081216 KiB
Current children cumulated memory: 31043348 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.49 2/192 24398
/proc/meminfo: memFree=187640/32770624 swapFree=66997328/67108860
[pid=24186] ppid=24183 vsize=31290172 memory=31261148 CPUtime=2519.16 cores=0-7
/proc/24186/stat : 24186 (cosoco) R 24183 24186 23554 0 -1 4202496 7489575 0 0 0 250167 1749 0 0 20 0 1 0 436362026 32041136128 7815287 33554432000 4194304 6211092 140733844674656 140733844657016 139976526982117 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7822543 7815287 842 493 0 7815848 0
Current children cumulated CPU time: 2519.16 s
Current children cumulated vsize: 31290172 KiB
Current children cumulated memory: 31261148 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.5 s]
# the end of solver process 24186 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2501.79 s, system=18.9991 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.49 2/192 24398
/proc/meminfo: memFree=187640/32770624 swapFree=66997328/67108860
[pid=24186] ppid=24183 vsize=31290172 memory=31261148 CPUtime=2519.23 cores=0-7
/proc/24186/stat : 24186 (cosoco) S 24183 24186 23554 0 -1 512 7489585 0 0 0 250173 1750 0 0 20 0 1 0 436362026 32041136128 7815287 33554432000 4194304 6211092 140733844674656 140733844657016 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7822543 7815287 842 493 0 7815848 0
Current children cumulated CPU time: 2519.23 s
Current children cumulated vsize: 31290172 KiB
Current children cumulated memory: 31261148 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.49 2/193 24399
/proc/meminfo: memFree=186700/32770624 swapFree=66997340/67108860
[pid=24186] ppid=24183 vsize=31290172 memory=31261148 CPUtime=2519.28 cores=0-7
/proc/24186/stat : 24186 (cosoco) S 24183 24186 23554 0 -1 512 7489585 0 0 0 250178 1750 0 0 20 0 1 0 436362026 32041136128 7815287 33554432000 4194304 6211092 140733844674656 140733844657016 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7822543 7815287 842 493 0 7815848 0
Current children cumulated CPU time: 2519.28 s
Current children cumulated vsize: 31290172 KiB
Current children cumulated memory: 31261148 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.01 1.49 1/193 24399
/proc/meminfo: memFree=165116/32770624 swapFree=66997340/67108860
[pid=24186] ppid=24183 vsize=31290172 memory=31261148 CPUtime=2519.29 cores=0-7
/proc/24186/stat : 24186 (cosoco) S 24183 24186 23554 0 -1 512 7489585 0 0 0 250179 1750 0 0 20 0 1 0 436362026 32041136128 7815287 33554432000 4194304 6211092 140733844674656 140733844657016 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 8843264 140733844681745 140733844681837 140733844681837 140733844684750 0
/proc/24186/statm: 7822543 7815287 842 493 0 7815848 0
Current children cumulated CPU time: 2519.29 s
Current children cumulated vsize: 31290172 KiB
Current children cumulated memory: 31261148 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.5
CPU time (s): 2520.79
CPU user time (s): 2501.79
CPU system time (s): 18.9991
CPU usage (%): 99.8926
Max. virtual memory (cumulated for all children) (KiB): 31290172
Max. memory (cumulated for all children) (KiB): 31261148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2501.79
system time used= 18.9991
maximum resident set size= 31261276
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7489585
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 57044
involuntary context switches= 1944


# summary of solver processes directly reported to runsolver:
#   pid: 24186
#   total CPU time (s): 2520.79
#   total CPU user time (s): 2501.79
#   total CPU system time (s): 18.9991

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.16435 second user time and 16.5888 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-16 04:30:31
IDJOB=4398039
IDBENCH=123874
IDSOLVER=2851
FILE ID=node103/4398039-1568601090
RUNJOBID= node103-1568595988-23581
PBS_JOBID= 21703397
Free space on /tmp= 61720 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Bibd/Bibd-sum-stab1/Bibd-sum-25-05-01.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398039-1568601090/watcher-4398039-1568601090 -o /tmp/evaluation-result-4398039-1568601090/solver-4398039-1568601090 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node103-1568595988-23581 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398039-1568601090.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8664f4f5c29eba7e0c756194721bfaf5
RANDOM SEED=2084756881

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31262948 kB
MemAvailable:   31880756 kB
Buffers:          133164 kB
Cached:           777068 kB
SwapCached:         9168 kB
Active:           595768 kB
Inactive:         326656 kB
Active(anon):       6508 kB
Inactive(anon):    55260 kB
Active(file):     589260 kB
Inactive(file):   271396 kB
Unevictable:      111164 kB
Mlocked:          111164 kB
SwapTotal:      67108860 kB
SwapFree:       66997024 kB
Dirty:              2716 kB
Writeback:           244 kB
AnonPages:        115164 kB
Mapped:            47064 kB
Shmem:             40856 kB
Slab:             175124 kB
SReclaimable:     145976 kB
SUnreclaim:        29148 kB
KernelStack:        3408 kB
PageTables:         5328 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505676 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 61500 MiB
End job on node103 at 2019-09-16 05:12:35