Trace number 4390296

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1429.96 1432.08

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-09-024-008.xml
MD5SUM0092e4980ed4af349e39cdcd3a0de294
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.68622
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size23
Distribution of domain sizes[{"size":2,"count":216},{"size":23,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":216},{"degree":37,"count":1}]
Minimum constraint arity24
Maximum constraint arity216
Distribution of constraint arities[{"arity":24,"count":9},{"arity":49,"count":36},{"arity":216,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14514 MiB free)
  memory of node 1: 16384 MiB (446 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390296-1568337279/watcher-4390296-1568337279 -o /tmp/evaluation-result-4390296-1568337279/solver-4390296-1568337279 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node145-1568328837-13394 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390296-1568337279.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=14896, runsolver pid=14893

[startup+0.100191 s]*
/proc/loadavg: 2.23 2.18 2.12 3/203 14897
/proc/meminfo: memFree=15316976/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=28564 memory=4744 CPUtime=0.1 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 1414 0 0 0 10 0 0 0 20 0 1 0 409664451 29249536 1186 33554432000 4194304 6210612 140723268896640 140723268893176 5012710 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 7141 1186 844 493 0 446 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28564 KiB
Current children cumulated memory: 4744 KiB

[startup+0.209961 s]*
/proc/loadavg: 2.23 2.18 2.12 4/203 14897
/proc/meminfo: memFree=15313328/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=29676 memory=6064 CPUtime=0.21 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 1713 0 0 0 21 0 0 0 20 0 1 0 409664451 30388224 1516 33554432000 4194304 6210612 140723268896640 140723268881112 5012488 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 7419 1516 845 493 0 724 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29676 KiB
Current children cumulated memory: 6064 KiB

[startup+0.309431 s]*
/proc/loadavg: 2.23 2.18 2.12 3/203 14897
/proc/meminfo: memFree=15311468/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=30816 memory=7240 CPUtime=0.31 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 1982 0 0 0 31 0 0 0 20 0 1 0 409664451 31555584 1810 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 7704 1810 845 493 0 1009 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30816 KiB
Current children cumulated memory: 7240 KiB

[startup+0.700393 s]
/proc/loadavg: 2.23 2.18 2.12 3/203 14897
/proc/meminfo: memFree=15302168/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=34960 memory=11216 CPUtime=0.69 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3022 0 0 0 69 0 0 0 20 0 1 0 409664451 35799040 2804 33554432000 4194304 6210612 140723268896640 140723268881112 5012890 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 8740 2804 845 493 0 2045 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 34960 KiB
Current children cumulated memory: 11216 KiB

[startup+1.50035 s]
/proc/loadavg: 2.23 2.18 2.12 3/200 14897
/proc/meminfo: memFree=15345384/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=43856 memory=19948 CPUtime=1.49 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 5204 0 0 0 149 0 0 0 20 0 1 0 409664451 44908544 4987 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 10964 4987 845 493 0 4269 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 43856 KiB
Current children cumulated memory: 19948 KiB

[startup+3.10958 s]
/proc/loadavg: 2.23 2.18 2.12 3/200 14897
/proc/meminfo: memFree=15298856/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=61824 memory=37580 CPUtime=3.1 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 9638 0 0 0 309 1 0 0 20 0 1 0 409664451 63307776 9395 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 15456 9395 845 493 0 8761 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 61824 KiB
Current children cumulated memory: 37580 KiB

[startup+6.30033 s]
/proc/loadavg: 2.05 2.14 2.10 3/200 14897
/proc/meminfo: memFree=15231656/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=98028 memory=72280 CPUtime=6.29 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 18392 0 0 0 627 2 0 0 20 0 1 0 409664451 100380672 18070 33554432000 4194304 6210612 140723268896640 140723268881112 5012647 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 24507 18070 845 493 0 17812 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 98028 KiB
Current children cumulated memory: 72280 KiB

[startup+12.7003 s]
/proc/loadavg: 2.05 2.14 2.10 3/200 14897
/proc/meminfo: memFree=15094264/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=166556 memory=142232 CPUtime=12.69 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 35400 0 0 0 1265 4 0 0 20 0 1 0 409664451 170553344 35558 33554432000 4194304 6210612 140723268896640 140723268881112 5446088 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 41639 35558 845 493 0 34944 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 166556 KiB
Current children cumulated memory: 142232 KiB

[startup+25.5003 s]
/proc/loadavg: 2.04 2.13 2.10 3/200 14897
/proc/meminfo: memFree=14797728/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=309068 memory=282080 CPUtime=25.49 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 69452 0 0 0 2540 9 0 0 20 0 1 0 409664451 316485632 70520 33554432000 4194304 6210612 140723268896640 140723268881112 5442901 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 77267 70520 845 493 0 70572 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 309068 KiB
Current children cumulated memory: 282080 KiB

[startup+51.1095 s]
/proc/loadavg: 2.02 2.12 2.10 3/200 14900
/proc/meminfo: memFree=14202276/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=597452 memory=561580 CPUtime=51.09 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 135759 0 0 0 5093 16 0 0 20 0 1 0 409664451 611790848 140395 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 149363 140395 845 493 0 142668 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 597452 KiB
Current children cumulated memory: 561580 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.10 2.10 3/200 14903
/proc/meminfo: memFree=13037856/32770624 swapFree=66956340/67108860
[pid=14896] ppid=14893 vsize=1143996 memory=1118892 CPUtime=102.29 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 266957 0 0 0 10196 33 0 0 20 0 1 0 409664451 1171451904 279723 33554432000 4194304 6210612 140723268896640 140723268881112 140618712202122 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 285999 279723 845 493 0 279304 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1143996 KiB
Current children cumulated memory: 1118892 KiB

[startup+162.3 s]
/proc/loadavg: 2.46 2.21 2.13 3/200 14972
/proc/meminfo: memFree=27802988/32770624 swapFree=66956344/67108860
[pid=14896] ppid=14893 vsize=1848248 memory=1772444 CPUtime=162.28 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 420631 0 0 0 16175 53 0 0 20 0 1 0 409664451 1892605952 443111 33554432000 4194304 6210612 140723268896640 140723268881112 140618703183268 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 462062 443111 845 493 0 455367 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1848248 KiB
Current children cumulated memory: 1772444 KiB

[startup+222.3 s]
/proc/loadavg: 2.17 2.17 2.13 3/200 15042
/proc/meminfo: memFree=27147764/32770624 swapFree=66956344/67108860
[pid=14896] ppid=14893 vsize=2459408 memory=2427316 CPUtime=222.25 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 573623 0 0 0 22152 73 0 0 20 0 1 0 409664451 2518433792 606829 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 614852 606829 845 493 0 608157 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 2459408 KiB
Current children cumulated memory: 2427316 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.13 2.12 3/200 15046
/proc/meminfo: memFree=26491152/32770624 swapFree=66956344/67108860
[pid=14896] ppid=14893 vsize=3155112 memory=3081764 CPUtime=282.23 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 727553 0 0 0 28129 94 0 0 20 0 1 0 409664451 3230834688 770441 33554432000 4194304 6210612 140723268896640 140723268881112 140618703177616 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 788778 770441 845 493 0 782083 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 3155112 KiB
Current children cumulated memory: 3081764 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.10 2.11 3/200 15050
/proc/meminfo: memFree=25834152/32770624 swapFree=66956344/67108860
[pid=14896] ppid=14893 vsize=3765876 memory=3736308 CPUtime=342.21 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 880590 0 0 0 34110 111 0 0 20 0 1 0 409664451 3856257024 934077 33554432000 4194304 6210612 140723268896640 140723268881112 140618712202068 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 941469 934077 845 493 0 934774 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 3765876 KiB
Current children cumulated memory: 3736308 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.08 2.10 3/201 15062
/proc/meminfo: memFree=25175016/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=4504580 memory=4391148 CPUtime=402.19 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 1034156 0 0 0 40088 131 0 0 20 0 1 0 409664451 4612689920 1097787 33554432000 4194304 6210612 140723268896640 140723268881112 5442912 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 1126145 1097787 845 493 0 1119450 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 4504580 KiB
Current children cumulated memory: 4391148 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.07 2.10 3/201 15066
/proc/meminfo: memFree=24519104/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=5120204 memory=5045896 CPUtime=462.17 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 1187229 0 0 0 46063 154 0 0 20 0 1 0 409664451 5243088896 1261474 33554432000 4194304 6210612 140723268896640 140723268881112 5012560 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 1280051 1261474 845 493 0 1273356 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 5120204 KiB
Current children cumulated memory: 5045896 KiB


################
# More data... #
################

Current children cumulated vsize: 9866680 KiB
Current children cumulated memory: 9622788 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15106
/proc/meminfo: memFree=19280984/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=10487720 memory=10277136 CPUtime=942.04 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 2411477 0 0 0 93851 353 0 0 20 0 1 0 409664451 10739425280 2569284 33554432000 4194304 6210612 140723268896640 140723268881112 5451340 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 2621930 2569284 845 493 0 2615235 0
Current children cumulated CPU time: 942.04 s
Current children cumulated vsize: 10487720 KiB
Current children cumulated memory: 10277136 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15115
/proc/meminfo: memFree=18624148/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=11097560 memory=10930800 CPUtime=1002.02 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 2564324 0 0 0 99820 382 0 0 20 0 1 0 409664451 11363901440 2732700 33554432000 4194304 6210612 140723268896640 140723268881112 140618703177632 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 2774390 2732700 845 493 0 2767695 0
Current children cumulated CPU time: 1002.02 s
Current children cumulated vsize: 11097560 KiB
Current children cumulated memory: 10930800 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15119
/proc/meminfo: memFree=17970636/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=11707268 memory=11583524 CPUtime=1062.01 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 2716990 0 0 0 105790 411 0 0 20 0 1 0 409664451 11988242432 2895881 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 2926817 2895881 845 493 0 2920122 0
Current children cumulated CPU time: 1062.01 s
Current children cumulated vsize: 11707268 KiB
Current children cumulated memory: 11583524 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15125
/proc/meminfo: memFree=17313592/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=12316844 memory=12238136 CPUtime=1121.99 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 2869586 0 0 0 111759 440 0 0 20 0 1 0 409664451 12612448256 3059534 33554432000 4194304 6210612 140723268896640 140723268881112 140618712202068 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3079211 3059534 845 493 0 3072516 0
Current children cumulated CPU time: 1121.99 s
Current children cumulated vsize: 12316844 KiB
Current children cumulated memory: 12238136 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15129
/proc/meminfo: memFree=16660488/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=12926288 memory=12890472 CPUtime=1181.97 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3022178 0 0 0 117723 474 0 0 20 0 1 0 409664451 13236518912 3222618 33554432000 4194304 6210612 140723268896640 140723268881112 5446115 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3231572 3222618 845 493 0 3224877 0
Current children cumulated CPU time: 1181.97 s
Current children cumulated vsize: 12926288 KiB
Current children cumulated memory: 12890472 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15133
/proc/meminfo: memFree=16007412/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=13956156 memory=13542628 CPUtime=1241.95 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3175722 0 0 0 123688 507 0 0 20 0 1 0 409664451 14291103744 3385657 33554432000 4194304 6210612 140723268896640 140723268881112 5012715 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3489039 3385657 845 493 0 3482344 0
Current children cumulated CPU time: 1241.95 s
Current children cumulated vsize: 13956156 KiB
Current children cumulated memory: 13542628 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15139
/proc/meminfo: memFree=15352924/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=14565864 memory=14195868 CPUtime=1301.94 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3328500 0 0 0 129656 538 0 0 20 0 1 0 409664451 14915444736 3548967 33554432000 4194304 6210612 140723268896640 140723268881112 140618703177649 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3641466 3548967 845 493 0 3634771 0
Current children cumulated CPU time: 1301.94 s
Current children cumulated vsize: 14565864 KiB
Current children cumulated memory: 14195868 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15143
/proc/meminfo: memFree=14700088/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15175704 memory=14847592 CPUtime=1361.92 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3481411 0 0 0 135621 571 0 0 20 0 1 0 409664451 15539920896 3711898 33554432000 4194304 6210612 140723268896640 140723268881112 5446462 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3793926 3711898 845 493 0 3787231 0
Current children cumulated CPU time: 1361.92 s
Current children cumulated vsize: 15175704 KiB
Current children cumulated memory: 14847592 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15147
/proc/meminfo: memFree=14043096/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15801816 memory=15503048 CPUtime=1421.91 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3634275 0 0 0 141586 605 0 0 20 0 1 0 409664451 16181059584 3875762 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3950454 3875762 845 493 0 3943759 0
Current children cumulated CPU time: 1421.91 s
Current children cumulated vsize: 15801816 KiB
Current children cumulated memory: 15503048 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1429.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 15150
/proc/meminfo: memFree=13967056/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15872832 memory=15578364 CPUtime=1428.9 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) R 14893 14896 13363 0 -1 4202496 3652040 0 0 0 142281 609 0 0 20 0 1 0 409664451 16253779968 3894591 33554432000 4194304 6210612 140723268896640 140723268881112 140618702257125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3968208 3894591 845 493 0 3961513 0
Current children cumulated CPU time: 1428.9 s
Current children cumulated vsize: 15872832 KiB
Current children cumulated memory: 15578364 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1432.08 s]
# the end of solver process 14896 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1423.07 s, system=6.89586 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1430.4 s]
/proc/loadavg: 2.00 2.01 2.05 4/201 15151
/proc/meminfo: memFree=13599312/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15872832 memory=15578364 CPUtime=1429.06 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) S 14893 14896 13363 0 -1 512 3652044 0 0 0 142295 611 0 0 20 0 1 0 409664451 16253779968 3894591 33554432000 4194304 6210612 140723268896640 140723268881112 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3968208 3894591 845 493 0 3961513 0
Current children cumulated CPU time: 1429.06 s
Current children cumulated vsize: 15872832 KiB
Current children cumulated memory: 15578364 KiB

[startup+1430.8 s]
/proc/loadavg: 2.00 2.01 2.05 4/201 15151
/proc/meminfo: memFree=13599312/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15872832 memory=15578364 CPUtime=1429.11 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) S 14893 14896 13363 0 -1 512 3652044 0 0 0 142300 611 0 0 20 0 1 0 409664451 16253779968 3894591 33554432000 4194304 6210612 140723268896640 140723268881112 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3968208 3894591 845 493 0 3961513 0
Current children cumulated CPU time: 1429.11 s
Current children cumulated vsize: 15872832 KiB
Current children cumulated memory: 15578364 KiB

[startup+1431.2 s]
/proc/loadavg: 2.00 2.01 2.05 2/201 15151
/proc/meminfo: memFree=13113924/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15872832 memory=15578364 CPUtime=1429.17 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) S 14893 14896 13363 0 -1 512 3652044 0 0 0 142305 612 0 0 20 0 1 0 409664451 16253779968 3894591 33554432000 4194304 6210612 140723268896640 140723268881112 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3968208 3894591 845 493 0 3961513 0
Current children cumulated CPU time: 1429.17 s
Current children cumulated vsize: 15872832 KiB
Current children cumulated memory: 15578364 KiB

[startup+1431.3 s]
/proc/loadavg: 2.00 2.01 2.05 2/201 15151
/proc/meminfo: memFree=13113924/32770624 swapFree=66956348/67108860
[pid=14896] ppid=14893 vsize=15872832 memory=15578364 CPUtime=1429.18 cores=0,2,4,6
/proc/14896/stat : 14896 (cosoco) S 14893 14896 13363 0 -1 512 3652044 0 0 0 142306 612 0 0 20 0 1 0 409664451 16253779968 3894591 33554432000 4194304 6210612 140723268896640 140723268881112 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 34201600 140723268903947 140723268904049 140723268904049 140723268906958 0
/proc/14896/statm: 3968208 3894591 845 493 0 3961513 0
Current children cumulated CPU time: 1429.18 s
Current children cumulated vsize: 15872832 KiB
Current children cumulated memory: 15578364 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1432.08
CPU time (s): 1429.96
CPU user time (s): 1423.07
CPU system time (s): 6.89586
CPU usage (%): 99.8526
Max. virtual memory (cumulated for all children) (KiB): 15872832
Max. memory (cumulated for all children) (KiB): 15578364

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1423.07
system time used= 6.89586
maximum resident set size= 15578380
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3652044
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 122954
involuntary context switches= 1441


# summary of solver processes directly reported to runsolver:
#   pid: 14896
#   total CPU time (s): 1429.96
#   total CPU user time (s): 1423.07
#   total CPU system time (s): 6.89586

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.19863 second user time and 10.0403 second system time

The end

Launcher Data 

Begin job on node145 at 2019-09-13 03:13:58
IDJOB=4390296
IDBENCH=122987
IDSOLVER=2831
FILE ID=node145/4390296-1568337279
RUNJOBID= node145-1568328837-13394
PBS_JOBID= 21701155
Free space on /tmp= 55184 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-09-024-008.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390296-1568337279/watcher-4390296-1568337279 -o /tmp/evaluation-result-4390296-1568337279/solver-4390296-1568337279 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node145-1568328837-13394 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390296-1568337279.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0092e4980ed4af349e39cdcd3a0de294
RANDOM SEED=1624537295

node145.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        15320092 kB
MemAvailable:   17644552 kB
Buffers:           60056 kB
Cached:          2544884 kB
SwapCached:        42180 kB
Active:         15037280 kB
Inactive:        1798188 kB
Active(anon):   13744308 kB
Inactive(anon):   527004 kB
Active(file):    1292972 kB
Inactive(file):  1271184 kB
Unevictable:      110276 kB
Mlocked:          110276 kB
SwapTotal:      67108860 kB
SwapFree:       66956340 kB
Dirty:              2900 kB
Writeback:             0 kB
AnonPages:      14299260 kB
Mapped:            42420 kB
Shmem:             32356 kB
Slab:             180240 kB
SReclaimable:     152276 kB
SUnreclaim:        27964 kB
KernelStack:        3552 kB
PageTables:        33708 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:   14934056 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1538048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 54704 MiB
End job on node145 at 2019-09-13 03:37:50