Trace number 4408317

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1708.7 1710.54

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-038-010.xml
MD5SUM8e449228b7b3cf049a5fccac2aa13fe6
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark4.37968
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size37
Distribution of domain sizes[{"size":2,"count":380},{"size":37,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":380},{"degree":46,"count":1}]
Minimum constraint arity38
Maximum constraint arity380
Distribution of constraint arities[{"arity":38,"count":10},{"arity":77,"count":45},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12269 MiB free)
  memory of node 1: 16384 MiB (14265 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408317-1569792435/watcher-4408317-1569792435 -o /tmp/evaluation-result-4408317-1569792435/solver-4408317-1569792435 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1569787355-25779 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408317-1569792435.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=26597, runsolver pid=26594
Current StackSize limit: 8192 KiB


[startup+0.100757 s]*
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27169676/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=28416 memory=4744 CPUtime=0.1 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 1402 0 0 0 10 0 0 0 20 0 1 0 555404981 29097984 1186 33554432000 4194304 6211132 140730044705280 140730044684376 5012856 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 7104 1186 845 493 0 409 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28416 KiB
Current children cumulated memory: 4744 KiB

[startup+0.209138 s]*
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27167664/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=29512 memory=5800 CPUtime=0.21 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 1649 0 0 0 21 0 0 0 20 0 1 0 555404981 30220288 1450 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 7378 1450 846 493 0 683 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29512 KiB
Current children cumulated memory: 5800 KiB

[startup+0.308721 s]*
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27165556/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=30344 memory=6592 CPUtime=0.31 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 1876 0 0 0 31 0 0 0 20 0 1 0 555404981 31072256 1648 33554432000 4194304 6211132 140730044705280 140730044684376 140521916805982 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 7586 1648 846 493 0 891 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30344 KiB
Current children cumulated memory: 6592 KiB

[startup+0.700239 s]
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27161092/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=33984 memory=10160 CPUtime=0.69 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 2753 0 0 0 69 0 0 0 20 0 1 0 555404981 34799616 2540 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 8496 2540 846 493 0 1801 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33984 KiB
Current children cumulated memory: 10160 KiB

[startup+1.50024 s]
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27150676/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=41456 memory=17436 CPUtime=1.49 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 4584 0 0 0 149 0 0 0 20 0 1 0 555404981 42450944 4359 33554432000 4194304 6211132 140730044705280 140730044684376 5441167 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 10364 4359 846 493 0 3669 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 41456 KiB
Current children cumulated memory: 17436 KiB

[startup+3.10921 s]
/proc/loadavg: 2.06 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27106716/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=56516 memory=32324 CPUtime=3.09 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 8307 0 0 0 309 0 0 0 20 0 1 0 555404981 57872384 8081 33554432000 4194304 6211132 140730044705280 140730044684376 5440643 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 14129 8081 846 493 0 7434 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 56516 KiB
Current children cumulated memory: 32324 KiB

[startup+6.30023 s]
/proc/loadavg: 2.05 2.07 2.05 3/199 26598
/proc/meminfo: memFree=27041428/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=85328 memory=61432 CPUtime=6.28 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 15657 0 0 0 627 1 0 0 20 0 1 0 555404981 87375872 15358 33554432000 4194304 6211132 140730044705280 140730044684376 5013001 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 21332 15358 846 493 0 14637 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 85328 KiB
Current children cumulated memory: 61432 KiB

[startup+12.7002 s]
/proc/loadavg: 2.05 2.06 2.05 3/199 26598
/proc/meminfo: memFree=26913660/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=144900 memory=120092 CPUtime=12.68 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 30349 0 0 0 1266 2 0 0 20 0 1 0 555404981 148377600 30023 33554432000 4194304 6211132 140730044705280 140730044684376 5446292 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 36225 30023 846 493 0 29530 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 144900 KiB
Current children cumulated memory: 120092 KiB

[startup+25.5002 s]
/proc/loadavg: 2.04 2.06 2.05 3/199 26599
/proc/meminfo: memFree=26630952/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=264784 memory=238424 CPUtime=25.49 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 59537 0 0 0 2542 7 0 0 20 0 1 0 555404981 271138816 59606 33554432000 4194304 6211132 140730044705280 140730044684376 140521916806721 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 66196 59606 846 493 0 59501 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 264784 KiB
Current children cumulated memory: 238424 KiB

[startup+51.1093 s]
/proc/loadavg: 2.03 2.06 2.05 3/199 26601
/proc/meminfo: memFree=26071184/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=495808 memory=471632 CPUtime=51.08 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 115863 0 0 0 5093 15 0 0 20 0 1 0 555404981 507707392 117908 33554432000 4194304 6211132 140730044705280 140730044684376 5013034 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 123952 117908 846 493 0 117257 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 495808 KiB
Current children cumulated memory: 471632 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/199 26606
/proc/meminfo: memFree=24969512/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=973188 memory=944340 CPUtime=102.28 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 229449 0 0 0 10195 33 0 0 20 0 1 0 555404981 996544512 236085 33554432000 4194304 6211132 140730044705280 140730044684376 140521915878206 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 243297 236085 846 493 0 236602 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 973188 KiB
Current children cumulated memory: 944340 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 26610
/proc/meminfo: memFree=23672812/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=1525548 memory=1496672 CPUtime=162.28 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 361924 0 0 0 16177 51 0 0 20 0 1 0 555404981 1562161152 374168 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 381387 374168 846 493 0 374692 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1525548 KiB
Current children cumulated memory: 1496672 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 26624
/proc/meminfo: memFree=22374876/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=2090492 memory=2049164 CPUtime=222.28 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 494455 0 0 0 22160 68 0 0 20 0 1 0 555404981 2140663808 512291 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 522623 512291 846 493 0 515928 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2090492 KiB
Current children cumulated memory: 2049164 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 26628
/proc/meminfo: memFree=21078328/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=2674100 memory=2601892 CPUtime=282.29 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 627042 0 0 0 28142 87 0 0 20 0 1 0 555404981 2738278400 650473 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 668525 650473 846 493 0 661830 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2674100 KiB
Current children cumulated memory: 2601892 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 26632
/proc/meminfo: memFree=19781824/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=3202532 memory=3154708 CPUtime=342.29 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 759152 0 0 0 34122 107 0 0 20 0 1 0 555404981 3279392768 788677 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 800633 788677 846 493 0 793938 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 3202532 KiB
Current children cumulated memory: 3154708 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 26638
/proc/meminfo: memFree=18486632/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=3730004 memory=3705748 CPUtime=402.3 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 891432 0 0 0 40102 128 0 0 20 0 1 0 555404981 3819524096 926437 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 932501 926437 846 493 0 925806 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 3730004 KiB
Current children cumulated memory: 3705748 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 26642
/proc/meminfo: memFree=17190800/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=4341960 memory=4258932 CPUtime=462.29 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 1023695 0 0 0 46082 147 0 0 20 0 1 0 555404981 4446167040 1064733 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 1085490 1064733 846 493 0 1078795 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 4341960 KiB
Current children cumulated memory: 4258932 KiB


################
# More data... #
################

Current children cumulated vsize: 10455036 KiB
Current children cumulated memory: 10331856 KiB

[startup+1182.3 s]
/proc/loadavg: 2.98 2.30 2.14 3/199 26772
/proc/meminfo: memFree=17692144/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=10981452 memory=10883664 CPUtime=1182.31 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 2609218 0 0 0 117775 456 0 0 20 0 1 0 555404981 11245006848 2720916 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 2745363 2720916 846 493 0 2738668 0
Current children cumulated CPU time: 1182.31 s
Current children cumulated vsize: 10981452 KiB
Current children cumulated memory: 10883664 KiB

[startup+1242.3 s]
/proc/loadavg: 2.36 2.24 2.13 3/199 26776
/proc/meminfo: memFree=17139904/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=11507736 memory=11435140 CPUtime=1242.3 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 2741224 0 0 0 123745 485 0 0 20 0 1 0 555404981 11783921664 2858785 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 2876934 2858785 846 493 0 2870239 0
Current children cumulated CPU time: 1242.3 s
Current children cumulated vsize: 11507736 KiB
Current children cumulated memory: 11435140 KiB

[startup+1302.3 s]
/proc/loadavg: 2.13 2.20 2.13 3/199 26782
/proc/meminfo: memFree=16587180/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=12038880 memory=11986476 CPUtime=1302.29 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 2873129 0 0 0 129714 515 0 0 20 0 1 0 555404981 12327813120 2996619 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3009720 2996619 846 493 0 3003025 0
Current children cumulated CPU time: 1302.29 s
Current children cumulated vsize: 12038880 KiB
Current children cumulated memory: 11986476 KiB

[startup+1362.3 s]
/proc/loadavg: 2.05 2.16 2.12 3/199 26786
/proc/meminfo: memFree=16035392/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=12565296 memory=12537292 CPUtime=1362.27 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3004959 0 0 0 135682 545 0 0 20 0 1 0 555404981 12866863104 3134323 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3141324 3134323 846 493 0 3134629 0
Current children cumulated CPU time: 1362.27 s
Current children cumulated vsize: 12565296 KiB
Current children cumulated memory: 12537292 KiB

[startup+1422.3 s]
/proc/loadavg: 2.02 2.13 2.11 3/200 26798
/proc/meminfo: memFree=15480908/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=13371464 memory=13089872 CPUtime=1422.25 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3137149 0 0 0 141648 577 0 0 20 0 1 0 555404981 13692379136 3272468 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3342866 3272468 846 493 0 3336171 0
Current children cumulated CPU time: 1422.25 s
Current children cumulated vsize: 13371464 KiB
Current children cumulated memory: 13089872 KiB

[startup+1482.3 s]
/proc/loadavg: 2.01 2.11 2.11 3/200 26804
/proc/meminfo: memFree=14928960/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=13897484 memory=13640424 CPUtime=1482.24 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3268885 0 0 0 147613 611 0 0 20 0 1 0 555404981 14231023616 3410106 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3474371 3410106 846 493 0 3467676 0
Current children cumulated CPU time: 1482.24 s
Current children cumulated vsize: 13897484 KiB
Current children cumulated memory: 13640424 KiB

[startup+1542.3 s]
/proc/loadavg: 2.53 2.23 2.15 3/200 26808
/proc/meminfo: memFree=14377972/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=14423240 memory=14190844 CPUtime=1542.23 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3400554 0 0 0 153573 650 0 0 20 0 1 0 555404981 14769397760 3547711 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3605810 3547711 846 493 0 3599115 0
Current children cumulated CPU time: 1542.23 s
Current children cumulated vsize: 14423240 KiB
Current children cumulated memory: 14190844 KiB

[startup+1602.3 s]
/proc/loadavg: 2.19 2.19 2.14 3/200 26826
/proc/meminfo: memFree=13825544/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=14948996 memory=14741184 CPUtime=1602.22 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3532209 0 0 0 159534 688 0 0 20 0 1 0 555404981 15307771904 3685296 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3737249 3685296 846 493 0 3730554 0
Current children cumulated CPU time: 1602.22 s
Current children cumulated vsize: 14948996 KiB
Current children cumulated memory: 14741184 KiB

[startup+1662.3 s]
/proc/loadavg: 2.07 2.15 2.13 3/200 26832
/proc/meminfo: memFree=13274064/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15474620 memory=15291472 CPUtime=1662.2 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3663914 0 0 0 165496 724 0 0 20 0 1 0 555404981 15846010880 3822868 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3868655 3822868 846 493 0 3861960 0
Current children cumulated CPU time: 1662.2 s
Current children cumulated vsize: 15474620 KiB
Current children cumulated memory: 15291472 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1707.7 s]
/proc/loadavg: 2.03 2.13 2.13 3/199 26837
/proc/meminfo: memFree=12860056/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15872072 memory=15707772 CPUtime=1707.6 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 4202496 3763538 0 0 0 170007 753 0 0 20 0 1 0 555404981 16253001728 3926943 33554432000 4194304 6211132 140730044705280 140730044684376 140521915882469 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3968018 3926943 846 493 0 3961323 0
Current children cumulated CPU time: 1707.6 s
Current children cumulated vsize: 15872072 KiB
Current children cumulated memory: 15707772 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1710.54 s]
# the end of solver process 26597 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1700.3 s, system=8.39416 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1708.8 s]
/proc/loadavg: 2.03 2.13 2.13 3/200 26838
/proc/meminfo: memFree=12698880/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15872072 memory=15707772 CPUtime=1707.76 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 512 3763542 0 0 0 170023 753 0 0 20 0 1 0 555404981 16253001728 3926943 33554432000 4194304 6211132 140730044705280 140730044684376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3968018 3926943 846 493 0 3961323 0
Current children cumulated CPU time: 1707.76 s
Current children cumulated vsize: 15872072 KiB
Current children cumulated memory: 15707772 KiB

[startup+1709.2 s]
/proc/loadavg: 2.03 2.13 2.13 3/200 26838
/proc/meminfo: memFree=12191332/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15872072 memory=15707772 CPUtime=1707.82 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) R 26594 26597 25748 0 -1 512 3763542 0 0 0 170028 754 0 0 20 0 1 0 555404981 16253001728 3926943 33554432000 4194304 6211132 140730044705280 140730044684376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3968018 3926943 846 493 0 3961323 0
Current children cumulated CPU time: 1707.82 s
Current children cumulated vsize: 15872072 KiB
Current children cumulated memory: 15707772 KiB

[startup+1709.6 s]
/proc/loadavg: 2.03 2.13 2.13 3/200 26838
/proc/meminfo: memFree=12191332/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15872072 memory=15707772 CPUtime=1707.85 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) S 26594 26597 25748 0 -1 512 3763542 0 0 0 170030 755 0 0 20 0 1 0 555404981 16253001728 3926943 33554432000 4194304 6211132 140730044705280 140730044684376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3968018 3926943 846 493 0 3961323 0
Current children cumulated CPU time: 1707.85 s
Current children cumulated vsize: 15872072 KiB
Current children cumulated memory: 15707772 KiB

[startup+1709.7 s]
/proc/loadavg: 2.03 2.13 2.13 3/200 26838
/proc/meminfo: memFree=12191332/32770624 swapFree=67002732/67108860
[pid=26597] ppid=26594 vsize=15872072 memory=15707772 CPUtime=1707.85 cores=0,2,4,6
/proc/26597/stat : 26597 (cosoco) S 26594 26597 25748 0 -1 512 3763542 0 0 0 170030 755 0 0 20 0 1 0 555404981 16253001728 3926943 33554432000 4194304 6211132 140730044705280 140730044684376 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 30162944 140730044707851 140730044707953 140730044707953 140730044710862 0
/proc/26597/statm: 3968018 3926943 846 493 0 3961323 0
Current children cumulated CPU time: 1707.85 s
Current children cumulated vsize: 15872072 KiB
Current children cumulated memory: 15707772 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1710.54
CPU time (s): 1708.7
CPU user time (s): 1700.3
CPU system time (s): 8.39416
CPU usage (%): 99.892
Max. virtual memory (cumulated for all children) (KiB): 15872072
Max. memory (cumulated for all children) (KiB): 15707772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1700.3
system time used= 8.39416
maximum resident set size= 15707804
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3763542
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 102436
involuntary context switches= 2096


# summary of solver processes directly reported to runsolver:
#   pid: 26597
#   total CPU time (s): 1708.7
#   total CPU user time (s): 1700.3
#   total CPU system time (s): 8.39416

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.7123 second user time and 11.914 second system time

The end

Launcher Data 

Begin job on node148 at 2019-09-29 23:26:37
IDJOB=4408317
IDBENCH=122994
IDSOLVER=2874
FILE ID=node148/4408317-1569792435
RUNJOBID= node148-1569787355-25779
PBS_JOBID= 21705817
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-038-010.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408317-1569792435/watcher-4408317-1569792435 -o /tmp/evaluation-result-4408317-1569792435/solver-4408317-1569792435 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1569787355-25779 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408317-1569792435.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e449228b7b3cf049a5fccac2aa13fe6
RANDOM SEED=789568141

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27172684 kB
MemAvailable:   30449100 kB
Buffers:          158016 kB
Cached:          3457708 kB
SwapCached:         3492 kB
Active:          3647084 kB
Inactive:        1396672 kB
Active(anon):    1441520 kB
Inactive(anon):    67088 kB
Active(file):    2205564 kB
Inactive(file):  1329584 kB
Unevictable:      110976 kB
Mlocked:          110976 kB
SwapTotal:      67108860 kB
SwapFree:       67002732 kB
Dirty:              2584 kB
Writeback:             0 kB
AnonPages:       1537332 kB
Mapped:            28284 kB
Shmem:             71796 kB
Slab:             143592 kB
SReclaimable:     114208 kB
SUnreclaim:        29384 kB
KernelStack:        3520 kB
PageTables:         8296 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2001120 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    157696 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 61624 MiB
End job on node148 at 2019-09-29 23:55:08