Trace number 4408954

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1176.74 1178.6

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-015-006.xml
MD5SUMd279c4dbde03937b121f919805027b3b
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.93758
Satisfiable
(Un)Satisfiability was proved
Number of variables151
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size14
Distribution of domain sizes[{"size":2,"count":150},{"size":14,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":150},{"degree":46,"count":1}]
Minimum constraint arity15
Maximum constraint arity150
Distribution of constraint arities[{"arity":15,"count":10},{"arity":31,"count":45},{"arity":150,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15283 MiB free)
  memory of node 1: 16384 MiB (7024 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408954-1569793704/watcher-4408954-1569793704 -o /tmp/evaluation-result-4408954-1569793704/solver-4408954-1569793704 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node106-1569783707-21610 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408954-1569793704.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22698, runsolver pid=22695
Current StackSize limit: 8192 KiB


[startup+0.100144 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22842316/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=28720 memory=5008 CPUtime=0.1 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1460 0 0 0 10 0 0 0 20 0 1 0 555624080 29409280 1252 33554432000 4194304 6211132 140732573004176 140732573000712 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 7180 1252 846 493 0 485 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28720 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209488 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22839712/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=30248 memory=6612 CPUtime=0.21 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1816 0 0 0 21 0 0 0 20 0 1 0 555624080 30973952 1653 33554432000 4194304 6211132 140732573004176 140732573000712 140557801393125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 7562 1653 846 493 0 867 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30248 KiB
Current children cumulated memory: 6612 KiB

[startup+0.308898 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22837852/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=31628 memory=7680 CPUtime=0.31 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2140 0 0 0 31 0 0 0 20 0 1 0 555624080 32387072 1920 33554432000 4194304 6211132 140732573004176 140732573000712 140557801393125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 7907 1920 846 493 0 1212 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31628 KiB
Current children cumulated memory: 7680 KiB

[startup+0.700278 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22833672/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=36828 memory=12772 CPUtime=0.69 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 3395 0 0 0 69 0 0 0 20 0 1 0 555624080 37711872 3193 33554432000 4194304 6211132 140732573004176 140732573000712 5446959 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 9207 3193 846 493 0 2512 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36828 KiB
Current children cumulated memory: 12772 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22823216/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=47800 memory=23164 CPUtime=1.48 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 6011 0 0 0 148 0 0 0 20 0 1 0 555624080 48947200 5791 33554432000 4194304 6211132 140732573004176 140732572992104 5452189 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 11950 5791 846 493 0 5255 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 47800 KiB
Current children cumulated memory: 23164 KiB

[startup+3.10932 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22782452/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=68224 memory=44188 CPUtime=3.09 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 11309 0 0 0 308 1 0 0 20 0 1 0 555624080 69861376 11047 33554432000 4194304 6211132 140732573004176 140732572992104 5454208 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 17056 11047 846 493 0 10361 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 68224 KiB
Current children cumulated memory: 44188 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22719452/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=111368 memory=86656 CPUtime=6.29 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 21434 0 0 0 626 3 0 0 20 0 1 0 555624080 114040832 21664 33554432000 4194304 6211132 140732573004176 140732572992104 5451553 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 27842 21664 846 493 0 21147 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 111368 KiB
Current children cumulated memory: 86656 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22596860/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=199076 memory=169580 CPUtime=12.68 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 41715 0 0 0 1263 5 0 0 20 0 1 0 555624080 203853824 42395 33554432000 4194304 6211132 140732573004176 140732572992104 5013078 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 49769 42395 846 493 0 43074 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 199076 KiB
Current children cumulated memory: 169580 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22699
/proc/meminfo: memFree=22328184/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=361468 memory=337452 CPUtime=25.49 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 80116 0 0 0 2538 11 0 0 20 0 1 0 555624080 370143232 84363 33554432000 4194304 6211132 140732573004176 140732572992104 5451553 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 90367 84363 846 493 0 83672 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 361468 KiB
Current children cumulated memory: 337452 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22701
/proc/meminfo: memFree=21788480/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=705432 memory=673348 CPUtime=51.09 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 156977 0 0 0 5087 22 0 0 20 0 1 0 555624080 722362368 168337 33554432000 4194304 6211132 140732573004176 140732572992104 140557801393125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 176358 168337 846 493 0 169663 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 705432 KiB
Current children cumulated memory: 673348 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 22705
/proc/meminfo: memFree=20735544/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=1403756 memory=1342316 CPUtime=102.29 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 309412 0 0 0 10184 45 0 0 20 0 1 0 555624080 1437446144 335579 33554432000 4194304 6211132 140732573004176 140732572992104 5455682 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 350939 335579 846 493 0 344244 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1403756 KiB
Current children cumulated memory: 1342316 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22710
/proc/meminfo: memFree=19498000/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=2201100 memory=2126580 CPUtime=162.28 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 487066 0 0 0 16158 70 0 0 20 0 1 0 555624080 2253926400 531645 33554432000 4194304 6211132 140732573004176 140732572992104 5451604 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 550275 531645 846 493 0 543580 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2201100 KiB
Current children cumulated memory: 2126580 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22724
/proc/meminfo: memFree=18258132/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=3039820 memory=2912224 CPUtime=222.28 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 665132 0 0 0 22134 94 0 0 20 0 1 0 555624080 3112775680 728056 33554432000 4194304 6211132 140732573004176 140732572992104 140557802317374 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 759955 728056 846 493 0 753260 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 3039820 KiB
Current children cumulated memory: 2912224 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22728
/proc/meminfo: memFree=17020004/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=3747208 memory=3699764 CPUtime=282.28 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 842181 0 0 0 28110 118 0 0 20 0 1 0 555624080 3837140992 924941 33554432000 4194304 6211132 140732573004176 140732572992104 5443124 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 936802 924941 846 493 0 930107 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 3747208 KiB
Current children cumulated memory: 3699764 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22732
/proc/meminfo: memFree=15779196/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=4652124 memory=4486348 CPUtime=342.28 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1020451 0 0 0 34085 143 0 0 20 0 1 0 555624080 4763774976 1121587 33554432000 4194304 6211132 140732573004176 140732572992104 5442969 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 1163031 1121587 846 493 0 1156336 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 4652124 KiB
Current children cumulated memory: 4486348 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22738
/proc/meminfo: memFree=14541708/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=5359116 memory=5270940 CPUtime=402.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1197316 0 0 0 40057 170 0 0 20 0 1 0 555624080 5487734784 1317735 33554432000 4194304 6211132 140732573004176 140732572992104 140557801385640 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 1339779 1317735 846 493 0 1333084 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 5359116 KiB
Current children cumulated memory: 5270940 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22742
/proc/meminfo: memFree=13302648/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=6346520 memory=6055856 CPUtime=462.28 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1374727 0 0 0 46033 195 0 0 20 0 1 0 555624080 6498836480 1513964 33554432000 4194304 6211132 140732573004176 140732572992104 5451564 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 1586630 1513964 846 493 0 1579935 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 6346520 KiB
Current children cumulated memory: 6055856 KiB


################
# More data... #
################

Current children cumulated vsize: 7776512 KiB
Current children cumulated memory: 7627336 KiB

[startup+642.3 s]
/proc/loadavg: 2.15 2.11 2.08 3/198 22757
/proc/meminfo: memFree=9586188/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=8507712 memory=8411880 CPUtime=642.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 1906263 0 0 0 63949 278 0 0 20 0 1 0 555624080 8711897088 2102970 33554432000 4194304 6211132 140732573004176 140732572992104 140557802317390 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 2126928 2102970 846 493 0 2120233 0
Current children cumulated CPU time: 642.27 s
Current children cumulated vsize: 8507712 KiB
Current children cumulated memory: 8411880 KiB

[startup+702.3 s]
/proc/loadavg: 2.06 2.09 2.07 3/198 22762
/proc/meminfo: memFree=8349160/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=9634468 memory=9195532 CPUtime=702.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2083436 0 0 0 69915 312 0 0 20 0 1 0 555624080 9865695232 2298883 33554432000 4194304 6211132 140732573004176 140732572992104 140557811338072 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 2408617 2298883 846 493 0 2401922 0
Current children cumulated CPU time: 702.27 s
Current children cumulated vsize: 9634468 KiB
Current children cumulated memory: 9195532 KiB

[startup+762.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/198 22768
/proc/meminfo: memFree=7109712/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=10341196 memory=9982320 CPUtime=762.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2260273 0 0 0 75882 345 0 0 20 0 1 0 555624080 10589384704 2495580 33554432000 4194304 6211132 140732573004176 140732572992104 140557802316634 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 2585299 2495580 846 493 0 2578604 0
Current children cumulated CPU time: 762.27 s
Current children cumulated vsize: 10341196 KiB
Current children cumulated memory: 9982320 KiB

[startup+822.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/198 22779
/proc/meminfo: memFree=5871540/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=11048056 memory=10766952 CPUtime=822.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2437163 0 0 0 81851 376 0 0 20 0 1 0 555624080 11313209344 2691738 33554432000 4194304 6211132 140732573004176 140732572992104 140557801393125 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 2762014 2691738 846 493 0 2755319 0
Current children cumulated CPU time: 822.27 s
Current children cumulated vsize: 11048056 KiB
Current children cumulated memory: 10766952 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/198 22805
/proc/meminfo: memFree=4631556/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=11791828 memory=11553836 CPUtime=882.27 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2614599 0 0 0 87817 410 0 0 20 0 1 0 555624080 12074831872 2888459 33554432000 4194304 6211132 140732573004176 140732572992104 5451516 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 2947957 2888459 846 493 0 2941262 0
Current children cumulated CPU time: 882.27 s
Current children cumulated vsize: 11791828 KiB
Current children cumulated memory: 11553836 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.04 2.05 2/197 22820
/proc/meminfo: memFree=18564836/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=12498028 memory=12337684 CPUtime=942.26 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2791303 0 0 0 93779 447 0 0 20 0 1 0 555624080 12797980672 3084421 33554432000 4194304 6211132 140732573004176 140732572992104 5454192 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3124507 3084421 846 493 0 3117812 0
Current children cumulated CPU time: 942.26 s
Current children cumulated vsize: 12498028 KiB
Current children cumulated memory: 12337684 KiB

[startup+1002.3 s]
/proc/loadavg: 2.17 2.10 2.07 3/199 22880
/proc/meminfo: memFree=18482112/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=13203040 memory=13120732 CPUtime=1002.23 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 2967748 0 0 0 99739 484 0 0 20 0 1 0 555624080 13519912960 3280183 33554432000 4194304 6211132 140732573004176 140732572992104 5443025 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3300760 3280183 846 493 0 3294065 0
Current children cumulated CPU time: 1002.23 s
Current children cumulated vsize: 13203040 KiB
Current children cumulated memory: 13120732 KiB

[startup+1062.3 s]
/proc/loadavg: 2.06 2.08 2.06 3/199 22884
/proc/meminfo: memFree=17696968/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=14538816 memory=13903796 CPUtime=1062.2 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 3144743 0 0 0 105701 519 0 0 20 0 1 0 555624080 14887747584 3475949 33554432000 4194304 6211132 140732573004176 140732572992104 5013034 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3634704 3475949 846 493 0 3628009 0
Current children cumulated CPU time: 1062.2 s
Current children cumulated vsize: 14538816 KiB
Current children cumulated memory: 13903796 KiB

[startup+1122.3 s]
/proc/loadavg: 2.02 2.07 2.06 3/199 22890
/proc/meminfo: memFree=16911000/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15243564 memory=14688296 CPUtime=1122.17 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 3321118 0 0 0 111659 558 0 0 20 0 1 0 555624080 15609409536 3672074 33554432000 4194304 6211132 140732573004176 140732572992104 5478664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3810891 3672074 846 493 0 3804196 0
Current children cumulated CPU time: 1122.17 s
Current children cumulated vsize: 15243564 KiB
Current children cumulated memory: 14688296 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1175.8 s]
/proc/loadavg: 2.01 2.06 2.05 3/199 22894
/proc/meminfo: memFree=16219240/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15872016 memory=15384148 CPUtime=1175.64 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) R 22695 22698 21579 0 -1 4202496 3478365 0 0 0 116972 592 0 0 20 0 1 0 555624080 16252944384 3846037 33554432000 4194304 6211132 140732573004176 140732572992104 5443096 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3968004 3846037 846 493 0 3961309 0
Current children cumulated CPU time: 1175.64 s
Current children cumulated vsize: 15872016 KiB
Current children cumulated memory: 15384148 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1178.6 s]
# the end of solver process 22698 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1170 s, system=6.74618 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1176 s]*
/proc/loadavg: 2.01 2.06 2.05 4/200 22895
/proc/meminfo: memFree=16095580/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15872016 memory=15384408 CPUtime=1175.68 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) S 22695 22698 21579 0 -1 512 3478370 0 0 0 116975 593 0 0 20 0 1 0 555624080 16252944384 3846102 33554432000 4194304 6211132 140732573004176 140732572992104 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3968004 3846102 846 493 0 3961309 0
Current children cumulated CPU time: 1175.68 s
Current children cumulated vsize: 15872016 KiB
Current children cumulated memory: 15384408 KiB

[startup+1176.8 s]
/proc/loadavg: 2.01 2.06 2.05 4/200 22895
/proc/meminfo: memFree=16095580/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15872016 memory=15384408 CPUtime=1175.79 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) S 22695 22698 21579 0 -1 512 3478370 0 0 0 116986 593 0 0 20 0 1 0 555624080 16252944384 3846102 33554432000 4194304 6211132 140732573004176 140732572992104 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3968004 3846102 846 493 0 3961309 0
Current children cumulated CPU time: 1175.79 s
Current children cumulated vsize: 15872016 KiB
Current children cumulated memory: 15384408 KiB

[startup+1177.6 s]
/proc/loadavg: 2.01 2.06 2.05 3/200 22895
/proc/meminfo: memFree=15589652/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15872016 memory=15384408 CPUtime=1175.91 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) S 22695 22698 21579 0 -1 512 3478370 0 0 0 116997 594 0 0 20 0 1 0 555624080 16252944384 3846102 33554432000 4194304 6211132 140732573004176 140732572992104 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3968004 3846102 846 493 0 3961309 0
Current children cumulated CPU time: 1175.91 s
Current children cumulated vsize: 15872016 KiB
Current children cumulated memory: 15384408 KiB

[startup+1177.8 s]
/proc/loadavg: 2.01 2.06 2.05 3/200 22895
/proc/meminfo: memFree=15589652/32770624 swapFree=67000008/67108860
[pid=22698] ppid=22695 vsize=15872016 memory=15384408 CPUtime=1175.93 cores=0,2,4,6
/proc/22698/stat : 22698 (cosoco) S 22695 22698 21579 0 -1 512 3478370 0 0 0 116999 594 0 0 20 0 1 0 555624080 16252944384 3846102 33554432000 4194304 6211132 140732573004176 140732572992104 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 12718080 140732573013003 140732573013105 140732573013105 140732573016014 0
/proc/22698/statm: 3968004 3846102 846 493 0 3961309 0
Current children cumulated CPU time: 1175.93 s
Current children cumulated vsize: 15872016 KiB
Current children cumulated memory: 15384408 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1178.6
CPU time (s): 1176.74
CPU user time (s): 1170
CPU system time (s): 6.74618
CPU usage (%): 99.8424
Max. virtual memory (cumulated for all children) (KiB): 15872016
Max. memory (cumulated for all children) (KiB): 15384408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1170
system time used= 6.74618
maximum resident set size= 15384412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3478370
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 126522
involuntary context switches= 402


# summary of solver processes directly reported to runsolver:
#   pid: 22698
#   total CPU time (s): 1176.74
#   total CPU user time (s): 1170
#   total CPU system time (s): 6.74618

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.9635 second user time and 8.29858 second system time

The end

Launcher Data 

Begin job on node106 at 2019-09-29 22:46:57
IDJOB=4408954
IDBENCH=122976
IDSOLVER=2876
FILE ID=node106/4408954-1569793704
RUNJOBID= node106-1569783707-21610
PBS_JOBID= 21705837
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-015-006.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408954-1569793704/watcher-4408954-1569793704 -o /tmp/evaluation-result-4408954-1569793704/solver-4408954-1569793704 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node106-1569783707-21610 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408954-1569793704.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d279c4dbde03937b121f919805027b3b
RANDOM SEED=1699843195

node106.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22844060 kB
MemAvailable:   23068340 kB
Buffers:          164776 kB
Cached:           384212 kB
SwapCached:         4560 kB
Active:          9047484 kB
Inactive:         292324 kB
Active(anon):    8800700 kB
Inactive(anon):    67128 kB
Active(file):     246784 kB
Inactive(file):   225196 kB
Unevictable:      108916 kB
Mlocked:          108916 kB
SwapTotal:      67108860 kB
SwapFree:       67000008 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:       8895760 kB
Mapped:            27892 kB
Shmem:             68520 kB
Slab:             165208 kB
SReclaimable:     136272 kB
SUnreclaim:        28936 kB
KernelStack:        3536 kB
PageTables:        22384 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    9353768 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1814528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 61532 MiB
End job on node106 at 2019-09-29 23:06:36