Trace number 4397771

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 2103.88 2105.72

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-04-350-100.xml
MD5SUM05a37308653f1418d8a9d31e27700b02
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark9
Best CPU time to get the best result obtained on this benchmark10.3495
Satisfiable
(Un)Satisfiability was proved
Number of variables1401
Number of constraints11
Number of domains2
Minimum domain size2
Maximum domain size342
Distribution of domain sizes[{"size":2,"count":1400},{"size":342,"count":1}]
Minimum variable degree5
Maximum variable degree7
Distribution of variable degrees[{"degree":5,"count":1400},{"degree":7,"count":1}]
Minimum constraint arity350
Maximum constraint arity1400
Distribution of constraint arities[{"arity":350,"count":4},{"arity":701,"count":6},{"arity":1400,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":10}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9440 MiB free)
  memory of node 1: 16384 MiB (15458 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397771-1568575312/watcher-4397771-1568575312 -o /tmp/evaluation-result-4397771-1568575312/solver-4397771-1568575312 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568572740-702 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397771-1568575312.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=1189, runsolver pid=1186
Current StackSize limit: 8192 KiB


[startup+0.100198 s]*
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25495228/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=29224 memory=5640 CPUtime=0.1 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 1605 0 0 0 10 0 0 0 20 0 1 0 433779837 29925376 1410 33554432000 4194304 6211092 140729859437664 140729859434200 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 7306 1410 846 493 0 611 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29224 KiB
Current children cumulated memory: 5640 KiB

[startup+0.209814 s]*
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25494484/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=30016 memory=6432 CPUtime=0.21 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 1812 0 0 0 21 0 0 0 20 0 1 0 433779837 30736384 1608 33554432000 4194304 6211092 140729859437664 140729859434200 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 7504 1608 846 493 0 809 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30016 KiB
Current children cumulated memory: 6432 KiB

[startup+0.30924 s]*
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25493740/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=30808 memory=7224 CPUtime=0.31 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 2000 0 0 0 31 0 0 0 20 0 1 0 433779837 31547392 1806 33554432000 4194304 6211092 140729859437664 140729859434200 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 7702 1806 846 493 0 1007 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30808 KiB
Current children cumulated memory: 7224 KiB

[startup+0.700338 s]
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25492224/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=33712 memory=10128 CPUtime=0.69 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 2727 0 0 0 69 0 0 0 20 0 1 0 433779837 34521088 2532 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 8428 2532 846 493 0 1733 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33712 KiB
Current children cumulated memory: 10128 KiB

[startup+1.50034 s]
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25488256/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=39652 memory=16200 CPUtime=1.49 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 4237 0 0 0 149 0 0 0 20 0 1 0 433779837 40603648 4050 33554432000 4194304 6211092 140729859437664 140729859296952 140410126440336 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 9913 4050 846 493 0 3218 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39652 KiB
Current children cumulated memory: 16200 KiB

[startup+3.10968 s]
/proc/loadavg: 1.99 1.99 1.87 3/200 1190
/proc/meminfo: memFree=25473252/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=51860 memory=28376 CPUtime=3.1 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 7460 0 0 0 309 1 0 0 20 0 1 0 433779837 53104640 7094 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 12965 7094 846 493 0 6270 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 51860 KiB
Current children cumulated memory: 28376 KiB

[startup+6.30033 s]
/proc/loadavg: 1.83 1.95 1.86 3/200 1190
/proc/meminfo: memFree=25450808/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=76008 memory=52424 CPUtime=6.29 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 13652 0 0 0 627 2 0 0 20 0 1 0 433779837 77832192 13106 33554432000 4194304 6211092 140729859437664 140729859296952 5478709 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 19002 13106 846 493 0 12307 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 76008 KiB
Current children cumulated memory: 52424 KiB

[startup+12.7003 s]
/proc/loadavg: 1.85 1.95 1.86 3/200 1191
/proc/meminfo: memFree=25405456/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=124372 memory=100724 CPUtime=12.69 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 25899 0 0 0 1265 4 0 0 20 0 1 0 433779837 127356928 25181 33554432000 4194304 6211092 140729859437664 140729859296952 5451482 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 31093 25181 846 493 0 24398 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 124372 KiB
Current children cumulated memory: 100724 KiB

[startup+25.5003 s]
/proc/loadavg: 1.88 1.96 1.86 3/200 1193
/proc/meminfo: memFree=25306424/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=220752 memory=197264 CPUtime=25.49 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 50381 0 0 0 2542 7 0 0 20 0 1 0 433779837 226050048 49316 33554432000 4194304 6211092 140729859437664 140729859296952 5451484 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 55188 49316 846 493 0 48493 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 220752 KiB
Current children cumulated memory: 197264 KiB

[startup+51.1097 s]
/proc/loadavg: 1.92 1.96 1.87 3/200 1193
/proc/meminfo: memFree=25110228/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=414276 memory=390368 CPUtime=51.1 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 98859 0 0 0 5096 14 0 0 20 0 1 0 433779837 424218624 97592 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 103569 97592 846 493 0 96874 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 414276 KiB
Current children cumulated memory: 390368 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.96 1.87 3/200 1197
/proc/meminfo: memFree=24723084/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=801192 memory=776484 CPUtime=102.29 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 195566 0 0 0 10201 28 0 0 20 0 1 0 433779837 820420608 194121 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 200298 194121 846 493 0 193603 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 801192 KiB
Current children cumulated memory: 776484 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 1.99 1.88 3/200 1204
/proc/meminfo: memFree=24269204/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=1254000 memory=1229244 CPUtime=162.28 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 308722 0 0 0 16185 43 0 0 20 0 1 0 433779837 1284096000 307311 33554432000 4194304 6211092 140729859437664 140729859296952 140410126443358 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 313500 307311 846 493 0 306805 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1254000 KiB
Current children cumulated memory: 1229244 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 1.99 1.89 3/200 1208
/proc/meminfo: memFree=23814548/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=1708020 memory=1681688 CPUtime=222.28 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 421870 0 0 0 22168 60 0 0 20 0 1 0 433779837 1749012480 420422 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 427005 420422 846 493 0 420310 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 1708020 KiB
Current children cumulated memory: 1681688 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/199 1213
/proc/meminfo: memFree=23361092/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=2158800 memory=2134908 CPUtime=282.28 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 534657 0 0 0 28150 78 0 0 20 0 1 0 433779837 2210611200 533727 33554432000 4194304 6211092 140729859437664 140729859296952 5451552 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 539700 533727 846 493 0 533005 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2158800 KiB
Current children cumulated memory: 2134908 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/199 1219
/proc/meminfo: memFree=22908420/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=2614704 memory=2587504 CPUtime=342.27 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 647938 0 0 0 34133 94 0 0 20 0 1 0 433779837 2677456896 646876 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 653676 646876 846 493 0 646981 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 2614704 KiB
Current children cumulated memory: 2587504 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/199 1223
/proc/meminfo: memFree=22453924/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=3065352 memory=3040776 CPUtime=402.27 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 760927 0 0 0 40114 113 0 0 20 0 1 0 433779837 3138920448 760194 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 766338 760194 846 493 0 759643 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 3065352 KiB
Current children cumulated memory: 3040776 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/199 1228
/proc/meminfo: memFree=22001180/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=3523160 memory=3492352 CPUtime=462.26 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 874380 0 0 0 46094 132 0 0 20 0 1 0 433779837 3607715840 873088 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 880790 873088 846 493 0 874095 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 3523160 KiB
Current children cumulated memory: 3492352 KiB


################
# More data... #
################

Current children cumulated vsize: 11202276 KiB
Current children cumulated memory: 11177128 KiB

[startup+1542.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/199 1330
/proc/meminfo: memFree=13851088/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=11651604 memory=11627748 CPUtime=1542.2 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 2914529 0 0 0 153675 545 0 0 20 0 1 0 433779837 11931242496 2906937 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 2912901 2906937 846 493 0 2906206 0
Current children cumulated CPU time: 1542.2 s
Current children cumulated vsize: 11651604 KiB
Current children cumulated memory: 11627748 KiB

[startup+1602.3 s]
/proc/loadavg: 2.05 2.03 1.97 3/199 1336
/proc/meminfo: memFree=13397484/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=12125404 memory=12079880 CPUtime=1602.2 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3027918 0 0 0 159649 571 0 0 20 0 1 0 433779837 12416413696 3019970 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3031351 3019970 846 493 0 3024656 0
Current children cumulated CPU time: 1602.2 s
Current children cumulated vsize: 12125404 KiB
Current children cumulated memory: 12079880 KiB

[startup+1662.3 s]
/proc/loadavg: 2.70 2.23 2.04 3/199 1340
/proc/meminfo: memFree=12945408/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=12574600 memory=12530960 CPUtime=1662.19 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3141084 0 0 0 165619 600 0 0 20 0 1 0 433779837 12876390400 3132740 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3143650 3132740 846 493 0 3136955 0
Current children cumulated CPU time: 1662.19 s
Current children cumulated vsize: 12574600 KiB
Current children cumulated memory: 12530960 KiB

[startup+1722.3 s]
/proc/loadavg: 2.26 2.19 2.04 3/199 1352
/proc/meminfo: memFree=12493120/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=13023664 memory=12982304 CPUtime=1722.19 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3254232 0 0 0 171586 633 0 0 20 0 1 0 433779837 13336231936 3245576 33554432000 4194304 6211092 140729859437664 140729859296952 5452242 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3255916 3245576 846 493 0 3249221 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 13023664 KiB
Current children cumulated memory: 12982304 KiB

[startup+1782.3 s]
/proc/loadavg: 2.13 2.17 2.05 3/200 1366
/proc/meminfo: memFree=12040936/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=13472728 memory=13433380 CPUtime=1782.18 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3367378 0 0 0 177552 666 0 0 20 0 1 0 433779837 13796073472 3358345 33554432000 4194304 6211092 140729859437664 140729859296952 5451618 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3368182 3358345 846 493 0 3361487 0
Current children cumulated CPU time: 1782.18 s
Current children cumulated vsize: 13472728 KiB
Current children cumulated memory: 13433380 KiB

[startup+1842.3 s]
/proc/loadavg: 2.05 2.14 2.05 3/200 1370
/proc/meminfo: memFree=11589572/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=13921792 memory=13884464 CPUtime=1842.18 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3480478 0 0 0 183519 699 0 0 20 0 1 0 433779837 14255915008 3471116 33554432000 4194304 6211092 140729859437664 140729859296952 5454183 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3480448 3471116 846 493 0 3473753 0
Current children cumulated CPU time: 1842.18 s
Current children cumulated vsize: 13921792 KiB
Current children cumulated memory: 13884464 KiB

[startup+1902.3 s]
/proc/loadavg: 2.02 2.11 2.05 3/200 1374
/proc/meminfo: memFree=11137620/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=14370724 memory=14335544 CPUtime=1902.18 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3593608 0 0 0 189488 730 0 0 20 0 1 0 433779837 14715621376 3583886 33554432000 4194304 6211092 140729859437664 140729859296952 5455658 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3592681 3583886 846 493 0 3585986 0
Current children cumulated CPU time: 1902.18 s
Current children cumulated vsize: 14370724 KiB
Current children cumulated memory: 14335544 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.09 2.05 3/200 1380
/proc/meminfo: memFree=10685068/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=14819788 memory=14786460 CPUtime=1962.17 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3706888 0 0 0 195452 765 0 0 20 0 1 0 433779837 15175462912 3696615 33554432000 4194304 6211092 140729859437664 140729859296952 5451566 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3704947 3696615 846 493 0 3698252 0
Current children cumulated CPU time: 1962.17 s
Current children cumulated vsize: 14819788 KiB
Current children cumulated memory: 14786460 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.08 2.05 3/200 1384
/proc/meminfo: memFree=10235560/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15268588 memory=15235232 CPUtime=2022.16 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3819952 0 0 0 201417 799 0 0 20 0 1 0 433779837 15635034112 3808808 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3817147 3808808 846 493 0 3810452 0
Current children cumulated CPU time: 2022.16 s
Current children cumulated vsize: 15268588 KiB
Current children cumulated memory: 15235232 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/199 1389
/proc/meminfo: memFree=9783868/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15717256 memory=15686148 CPUtime=2082.16 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3933169 0 0 0 207384 832 0 0 20 0 1 0 433779837 16094470144 3921537 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3929314 3921537 846 493 0 3922619 0
Current children cumulated CPU time: 2082.16 s
Current children cumulated vsize: 15717256 KiB
Current children cumulated memory: 15686148 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2103 s]*
/proc/loadavg: 2.00 2.06 2.05 3/199 1392
/proc/meminfo: memFree=9624920/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15872092 memory=15842828 CPUtime=2102.86 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) R 1186 1189 671 0 -1 4202496 3972224 0 0 0 209442 844 0 0 20 0 1 0 433779837 16253022208 3960707 33554432000 4194304 6211092 140729859437664 140729859296952 140410125519845 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3968023 3960707 846 493 0 3961328 0
Current children cumulated CPU time: 2102.86 s
Current children cumulated vsize: 15872092 KiB
Current children cumulated memory: 15842828 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2105.72 s]
# the end of solver process 1189 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2094.69 s, system=9.18452 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2104 s]*
/proc/loadavg: 2.00 2.06 2.05 3/200 1393
/proc/meminfo: memFree=9150540/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15872092 memory=15842828 CPUtime=2103.02 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) S 1186 1189 671 0 -1 512 3972234 0 0 0 209457 845 0 0 20 0 1 0 433779837 16253022208 3960707 33554432000 4194304 6211092 140729859437664 140729859296952 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3968023 3960707 846 493 0 3961328 0
Current children cumulated CPU time: 2103.02 s
Current children cumulated vsize: 15872092 KiB
Current children cumulated memory: 15842828 KiB

[startup+2104.8 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 1393
/proc/meminfo: memFree=9150540/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15872092 memory=15842828 CPUtime=2103.12 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) S 1186 1189 671 0 -1 512 3972234 0 0 0 209466 846 0 0 20 0 1 0 433779837 16253022208 3960707 33554432000 4194304 6211092 140729859437664 140729859296952 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3968023 3960707 846 493 0 3961328 0
Current children cumulated CPU time: 2103.12 s
Current children cumulated vsize: 15872092 KiB
Current children cumulated memory: 15842828 KiB

[startup+2105 s]*
/proc/loadavg: 2.00 2.06 2.05 3/200 1393
/proc/meminfo: memFree=8663884/32770624 swapFree=67002444/67108860
[pid=1189] ppid=1186 vsize=15872092 memory=15842828 CPUtime=2103.16 cores=0,2,4,6
/proc/1189/stat : 1189 (cosoco) S 1186 1189 671 0 -1 512 3972234 0 0 0 209469 847 0 0 20 0 1 0 433779837 16253022208 3960707 33554432000 4194304 6211092 140729859437664 140729859296952 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37941248 140729859445771 140729859445873 140729859445873 140729859448782 0
/proc/1189/statm: 3968023 3960707 846 493 0 3961328 0
Current children cumulated CPU time: 2103.16 s
Current children cumulated vsize: 15872092 KiB
Current children cumulated memory: 15842828 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2105.72
CPU time (s): 2103.88
CPU user time (s): 2094.69
CPU system time (s): 9.18452
CPU usage (%): 99.9124
Max. virtual memory (cumulated for all children) (KiB): 15872092
Max. memory (cumulated for all children) (KiB): 15842828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2094.69
system time used= 9.18452
maximum resident set size= 15843068
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3972234
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 118921
involuntary context switches= 1716


# summary of solver processes directly reported to runsolver:
#   pid: 1189
#   total CPU time (s): 2103.88
#   total CPU user time (s): 2094.69
#   total CPU system time (s): 9.18452

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.86503 second user time and 14.879 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-15 21:21:08
IDJOB=4397771
IDBENCH=122932
IDSOLVER=2850
FILE ID=node136/4397771-1568575312
RUNJOBID= node136-1568572740-702
PBS_JOBID= 21703318
Free space on /tmp= 61168 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-04-350-100.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397771-1568575312/watcher-4397771-1568575312 -o /tmp/evaluation-result-4397771-1568575312/solver-4397771-1568575312 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568572740-702 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397771-1568575312.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 05a37308653f1418d8a9d31e27700b02
RANDOM SEED=1007110592

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25496084 kB
MemAvailable:   31880956 kB
Buffers:           99064 kB
Cached:          6569708 kB
SwapCached:         3784 kB
Active:          2119024 kB
Inactive:        4557540 kB
Active(anon):       7008 kB
Inactive(anon):    49672 kB
Active(file):    2112016 kB
Inactive(file):  4507868 kB
Unevictable:      109088 kB
Mlocked:          109088 kB
SwapTotal:      67108860 kB
SwapFree:       67002444 kB
Dirty:              2728 kB
Writeback:             0 kB
AnonPages:        114492 kB
Mapped:            48740 kB
Shmem:             40272 kB
Slab:             191236 kB
SReclaimable:     161648 kB
SUnreclaim:        29588 kB
KernelStack:        3568 kB
PageTables:         6120 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     537736 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 60704 MiB
End job on node136 at 2019-09-15 21:56:13