Trace number 4390248

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1163.5 1165.61

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-15-015-004.xml
MD5SUM1a7c138b4bdf03d361f31c5b4036df8a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark2.19765
Satisfiable
(Un)Satisfiability was proved
Number of variables226
Number of constraints121
Number of domains2
Minimum domain size2
Maximum domain size15
Distribution of domain sizes[{"size":2,"count":225},{"size":15,"count":1}]
Minimum variable degree16
Maximum variable degree106
Distribution of variable degrees[{"degree":16,"count":225},{"degree":106,"count":1}]
Minimum constraint arity15
Maximum constraint arity225
Distribution of constraint arities[{"arity":15,"count":15},{"arity":31,"count":105},{"arity":225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":120}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9891 MiB free)
  memory of node 1: 16384 MiB (12362 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390248-1568336808/watcher-4390248-1568336808 -o /tmp/evaluation-result-4390248-1568336808/solver-4390248-1568336808 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1568329709-13075 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390248-1568336808.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=14388, runsolver pid=14385

[startup+0.100113 s]*
/proc/loadavg: 2.05 2.10 2.08 3/201 14389
/proc/meminfo: memFree=22779948/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=28796 memory=5008 CPUtime=0.09 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1465 0 0 0 9 0 0 0 20 0 1 0 409933908 29487104 1252 33554432000 4194304 6210612 140736160327200 140736160323736 140204537797605 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 7199 1252 845 493 0 504 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 28796 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209692 s]*
/proc/loadavg: 2.05 2.10 2.08 3/201 14389
/proc/meminfo: memFree=22778656/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=30192 memory=6436 CPUtime=0.21 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1810 0 0 0 20 1 0 0 20 0 1 0 409933908 30916608 1609 33554432000 4194304 6210612 140736160327200 140736160323736 5452055 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 7548 1609 845 493 0 853 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30192 KiB
Current children cumulated memory: 6436 KiB

[startup+0.309422 s]*
/proc/loadavg: 2.05 2.10 2.08 3/201 14389
/proc/meminfo: memFree=22782108/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=31572 memory=7828 CPUtime=0.3 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2123 0 0 0 29 1 0 0 20 0 1 0 409933908 32329728 1957 33554432000 4194304 6210612 140736160327200 140736160323736 5442920 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 7893 1957 845 493 0 1198 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 31572 KiB
Current children cumulated memory: 7828 KiB

[startup+0.700313 s]
/proc/loadavg: 2.05 2.10 2.08 3/201 14389
/proc/meminfo: memFree=22781416/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=36108 memory=12576 CPUtime=0.68 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 3327 0 0 0 66 2 0 0 20 0 1 0 409933908 36974592 3144 33554432000 4194304 6210612 140736160327200 140736160315128 5446050 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 9027 3144 845 493 0 2332 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 36108 KiB
Current children cumulated memory: 12576 KiB

[startup+1.50031 s]
/proc/loadavg: 2.21 2.14 2.09 3/201 14389
/proc/meminfo: memFree=22778084/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=46488 memory=22548 CPUtime=1.48 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 5857 0 0 0 143 5 0 0 20 0 1 0 409933908 47603712 5637 33554432000 4194304 6210612 140736160327200 140736160315128 5451347 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 11622 5637 845 493 0 4927 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 46488 KiB
Current children cumulated memory: 22548 KiB

[startup+3.10952 s]
/proc/loadavg: 2.21 2.14 2.09 3/201 14389
/proc/meminfo: memFree=22748368/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=67492 memory=43252 CPUtime=3.1 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 11049 0 0 0 301 9 0 0 20 0 1 0 409933908 69111808 10813 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 16873 10813 845 493 0 10178 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 67492 KiB
Current children cumulated memory: 43252 KiB

[startup+6.30039 s]
/proc/loadavg: 2.35 2.17 2.10 3/201 14389
/proc/meminfo: memFree=22707612/32770624 swapFree=66997116/67108860
[pid=14388] ppid=14385 vsize=110960 memory=86648 CPUtime=6.29 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 21406 0 0 0 618 11 0 0 20 0 1 0 409933908 113623040 21662 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 27740 21662 845 493 0 21045 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 110960 KiB
Current children cumulated memory: 86648 KiB

[startup+12.7003 s]
/proc/loadavg: 2.49 2.20 2.11 3/200 14389
/proc/meminfo: memFree=23133108/32770624 swapFree=66997120/67108860
[pid=14388] ppid=14385 vsize=199460 memory=170544 CPUtime=12.68 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 41390 0 0 0 1255 13 0 0 20 0 1 0 409933908 204247040 42636 33554432000 4194304 6210612 140736160327200 140736160315128 5446088 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 49865 42636 845 493 0 43170 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 199460 KiB
Current children cumulated memory: 170544 KiB

[startup+25.5004 s]
/proc/loadavg: 2.49 2.21 2.12 3/201 14394
/proc/meminfo: memFree=23434056/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=363268 memory=337356 CPUtime=25.48 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 80092 0 0 0 2529 19 0 0 20 0 1 0 409933908 371986432 84339 33554432000 4194304 6210612 140736160327200 140736160315128 140204538721114 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 90817 84339 845 493 0 84122 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 363268 KiB
Current children cumulated memory: 337356 KiB

[startup+51.1095 s]
/proc/loadavg: 2.35 2.20 2.12 3/200 14394
/proc/meminfo: memFree=23092724/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=710684 memory=674388 CPUtime=51.09 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 157718 0 0 0 5080 29 0 0 20 0 1 0 409933908 727740416 168597 33554432000 4194304 6210612 140736160327200 140736160315128 5452001 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 177671 168597 845 493 0 170976 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 710684 KiB
Current children cumulated memory: 674388 KiB

[startup+102.3 s]
/proc/loadavg: 2.15 2.17 2.11 3/200 14398
/proc/meminfo: memFree=22420440/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=1416676 memory=1347640 CPUtime=102.28 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 311210 0 0 0 10177 51 0 0 20 0 1 0 409933908 1450676224 336910 33554432000 4194304 6210612 140736160327200 140736160315128 5440930 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 354169 336910 845 493 0 347474 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1416676 KiB
Current children cumulated memory: 1347640 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.14 2.11 3/200 14404
/proc/meminfo: memFree=21628504/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=2217040 memory=2137384 CPUtime=162.26 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 489763 0 0 0 16152 74 0 0 20 0 1 0 409933908 2270248960 534346 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 554260 534346 845 493 0 547565 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 2217040 KiB
Current children cumulated memory: 2137384 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.11 2.10 3/200 14408
/proc/meminfo: memFree=20838332/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=3062176 memory=2925756 CPUtime=222.24 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 668512 0 0 0 22128 96 0 0 20 0 1 0 409933908 3135668224 731439 33554432000 4194304 6210612 140736160327200 140736160315128 140204547742529 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 765544 731439 845 493 0 758849 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 3062176 KiB
Current children cumulated memory: 2925756 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.09 2.10 3/201 14479
/proc/meminfo: memFree=19705352/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=3789004 memory=3713964 CPUtime=282.22 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 846727 0 0 0 28102 120 0 0 20 0 1 0 409933908 3879940096 928491 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 947251 928491 845 493 0 940556 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 3789004 KiB
Current children cumulated memory: 3713964 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.08 2.09 3/201 14485
/proc/meminfo: memFree=18170332/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=4686944 memory=4505000 CPUtime=342.2 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1025086 0 0 0 34075 145 0 0 20 0 1 0 409933908 4799430656 1126250 33554432000 4194304 6210612 140736160327200 140736160315128 5452066 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 1171736 1126250 845 493 0 1165041 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 4686944 KiB
Current children cumulated memory: 4505000 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.06 2.08 3/202 14490
/proc/meminfo: memFree=16632916/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=5422368 memory=5295656 CPUtime=402.18 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1203434 0 0 0 40046 172 0 0 20 0 1 0 409933908 5552504832 1323914 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 1355592 1323914 845 493 0 1348897 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 5422368 KiB
Current children cumulated memory: 5295656 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 2.07 2.08 3/202 14494
/proc/meminfo: memFree=15098640/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=6133584 memory=6084580 CPUtime=462.17 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1381320 0 0 0 46017 200 0 0 20 0 1 0 409933908 6280790016 1521145 33554432000 4194304 6210612 140736160327200 140736160315128 140204538721840 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 1533396 1521145 845 493 0 1526701 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 6133584 KiB
Current children cumulated memory: 6084580 KiB


################
# More data... #
################

Current children cumulated vsize: 7872284 KiB
Current children cumulated memory: 7665268 KiB

[startup+642.3 s]
/proc/loadavg: 2.00 2.04 2.07 3/201 14508
/proc/meminfo: memFree=10494040/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=8582840 memory=8453756 CPUtime=642.1 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 1915594 0 0 0 63926 284 0 0 20 0 1 0 409933908 8788828160 2113439 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 2145710 2113439 845 493 0 2139015 0
Current children cumulated CPU time: 642.1 s
Current children cumulated vsize: 8582840 KiB
Current children cumulated memory: 8453756 KiB

[startup+702.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/200 14514
/proc/meminfo: memFree=8958100/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=9293264 memory=9243972 CPUtime=702.09 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2093340 0 0 0 69893 316 0 0 20 0 1 0 409933908 9516302336 2310993 33554432000 4194304 6210612 140736160327200 140736160315128 5451347 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 2323316 2310993 845 493 0 2316621 0
Current children cumulated CPU time: 702.09 s
Current children cumulated vsize: 9293264 KiB
Current children cumulated memory: 9243972 KiB

[startup+762.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/200 14518
/proc/meminfo: memFree=7422624/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=10479476 memory=10034276 CPUtime=762.07 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2272137 0 0 0 75861 346 0 0 20 0 1 0 409933908 10730983424 2508569 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 2619869 2508569 845 493 0 2613174 0
Current children cumulated CPU time: 762.07 s
Current children cumulated vsize: 10479476 KiB
Current children cumulated memory: 10034276 KiB

[startup+822.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 14522
/proc/meminfo: memFree=5892408/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=11187656 memory=10820096 CPUtime=822.05 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2449448 0 0 0 81810 395 0 0 20 0 1 0 409933908 11456159744 2705024 33554432000 4194304 6210612 140736160327200 140736160315128 140204538721868 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 2796914 2705024 845 493 0 2790219 0
Current children cumulated CPU time: 822.05 s
Current children cumulated vsize: 11187656 KiB
Current children cumulated memory: 10820096 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 14533
/proc/meminfo: memFree=4371840/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=11885936 memory=11596360 CPUtime=882.02 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2625252 0 0 0 87696 506 0 0 20 0 1 0 409933908 12171198464 2899090 33554432000 4194304 6210612 140736160327200 140736160315128 5440946 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 2971484 2899090 845 493 0 2964789 0
Current children cumulated CPU time: 882.02 s
Current children cumulated vsize: 11885936 KiB
Current children cumulated memory: 11596360 KiB

[startup+942.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/200 14537
/proc/meminfo: memFree=2850316/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=12583424 memory=12371528 CPUtime=942 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2800756 0 0 0 93581 619 0 0 20 0 1 0 409933908 12885426176 3092882 33554432000 4194304 6210612 140736160327200 140736160315128 5454028 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3145856 3092882 845 493 0 3139161 0
Current children cumulated CPU time: 942 s
Current children cumulated vsize: 12583424 KiB
Current children cumulated memory: 12371528 KiB

[startup+1002.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/200 14541
/proc/meminfo: memFree=1331816/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=13280252 memory=13146236 CPUtime=1001.98 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 2976061 0 0 0 99461 737 0 0 20 0 1 0 409933908 13598978048 3286559 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3320063 3286559 845 493 0 3313368 0
Current children cumulated CPU time: 1001.98 s
Current children cumulated vsize: 13280252 KiB
Current children cumulated memory: 13146236 KiB

[startup+1062.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 14547
/proc/meminfo: memFree=193232/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=13978928 memory=13920880 CPUtime=1061.96 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 3152621 0 0 0 105355 841 0 0 20 0 1 0 409933908 14314422272 3480154 33554432000 4194304 6210612 140736160327200 140736160315128 140204538721843 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3494732 3480220 845 493 0 3488037 0
Current children cumulated CPU time: 1061.96 s
Current children cumulated vsize: 13978928 KiB
Current children cumulated memory: 13920880 KiB

[startup+1122.3 s]
/proc/loadavg: 1.94 2.00 2.04 3/200 14551
/proc/meminfo: memFree=206624/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15399464 memory=14704844 CPUtime=1121.96 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 3342125 0 0 0 111314 882 0 0 20 0 1 0 409933908 15769051136 3676211 33554432000 4194304 6210612 140736160327200 140736160315128 140204537797605 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3849866 3676211 845 493 0 3843171 0
Current children cumulated CPU time: 1121.96 s
Current children cumulated vsize: 15399464 KiB
Current children cumulated memory: 14704844 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1162.8 s]
/proc/loadavg: 1.90 1.98 2.03 3/200 14556
/proc/meminfo: memFree=209520/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15872816 memory=15232068 CPUtime=1162.45 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) R 14385 14388 13044 0 -1 4202496 3465817 0 0 0 115311 934 0 0 20 0 1 0 409933908 16253763584 3808017 33554432000 4194304 6210612 140736160327200 140736160315128 5445951 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3968204 3808017 845 493 0 3961509 0
Current children cumulated CPU time: 1162.45 s
Current children cumulated vsize: 15872816 KiB
Current children cumulated memory: 15232068 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1165.61 s]
# the end of solver process 14388 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1153.33 s, system=10.165 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1163.2 s]
/proc/loadavg: 1.90 1.98 2.03 2/201 14557
/proc/meminfo: memFree=185768/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15872816 memory=15232068 CPUtime=1162.48 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) S 14385 14388 13044 0 -1 512 3465822 0 0 0 115314 934 0 0 20 0 1 0 409933908 16253763584 3808017 33554432000 4194304 6210612 140736160327200 140736160315128 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3968204 3808017 845 493 0 3961509 0
Current children cumulated CPU time: 1162.48 s
Current children cumulated vsize: 15872816 KiB
Current children cumulated memory: 15232068 KiB

[startup+1164 s]*
/proc/loadavg: 1.90 1.98 2.03 3/201 14557
/proc/meminfo: memFree=220352/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15872816 memory=15232068 CPUtime=1162.59 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) S 14385 14388 13044 0 -1 512 3465822 0 0 0 115324 935 0 0 20 0 1 0 409933908 16253763584 3808017 33554432000 4194304 6210612 140736160327200 140736160315128 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3968204 3808017 845 493 0 3961509 0
Current children cumulated CPU time: 1162.59 s
Current children cumulated vsize: 15872816 KiB
Current children cumulated memory: 15232068 KiB

[startup+1164.4 s]
/proc/loadavg: 1.90 1.98 2.03 3/201 14557
/proc/meminfo: memFree=220352/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15872816 memory=15232068 CPUtime=1162.64 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) S 14385 14388 13044 0 -1 512 3465822 0 0 0 115329 935 0 0 20 0 1 0 409933908 16253763584 3808017 33554432000 4194304 6210612 140736160327200 140736160315128 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3968204 3808017 845 493 0 3961509 0
Current children cumulated CPU time: 1162.64 s
Current children cumulated vsize: 15872816 KiB
Current children cumulated memory: 15232068 KiB

[startup+1164.8 s]
/proc/loadavg: 1.90 1.98 2.03 3/201 14557
/proc/meminfo: memFree=220352/32770624 swapFree=66997368/67108860
[pid=14388] ppid=14385 vsize=15872816 memory=15232068 CPUtime=1162.68 cores=0,2,4,6
/proc/14388/stat : 14388 (cosoco) S 14385 14388 13044 0 -1 512 3465822 0 0 0 115333 935 0 0 20 0 1 0 409933908 16253763584 3808017 33554432000 4194304 6210612 140736160327200 140736160315128 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 12861440 140736160334859 140736160334961 140736160334961 140736160337870 0
/proc/14388/statm: 3968204 3808017 845 493 0 3961509 0
Current children cumulated CPU time: 1162.68 s
Current children cumulated vsize: 15872816 KiB
Current children cumulated memory: 15232068 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1165.61
CPU time (s): 1163.5
CPU user time (s): 1153.33
CPU system time (s): 10.165
CPU usage (%): 99.819
Max. virtual memory (cumulated for all children) (KiB): 15872816
Max. memory (cumulated for all children) (KiB): 15232068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1153.33
system time used= 10.165
maximum resident set size= 15232268
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3465822
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 101230
involuntary context switches= 986


# summary of solver processes directly reported to runsolver:
#   pid: 14388
#   total CPU time (s): 1163.5
#   total CPU user time (s): 1153.33
#   total CPU system time (s): 10.165

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.89853 second user time and 8.40509 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-13 03:05:49
IDJOB=4390248
IDBENCH=122978
IDSOLVER=2831
FILE ID=node103/4390248-1568336808
RUNJOBID= node103-1568329709-13075
PBS_JOBID= 21701158
Free space on /tmp= 56800 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-15-015-004.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390248-1568336808/watcher-4390248-1568336808 -o /tmp/evaluation-result-4390248-1568336808/solver-4390248-1568336808 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1568329709-13075 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390248-1568336808.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1a7c138b4bdf03d361f31c5b4036df8a
RANDOM SEED=1205917562

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22787432 kB
MemAvailable:   31801184 kB
Buffers:          152616 kB
Cached:          9067364 kB
SwapCached:         8916 kB
Active:          1727788 kB
Inactive:        7530572 kB
Active(anon):      26912 kB
Inactive(anon):    53048 kB
Active(file):    1700876 kB
Inactive(file):  7477524 kB
Unevictable:      107456 kB
Mlocked:          107456 kB
SwapTotal:      67108860 kB
SwapFree:       66997116 kB
Dirty:            784964 kB
Writeback:         68112 kB
AnonPages:        138284 kB
Mapped:            46408 kB
Shmem:             32848 kB
Slab:             320368 kB
SReclaimable:     263812 kB
SUnreclaim:        56556 kB
KernelStack:        3504 kB
PageTables:         5880 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     550732 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     90112 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 56868 MiB
End job on node103 at 2019-09-13 03:25:15