Trace number 4409685

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallel? (TO) 2521.01 2523.43

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-031-009.xml
MD5SUMc781bc55b7ee4c4bb57d86a03397642c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark3.79055
Satisfiable
(Un)Satisfiability was proved
Number of variables311
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size30
Distribution of domain sizes[{"size":2,"count":310},{"size":30,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":310},{"degree":46,"count":1}]
Minimum constraint arity31
Maximum constraint arity310
Distribution of constraint arities[{"arity":31,"count":10},{"arity":63,"count":45},{"arity":310,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15146 MiB free)
  memory of node 1: 16384 MiB (15576 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409685-1569820448/watcher-4409685-1569820448 -o /tmp/evaluation-result-4409685-1569820448/solver-4409685-1569820448 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node125-1569817883-23708 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409685-1569820448.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=24017, runsolver pid=24014
Current StackSize limit: 8192 KiB


[startup+0.100148 s]*
/proc/loadavg: 8.10 8.23 7.79 2/192 24018
/proc/meminfo: memFree=31458104/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=29992 memory=6264 CPUtime=0.1 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 1791 0 0 0 10 0 0 0 20 0 1 0 558311539 30711808 1566 33554432000 4194304 6211132 140732346402528 140732346399064 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7498 1566 846 493 0 803 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29992 KiB
Current children cumulated memory: 6264 KiB

[startup+0.209169 s]*
/proc/loadavg: 8.10 8.23 7.79 2/192 24018
/proc/meminfo: memFree=31456616/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=31320 memory=7584 CPUtime=0.21 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 2112 0 0 0 21 0 0 0 20 0 1 0 558311539 32071680 1896 33554432000 4194304 6211132 140732346402528 140732346399064 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7830 1896 846 493 0 1135 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 31320 KiB
Current children cumulated memory: 7584 KiB

[startup+0.30865 s]*
/proc/loadavg: 8.10 8.23 7.79 2/192 24018
/proc/meminfo: memFree=31455800/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=32416 memory=8904 CPUtime=0.31 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 2408 0 0 0 31 0 0 0 20 0 1 0 558311539 33193984 2226 33554432000 4194304 6211132 140732346402528 140732346384312 140520525847380 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 8104 2226 846 493 0 1409 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32416 KiB
Current children cumulated memory: 8904 KiB

[startup+0.70027 s]
/proc/loadavg: 8.10 8.23 7.79 2/192 24018
/proc/meminfo: memFree=31453904/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=36980 memory=13292 CPUtime=0.69 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 3543 0 0 0 69 0 0 0 20 0 1 0 558311539 37867520 3323 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 9245 3323 846 493 0 2550 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36980 KiB
Current children cumulated memory: 13292 KiB

[startup+1.50027 s]
/proc/loadavg: 8.10 8.23 7.79 2/192 24018
/proc/meminfo: memFree=31447952/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=46564 memory=22948 CPUtime=1.49 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 5913 0 0 0 149 0 0 0 20 0 1 0 558311539 47681536 5737 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 11641 5737 846 493 0 4946 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 46564 KiB
Current children cumulated memory: 22948 KiB

[startup+3.10932 s]
/proc/loadavg: 7.61 8.13 7.76 2/192 24018
/proc/meminfo: memFree=31424144/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=65848 memory=42052 CPUtime=3.1 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 10785 0 0 0 309 1 0 0 20 0 1 0 558311539 67428352 10513 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 16462 10513 846 493 0 9767 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 65848 KiB
Current children cumulated memory: 42052 KiB

[startup+6.30026 s]
/proc/loadavg: 7.61 8.13 7.76 2/192 24018
/proc/meminfo: memFree=31389080/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=104284 memory=79668 CPUtime=6.29 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 20347 0 0 0 627 2 0 0 20 0 1 0 558311539 106786816 19917 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 26071 19917 846 493 0 19376 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104284 KiB
Current children cumulated memory: 79668 KiB

[startup+12.7003 s]
/proc/loadavg: 6.74 7.92 7.70 2/192 24019
/proc/meminfo: memFree=31317800/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=182176 memory=155660 CPUtime=12.68 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 39418 0 0 0 1264 4 0 0 20 0 1 0 558311539 186548224 38915 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 45544 38915 846 493 0 38849 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 182176 KiB
Current children cumulated memory: 155660 KiB

[startup+25.5003 s]
/proc/loadavg: 5.86 7.70 7.63 2/192 24019
/proc/meminfo: memFree=31163416/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=331980 memory=307268 CPUtime=25.49 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 76536 0 0 0 2539 10 0 0 20 0 1 0 558311539 339947520 76817 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 82995 76817 846 493 0 76300 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 331980 KiB
Current children cumulated memory: 307268 KiB

[startup+51.1093 s]
/proc/loadavg: 4.20 7.16 7.45 2/192 24021
/proc/meminfo: memFree=30852180/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=640024 memory=612288 CPUtime=51.09 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 150330 0 0 0 5091 18 0 0 20 0 1 0 558311539 655384576 153072 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 160006 153072 846 493 0 153311 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 640024 KiB
Current children cumulated memory: 612288 KiB

[startup+102.3 s]
/proc/loadavg: 2.28 6.12 7.08 2/192 24024
/proc/meminfo: memFree=30248216/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=1260460 memory=1218340 CPUtime=102.27 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 295700 0 0 0 10193 34 0 0 20 0 1 0 558311539 1290711040 304585 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 315115 304585 846 493 0 308420 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1260460 KiB
Current children cumulated memory: 1218340 KiB

[startup+162.3 s]
/proc/loadavg: 1.47 5.19 6.70 2/191 24027
/proc/meminfo: memFree=29538404/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=1976412 memory=1928328 CPUtime=162.23 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 466066 0 0 0 16173 50 0 0 20 0 1 0 558311539 2023845888 482082 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 494103 482082 846 493 0 487408 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 1976412 KiB
Current children cumulated memory: 1928328 KiB

[startup+222.3 s]
/proc/loadavg: 1.17 4.43 6.34 2/192 24032
/proc/meminfo: memFree=28824588/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=2711988 memory=2640720 CPUtime=222.21 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 636615 0 0 0 22150 71 0 0 20 0 1 0 558311539 2777075712 660180 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 677997 660180 846 493 0 671302 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 2711988 KiB
Current children cumulated memory: 2640720 KiB

[startup+282.3 s]
/proc/loadavg: 1.06 3.80 6.01 2/191 24035
/proc/meminfo: memFree=28114252/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=3391908 memory=3350548 CPUtime=282.19 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 806607 0 0 0 28127 92 0 0 20 0 1 0 558311539 3473313792 837637 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 847977 837637 846 493 0 841282 0
Current children cumulated CPU time: 282.19 s
Current children cumulated vsize: 3391908 KiB
Current children cumulated memory: 3350548 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.29 5.69 2/191 24038
/proc/meminfo: memFree=27400556/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=4153432 memory=4061732 CPUtime=342.17 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 977435 0 0 0 34104 113 0 0 20 0 1 0 558311539 4253114368 1015433 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 1038358 1015433 846 493 0 1031663 0
Current children cumulated CPU time: 342.17 s
Current children cumulated vsize: 4153432 KiB
Current children cumulated memory: 4061732 KiB

[startup+402.3 s]
/proc/loadavg: 1.01 2.88 5.40 2/193 24051
/proc/meminfo: memFree=26690036/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=4831780 memory=4773360 CPUtime=402.15 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 1147365 0 0 0 40079 136 0 0 20 0 1 0 558311539 4947742720 1193340 33554432000 4194304 6211132 140732346402528 140732346384312 140520515898174 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 1207945 1193340 846 493 0 1201250 0
Current children cumulated CPU time: 402.15 s
Current children cumulated vsize: 4831780 KiB
Current children cumulated memory: 4773360 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.53 5.13 2/192 24054
/proc/meminfo: memFree=25976940/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=5512156 memory=5483368 CPUtime=462.12 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 1317533 0 0 0 46055 157 0 0 20 0 1 0 558311539 5644447744 1370842 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 1378039 1370842 846 493 0 1371344 0
Current children cumulated CPU time: 462.12 s
Current children cumulated vsize: 5512156 KiB
Current children cumulated memory: 5483368 KiB


################
# More data... #
################

Current children cumulated vsize: 22793608 KiB
Current children cumulated memory: 22500788 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.82 2/191 24162
/proc/meminfo: memFree=8217048/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=23468788 memory=23208588 CPUtime=1961.71 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 5563755 0 0 0 195112 1059 0 0 20 0 1 0 558311539 24032038912 5802147 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 5867197 5802147 846 493 0 5860502 0
Current children cumulated CPU time: 1961.71 s
Current children cumulated vsize: 23468788 KiB
Current children cumulated memory: 23208588 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.77 2/192 24167
/proc/meminfo: memFree=7509980/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=24143308 memory=23913820 CPUtime=2021.69 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 5732917 0 0 0 201057 1112 0 0 20 0 1 0 558311539 24722747392 5978455 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6035827 5978455 846 493 0 6029132 0
Current children cumulated CPU time: 2021.69 s
Current children cumulated vsize: 24143308 KiB
Current children cumulated memory: 23913820 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.72 2/191 24170
/proc/meminfo: memFree=6801400/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=24817960 memory=24621356 CPUtime=2081.68 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 5902134 0 0 0 207007 1161 0 0 20 0 1 0 558311539 25413591040 6155339 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6204490 6155339 846 493 0 6197795 0
Current children cumulated CPU time: 2081.68 s
Current children cumulated vsize: 24817960 KiB
Current children cumulated memory: 24621356 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.68 2/191 24173
/proc/meminfo: memFree=6093080/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=25492612 memory=25328748 CPUtime=2141.66 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6071427 0 0 0 212953 1213 0 0 20 0 1 0 558311539 26104434688 6332187 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6373153 6332187 846 493 0 6366458 0
Current children cumulated CPU time: 2141.66 s
Current children cumulated vsize: 25492612 KiB
Current children cumulated memory: 25328748 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.64 2/193 24186
/proc/meminfo: memFree=5385860/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=26167132 memory=26033976 CPUtime=2201.64 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6240572 0 0 0 218894 1270 0 0 20 0 1 0 558311539 26795143168 6508494 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6541783 6508494 846 493 0 6535088 0
Current children cumulated CPU time: 2201.64 s
Current children cumulated vsize: 26167132 KiB
Current children cumulated memory: 26033976 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.60 2/192 24189
/proc/meminfo: memFree=4679736/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=26841520 memory=26740984 CPUtime=2261.63 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6409704 0 0 0 224835 1328 0 0 20 0 1 0 558311539 27485716480 6685246 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6710380 6685246 846 493 0 6703685 0
Current children cumulated CPU time: 2261.63 s
Current children cumulated vsize: 26841520 KiB
Current children cumulated memory: 26740984 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.56 2/192 24192
/proc/meminfo: memFree=3969584/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=27515908 memory=27448108 CPUtime=2321.61 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6578941 0 0 0 230779 1382 0 0 20 0 1 0 558311539 28176289792 6862027 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 6878977 6862027 846 493 0 6872282 0
Current children cumulated CPU time: 2321.61 s
Current children cumulated vsize: 27515908 KiB
Current children cumulated memory: 27448108 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.52 2/193 24197
/proc/meminfo: memFree=3263540/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=28189900 memory=28152928 CPUtime=2381.6 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6748088 0 0 0 236719 1441 0 0 20 0 1 0 558311539 28866457600 7038232 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7047475 7038232 846 493 0 7040780 0
Current children cumulated CPU time: 2381.6 s
Current children cumulated vsize: 28189900 KiB
Current children cumulated memory: 28152928 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.49 2/192 24200
/proc/meminfo: memFree=2556044/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=29494260 memory=28859472 CPUtime=2441.58 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 6917562 0 0 0 242659 1499 0 0 20 0 1 0 558311539 30202122240 7214868 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7373565 7214868 846 493 0 7366870 0
Current children cumulated CPU time: 2441.58 s
Current children cumulated vsize: 29494260 KiB
Current children cumulated memory: 28859472 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.46 2/192 24204
/proc/meminfo: memFree=1847536/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=30184788 memory=29566396 CPUtime=2501.56 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 7086738 0 0 0 248598 1558 0 0 20 0 1 0 558311539 30909222912 7391599 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7546197 7391599 846 493 0 7539502 0
Current children cumulated CPU time: 2501.56 s
Current children cumulated vsize: 30184788 KiB
Current children cumulated memory: 29566396 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.45 2/191 24206
/proc/meminfo: memFree=1636904/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=30383712 memory=29773476 CPUtime=2519.27 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 4202496 7136584 0 0 0 250351 1576 0 0 20 0 1 0 558311539 31112921088 7443369 33554432000 4194304 6211132 140732346402528 140732346384312 140520515902437 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7595928 7443369 846 493 0 7589233 0
Current children cumulated CPU time: 2519.27 s
Current children cumulated vsize: 30383712 KiB
Current children cumulated memory: 29773476 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.43 s]
# the end of solver process 24017 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2503.77 s, system=17.2464 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.45 2/191 24206
/proc/meminfo: memFree=1636904/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=30383712 memory=29773476 CPUtime=2519.4 cores=0-7
/proc/24017/stat : 24017 (cosoco) S 24014 24017 23681 0 -1 512 7136589 0 0 0 250360 1580 0 0 20 0 1 0 558311539 31112921088 7443369 33554432000 4194304 6211132 140732346402528 140732346384312 5189582 0 16384 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7595928 7443369 846 493 0 7589233 0
Current children cumulated CPU time: 2519.4 s
Current children cumulated vsize: 30383712 KiB
Current children cumulated memory: 29773476 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.45 1/192 24207
/proc/meminfo: memFree=1086468/32770624 swapFree=66975648/67108860
[pid=24017] ppid=24014 vsize=30383712 memory=29773476 CPUtime=2519.52 cores=0-7
/proc/24017/stat : 24017 (cosoco) S 24014 24017 23681 0 -1 512 7136589 0 0 0 250370 1582 0 0 20 0 1 0 558311539 31112921088 7443369 33554432000 4194304 6211132 140732346402528 140732346384312 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7595928 7443369 846 493 0 7589233 0
Current children cumulated CPU time: 2519.52 s
Current children cumulated vsize: 30383712 KiB
Current children cumulated memory: 29773476 KiB

[startup+2522 s]*
/proc/loadavg: 1.16 1.05 1.46 3/192 24207
/proc/meminfo: memFree=835720/32770624 swapFree=66975632/67108860
[pid=24017] ppid=24014 vsize=30383712 memory=29773476 CPUtime=2519.58 cores=0-7
/proc/24017/stat : 24017 (cosoco) R 24014 24017 23681 0 -1 512 7136589 0 0 0 250376 1582 0 0 20 0 1 0 558311539 31112921088 7443369 33554432000 4194304 6211132 140732346402528 140732346384312 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 19013632 140732346405905 140732346405997 140732346405997 140732346408910 0
/proc/24017/statm: 7595928 7443369 846 493 0 7589233 0
Current children cumulated CPU time: 2519.58 s
Current children cumulated vsize: 30383712 KiB
Current children cumulated memory: 29773476 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.43
CPU time (s): 2521.01
CPU user time (s): 2503.77
CPU system time (s): 17.2464
CPU usage (%): 99.9043
Max. virtual memory (cumulated for all children) (KiB): 30383712
Max. memory (cumulated for all children) (KiB): 29773476

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2503.77
system time used= 17.2464
maximum resident set size= 29773700
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7136589
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 133268
involuntary context switches= 1448


# summary of solver processes directly reported to runsolver:
#   pid: 24017
#   total CPU time (s): 2521.01
#   total CPU user time (s): 2503.77
#   total CPU system time (s): 17.2464

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.03379 second user time and 16.6969 second system time

The end

Launcher Data 

Begin job on node125 at 2019-09-30 07:13:25
IDJOB=4409685
IDBENCH=122975
IDSOLVER=2877
FILE ID=node125/4409685-1569820448
RUNJOBID= node125-1569817883-23708
PBS_JOBID= 21705920
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-031-009.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409685-1569820448/watcher-4409685-1569820448 -o /tmp/evaluation-result-4409685-1569820448/solver-4409685-1569820448 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node125-1569817883-23708 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409685-1569820448.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c781bc55b7ee4c4bb57d86a03397642c
RANDOM SEED=2075287984

node125.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31459920 kB
MemAvailable:   31843968 kB
Buffers:          205760 kB
Cached:           516220 kB
SwapCached:        29880 kB
Active:           397676 kB
Inactive:         359624 kB
Active(anon):      18084 kB
Inactive(anon):    97880 kB
Active(file):     379592 kB
Inactive(file):   261744 kB
Unevictable:      107324 kB
Mlocked:          107324 kB
SwapTotal:      67108860 kB
SwapFree:       66975648 kB
Dirty:              2776 kB
Writeback:             0 kB
AnonPages:        114572 kB
Mapped:            25948 kB
Shmem:             72028 kB
Slab:             146328 kB
SReclaimable:     117092 kB
SUnreclaim:        29236 kB
KernelStack:        3376 kB
PageTables:         5320 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538672 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61516 MiB
End job on node125 at 2019-09-30 07:55:29