Trace number 4397884

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1114.63 1116.68

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-19-020-009.xml
MD5SUM62ee24bcba75d1d33fbbd4bb45a854a0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4
Best CPU time to get the best result obtained on this benchmark1381.62
Satisfiable
(Un)Satisfiability was proved
Number of variables381
Number of constraints191
Number of domains2
Minimum domain size2
Maximum domain size17
Distribution of domain sizes[{"size":2,"count":380},{"size":17,"count":1}]
Minimum variable degree20
Maximum variable degree172
Distribution of variable degrees[{"degree":20,"count":380},{"degree":172,"count":1}]
Minimum constraint arity20
Maximum constraint arity380
Distribution of constraint arities[{"arity":20,"count":19},{"arity":41,"count":171},{"arity":380,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":190}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11743 MiB free)
  memory of node 1: 16384 MiB (14530 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397884-1568577119/watcher-4397884-1568577119 -o /tmp/evaluation-result-4397884-1568577119/solver-4397884-1568577119 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568572745-21074 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397884-1568577119.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=21776, runsolver pid=21773

[startup+0.10011 s]*
/proc/loadavg: 2.10 2.08 2.05 3/202 21777
/proc/meminfo: memFree=26903496/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=28856 memory=5276 CPUtime=0.1 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1511 0 0 0 10 0 0 0 20 0 1 0 433976796 29548544 1319 33554432000 4194304 6211092 140730021870816 140730021867352 140359105305573 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 7214 1319 846 493 0 519 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28856 KiB
Current children cumulated memory: 5276 KiB

[startup+0.20974 s]*
/proc/loadavg: 2.10 2.08 2.05 3/202 21777
/proc/meminfo: memFree=26902412/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=30432 memory=6600 CPUtime=0.21 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1874 0 0 0 20 1 0 0 20 0 1 0 433976796 31162368 1650 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 7608 1650 846 493 0 913 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30432 KiB
Current children cumulated memory: 6600 KiB

[startup+0.309753 s]*
/proc/loadavg: 2.10 2.08 2.05 3/203 21779
/proc/meminfo: memFree=26900024/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=31744 memory=7916 CPUtime=0.31 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2205 0 0 0 30 1 0 0 20 0 1 0 433976796 32505856 1979 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 7936 1979 846 493 0 1241 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31744 KiB
Current children cumulated memory: 7916 KiB

[startup+0.700333 s]
/proc/loadavg: 2.10 2.08 2.05 3/203 21779
/proc/meminfo: memFree=26897172/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=36972 memory=13188 CPUtime=0.69 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 3486 0 0 0 67 2 0 0 20 0 1 0 433976796 37859328 3297 33554432000 4194304 6211092 140730021870816 140730021856824 140359106226112 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 9243 3297 846 493 0 2548 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 36972 KiB
Current children cumulated memory: 13188 KiB

[startup+1.50031 s]
/proc/loadavg: 2.10 2.08 2.05 3/203 21779
/proc/meminfo: memFree=26891068/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=48204 memory=24068 CPUtime=1.48 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 6188 0 0 0 144 4 0 0 20 0 1 0 433976796 49360896 6017 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 12051 6017 846 493 0 5356 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 48204 KiB
Current children cumulated memory: 24068 KiB

[startup+3.10963 s]
/proc/loadavg: 2.10 2.08 2.05 3/203 21779
/proc/meminfo: memFree=26857848/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=69492 memory=45840 CPUtime=3.1 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 11671 0 0 0 302 8 0 0 20 0 1 0 433976796 71159808 11460 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 17373 11460 846 493 0 10678 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 69492 KiB
Current children cumulated memory: 45840 KiB

[startup+7.74572 s]
/proc/loadavg: 2.10 2.08 2.05 3/203 21779
/proc/meminfo: memFree=26857848/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=135336 memory=108996 CPUtime=7.73 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 27021 0 0 0 753 20 0 0 20 0 1 0 433976796 138584064 27249 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 33834 27249 846 493 0 27139 0
Current children cumulated CPU time: 7.73 s
Current children cumulated vsize: 135336 KiB
Current children cumulated memory: 108996 KiB

[startup+12.7003 s]
/proc/loadavg: 2.62 2.19 2.09 3/202 21779
/proc/meminfo: memFree=27179032/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=205008 memory=178984 CPUtime=12.69 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 44015 0 0 0 1247 22 0 0 20 0 1 0 433976796 209928192 44746 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 51252 44746 846 493 0 44557 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 205008 KiB
Current children cumulated memory: 178984 KiB

[startup+25.5003 s]*
/proc/loadavg: 2.48 2.18 2.09 3/201 21783
/proc/meminfo: memFree=27515116/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=390916 memory=358124 CPUtime=25.5 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 86813 0 0 0 2522 28 0 0 20 0 1 0 433976796 400297984 89531 33554432000 4194304 6211092 140730021870816 140730021856824 5451482 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 97729 89531 846 493 0 91034 0
Current children cumulated CPU time: 25.5 s
Current children cumulated vsize: 390916 KiB
Current children cumulated memory: 358124 KiB

[startup+51.1003 s]
/proc/loadavg: 2.32 2.17 2.08 3/202 21785
/proc/meminfo: memFree=27160732/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=743028 memory=718608 CPUtime=51.09 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 171385 0 0 0 5071 38 0 0 20 0 1 0 433976796 760860672 179652 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 185757 179652 846 493 0 179062 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 743028 KiB
Current children cumulated memory: 718608 KiB

[startup+102.3 s]
/proc/loadavg: 2.14 2.14 2.08 3/201 21789
/proc/meminfo: memFree=26442532/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=1476808 memory=1438096 CPUtime=102.29 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 340505 0 0 0 10171 58 0 0 20 0 1 0 433976796 1512251392 359524 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 369202 359524 846 493 0 362507 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1476808 KiB
Current children cumulated memory: 1438096 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 2.12 2.07 3/201 21793
/proc/meminfo: memFree=25597828/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=2319216 memory=2282396 CPUtime=162.27 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 537831 0 0 0 16144 83 0 0 20 0 1 0 433976796 2374877184 570599 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 579804 570599 846 493 0 573109 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2319216 KiB
Current children cumulated memory: 2282396 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.10 2.07 3/201 21798
/proc/meminfo: memFree=24752648/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=3189924 memory=3124368 CPUtime=222.25 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 735055 0 0 0 22118 107 0 0 20 0 1 0 433976796 3266482176 781092 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 797481 781092 846 493 0 790786 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 3189924 KiB
Current children cumulated memory: 3124368 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.08 2.06 3/199 21804
/proc/meminfo: memFree=23907176/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=4102036 memory=3969544 CPUtime=282.23 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 932545 0 0 0 28090 133 0 0 20 0 1 0 433976796 4200484864 992386 33554432000 4194304 6211092 140730021870816 140730021856824 140359114638496 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 1025509 992386 846 493 0 1018814 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 4102036 KiB
Current children cumulated memory: 3969544 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/199 21808
/proc/meminfo: memFree=23063024/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=4889264 memory=4811900 CPUtime=342.21 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1129437 0 0 0 34064 157 0 0 20 0 1 0 433976796 5006606336 1202975 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 1222316 1202975 846 493 0 1215621 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 4889264 KiB
Current children cumulated memory: 4811900 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/199 21813
/proc/meminfo: memFree=22218028/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=5863668 memory=5653280 CPUtime=402.19 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1326594 0 0 0 40035 184 0 0 20 0 1 0 433976796 6004396032 1413320 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 1465917 1413320 846 493 0 1459222 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 5863668 KiB
Current children cumulated memory: 5653280 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 21819
/proc/meminfo: memFree=21374008/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=6649728 memory=6497184 CPUtime=462.17 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1523325 0 0 0 46006 211 0 0 20 0 1 0 433976796 6809321472 1624296 33554432000 4194304 6211092 140730021870816 140730021856824 5446197 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 1662432 1624296 846 493 0 1655737 0
Current children cumulated CPU time: 462.17 s
Current children cumulated vsize: 6649728 KiB
Current children cumulated memory: 6497184 KiB

[startup+522.3 s]
/proc/loadavg: 2.16 2.07 2.06 3/200 22016
/proc/meminfo: memFree=20561596/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=7436580 memory=7339372 CPUtime=522.16 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1720231 0 0 0 51975 241 0 0 20 0 1 0 433976796 7615057920 1834843 33554432000 4194304 6211092 140730021870816 140730021856824 140359105301310 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 1859145 1834843 846 493 0 1852450 0
Current children cumulated CPU time: 522.16 s
Current children cumulated vsize: 7436580 KiB
Current children cumulated memory: 7339372 KiB

[startup+582.3 s]
/proc/loadavg: 2.06 2.06 2.05 3/201 22043
/proc/meminfo: memFree=19715924/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=8223948 memory=8181184 CPUtime=582.14 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 1917028 0 0 0 57942 272 0 0 20 0 1 0 433976796 8421322752 2045296 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 2055987 2045296 846 493 0 2049292 0
Current children cumulated CPU time: 582.14 s
Current children cumulated vsize: 8223948 KiB
Current children cumulated memory: 8181184 KiB

[startup+642.3 s]
/proc/loadavg: 2.02 2.05 2.05 3/201 22049
/proc/meminfo: memFree=18856456/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=9290552 memory=9023224 CPUtime=642.12 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2114372 0 0 0 63909 303 0 0 20 0 1 0 433976796 9513525248 2255806 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 2322638 2255806 846 493 0 2315943 0
Current children cumulated CPU time: 642.12 s
Current children cumulated vsize: 9290552 KiB
Current children cumulated memory: 9023224 KiB

[startup+702.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/201 22053
/proc/meminfo: memFree=18012692/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=10077008 memory=9867244 CPUtime=702.1 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2311178 0 0 0 69877 333 0 0 20 0 1 0 433976796 10318856192 2466811 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 2519252 2466811 846 493 0 2512557 0
Current children cumulated CPU time: 702.1 s
Current children cumulated vsize: 10077008 KiB
Current children cumulated memory: 9867244 KiB

[startup+762.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 22057
/proc/meminfo: memFree=17167992/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=10863332 memory=10709224 CPUtime=762.08 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2507980 0 0 0 75846 362 0 0 20 0 1 0 433976796 11124051968 2677306 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 2715833 2677306 846 493 0 2709138 0
Current children cumulated CPU time: 762.08 s
Current children cumulated vsize: 10863332 KiB
Current children cumulated memory: 10709224 KiB

[startup+822.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 22063
/proc/meminfo: memFree=16324532/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=11649656 memory=11551052 CPUtime=822.07 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2704791 0 0 0 81812 395 0 0 20 0 1 0 433976796 11929247744 2887763 33554432000 4194304 6211092 140730021870816 140730021856824 140359105305573 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 2912414 2887763 846 493 0 2905719 0
Current children cumulated CPU time: 822.07 s
Current children cumulated vsize: 11649656 KiB
Current children cumulated memory: 11551052 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 22188
/proc/meminfo: memFree=15361596/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=12434312 memory=12391228 CPUtime=882.04 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 2900685 0 0 0 87772 432 0 0 20 0 1 0 433976796 12732735488 3097807 33554432000 4194304 6211092 140730021870816 140730021856824 5451482 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3108578 3097807 846 493 0 3101883 0
Current children cumulated CPU time: 882.04 s
Current children cumulated vsize: 12434312 KiB
Current children cumulated memory: 12391228 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 22193
/proc/meminfo: memFree=14523128/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=13635516 memory=13226888 CPUtime=942.01 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 3096495 0 0 0 93728 473 0 0 20 0 1 0 433976796 13962768384 3306722 33554432000 4194304 6211092 140730021870816 140730021856824 5456310 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3408879 3306722 846 493 0 3402184 0
Current children cumulated CPU time: 942.01 s
Current children cumulated vsize: 13635516 KiB
Current children cumulated memory: 13226888 KiB

[startup+1002.3 s]
/proc/loadavg: 1.92 2.00 2.04 3/200 22199
/proc/meminfo: memFree=13682728/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=14419200 memory=14065904 CPUtime=1001.97 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 3292555 0 0 0 99685 512 0 0 20 0 1 0 433976796 14765260800 3516476 33554432000 4194304 6211092 140730021870816 140730021856824 5453904 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3604800 3516476 846 493 0 3598105 0
Current children cumulated CPU time: 1001.97 s
Current children cumulated vsize: 14419200 KiB
Current children cumulated memory: 14065904 KiB

[startup+1062.3 s]
/proc/loadavg: 1.97 2.00 2.04 3/200 22203
/proc/meminfo: memFree=12841660/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=15202428 memory=14901768 CPUtime=1061.95 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 3487887 0 0 0 105642 553 0 0 20 0 1 0 433976796 15567286272 3725442 33554432000 4194304 6211092 140730021870816 140730021856824 140359106229078 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3800607 3725442 846 493 0 3793912 0
Current children cumulated CPU time: 1061.95 s
Current children cumulated vsize: 15202428 KiB
Current children cumulated memory: 14901768 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1113.9 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 22207
/proc/meminfo: memFree=12118052/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=15872724 memory=15619668 CPUtime=1113.52 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 4202496 3655745 0 0 0 110758 594 0 0 20 0 1 0 433976796 16253669376 3904917 33554432000 4194304 6211092 140730021870816 140730021856824 5439786 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3968181 3904917 846 493 0 3961486 0
Current children cumulated CPU time: 1113.52 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15619668 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1116.68 s]
# the end of solver process 21776 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1107.89 s, system=6.74222 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1114.9 s]
/proc/loadavg: 1.99 2.00 2.04 3/201 22208
/proc/meminfo: memFree=11792552/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=15872724 memory=15619668 CPUtime=1113.7 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) S 21773 21776 21043 0 -1 512 3655750 0 0 0 110775 595 0 0 20 0 1 0 433976796 16253669376 3904917 33554432000 4194304 6211092 140730021870816 140730021856824 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3968181 3904917 846 493 0 3961486 0
Current children cumulated CPU time: 1113.7 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15619668 KiB

[startup+1115.7 s]
/proc/loadavg: 1.99 2.00 2.04 3/201 22208
/proc/meminfo: memFree=11297820/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=15872724 memory=15619668 CPUtime=1113.81 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) S 21773 21776 21043 0 -1 512 3655750 0 0 0 110785 596 0 0 20 0 1 0 433976796 16253669376 3904917 33554432000 4194304 6211092 140730021870816 140730021856824 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3968181 3904917 846 493 0 3961486 0
Current children cumulated CPU time: 1113.81 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15619668 KiB

[startup+1115.9 s]
/proc/loadavg: 1.99 2.00 2.04 3/201 22208
/proc/meminfo: memFree=11297820/32770624 swapFree=66999944/67108860
[pid=21776] ppid=21773 vsize=15872724 memory=15619668 CPUtime=1113.84 cores=0,2,4,6
/proc/21776/stat : 21776 (cosoco) R 21773 21776 21043 0 -1 512 3655750 0 0 0 110788 596 0 0 20 0 1 0 433976796 16253669376 3904917 33554432000 4194304 6211092 140730021870816 140730021856824 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 23105536 140730021876747 140730021876849 140730021876849 140730021879758 0
/proc/21776/statm: 3968181 3904917 846 493 0 3961486 0
Current children cumulated CPU time: 1113.84 s
Current children cumulated vsize: 15872724 KiB
Current children cumulated memory: 15619668 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1116.68
CPU time (s): 1114.63
CPU user time (s): 1107.89
CPU system time (s): 6.74222
CPU usage (%): 99.8163
Max. virtual memory (cumulated for all children) (KiB): 15872724
Max. memory (cumulated for all children) (KiB): 15619668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1107.89
system time used= 6.74222
maximum resident set size= 15619856
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3655750
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 122960
involuntary context switches= 1817


# summary of solver processes directly reported to runsolver:
#   pid: 21776
#   total CPU time (s): 1114.63
#   total CPU user time (s): 1107.89
#   total CPU system time (s): 6.74222

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.92431 second user time and 7.88499 second system time

The end

Launcher Data 

Begin job on node123 at 2019-09-15 21:51:20
IDJOB=4397884
IDBENCH=122984
IDSOLVER=2850
FILE ID=node123/4397884-1568577119
RUNJOBID= node123-1568572745-21074
PBS_JOBID= 21703327
Free space on /tmp= 58720 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-19-020-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397884-1568577119/watcher-4397884-1568577119 -o /tmp/evaluation-result-4397884-1568577119/solver-4397884-1568577119 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568572745-21074 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397884-1568577119.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 62ee24bcba75d1d33fbbd4bb45a854a0
RANDOM SEED=443601585

node123.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26904760 kB
MemAvailable:   31806884 kB
Buffers:          166224 kB
Cached:          5001124 kB
SwapCached:         7372 kB
Active:          1373188 kB
Inactive:        3857412 kB
Active(anon):      56628 kB
Inactive(anon):    56244 kB
Active(file):    1316560 kB
Inactive(file):  3801168 kB
Unevictable:      108772 kB
Mlocked:          108772 kB
SwapTotal:      67108860 kB
SwapFree:       66999944 kB
Dirty:            783952 kB
Writeback:         80264 kB
AnonPages:        165760 kB
Mapped:            49816 kB
Shmem:             40884 kB
Slab:             230228 kB
SReclaimable:     200460 kB
SUnreclaim:        29768 kB
KernelStack:        3520 kB
PageTables:         5808 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     588252 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    114688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 58696 MiB
End job on node123 at 2019-09-15 22:09:57