Trace number 4397825

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1298.14 1300.26

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-031-009.xml
MD5SUMc781bc55b7ee4c4bb57d86a03397642c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark3.78622
Satisfiable
(Un)Satisfiability was proved
Number of variables311
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size30
Distribution of domain sizes[{"size":2,"count":310},{"size":30,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":310},{"degree":46,"count":1}]
Minimum constraint arity31
Maximum constraint arity310
Distribution of constraint arities[{"arity":31,"count":10},{"arity":63,"count":45},{"arity":310,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11742 MiB free)
  memory of node 1: 16384 MiB (15475 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397825-1568575818/watcher-4397825-1568575818 -o /tmp/evaluation-result-4397825-1568575818/solver-4397825-1568575818 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568572745-21074 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397825-1568575818.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=21592, runsolver pid=21589
Current StackSize limit: 8192 KiB


[startup+0.100195 s]*
/proc/loadavg: 2.00 2.01 1.95 3/199 21593
/proc/meminfo: memFree=27869616/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=28736 memory=5008 CPUtime=0.1 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 1464 0 0 0 10 0 0 0 20 0 1 0 433846640 29425664 1252 33554432000 4194304 6211092 140735653703584 140735653700120 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 7184 1252 845 493 0 489 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28736 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209509 s]*
/proc/loadavg: 2.00 2.01 1.95 3/199 21593
/proc/meminfo: memFree=27868624/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=30148 memory=6592 CPUtime=0.21 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 1811 0 0 0 21 0 0 0 20 0 1 0 433846640 30871552 1648 33554432000 4194304 6211092 140735653703584 140735653700120 5443096 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 7537 1648 846 493 0 842 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30148 KiB
Current children cumulated memory: 6592 KiB

[startup+0.309096 s]*
/proc/loadavg: 2.00 2.01 1.95 3/199 21593
/proc/meminfo: memFree=27867508/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=31288 memory=7724 CPUtime=0.31 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 2093 0 0 0 31 0 0 0 20 0 1 0 433846640 32038912 1931 33554432000 4194304 6211092 140735653703584 140735653700120 5443103 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 7822 1931 846 493 0 1127 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31288 KiB
Current children cumulated memory: 7724 KiB

[startup+0.700336 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21593
/proc/meminfo: memFree=27865124/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=35768 memory=12208 CPUtime=0.69 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3245 0 0 0 69 0 0 0 20 0 1 0 433846640 36626432 3052 33554432000 4194304 6211092 140735653703584 140735653700120 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 8942 3052 846 493 0 2247 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35768 KiB
Current children cumulated memory: 12208 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21593
/proc/meminfo: memFree=27859172/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=45484 memory=21868 CPUtime=1.49 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 5665 0 0 0 149 0 0 0 20 0 1 0 433846640 46575616 5467 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 11371 5467 846 493 0 4676 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 45484 KiB
Current children cumulated memory: 21868 KiB

[startup+3.1095 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21594
/proc/meminfo: memFree=27835192/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=65164 memory=41496 CPUtime=3.09 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 10585 0 0 0 309 0 0 0 20 0 1 0 433846640 66727936 10374 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 16291 10374 846 493 0 9596 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 65164 KiB
Current children cumulated memory: 41496 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21594
/proc/meminfo: memFree=27798616/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=104392 memory=79908 CPUtime=6.29 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 20271 0 0 0 627 2 0 0 20 0 1 0 433846640 106897408 19977 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 26098 19977 846 493 0 19403 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104392 KiB
Current children cumulated memory: 79908 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21594
/proc/meminfo: memFree=27726356/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=183876 memory=157484 CPUtime=12.69 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 39701 0 0 0 1265 4 0 0 20 0 1 0 433846640 188289024 39371 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 45969 39371 846 493 0 39274 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 183876 KiB
Current children cumulated memory: 157484 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21601
/proc/meminfo: memFree=27567616/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=336972 memory=312464 CPUtime=25.49 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 77556 0 0 0 2540 9 0 0 20 0 1 0 433846640 345059328 78116 33554432000 4194304 6211092 140735653703584 140735653685368 140052065913662 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 84243 78116 846 493 0 77548 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 336972 KiB
Current children cumulated memory: 312464 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21603
/proc/meminfo: memFree=27249320/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=651220 memory=624352 CPUtime=51.09 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 152430 0 0 0 5090 19 0 0 20 0 1 0 433846640 666849280 156088 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 162805 156088 846 493 0 156110 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 651220 KiB
Current children cumulated memory: 624352 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21607
/proc/meminfo: memFree=26631116/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=1284856 memory=1243396 CPUtime=102.26 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 301607 0 0 0 10189 37 0 0 20 0 1 0 433846640 1315692544 310849 33554432000 4194304 6211092 140735653703584 140735653685368 140052065913662 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 321214 310849 846 493 0 314519 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 1284856 KiB
Current children cumulated memory: 1243396 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21611
/proc/meminfo: memFree=25902516/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=2016892 memory=1970916 CPUtime=162.24 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 475849 0 0 0 16163 61 0 0 20 0 1 0 433846640 2065297408 492729 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 504223 492729 846 493 0 497528 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 2016892 KiB
Current children cumulated memory: 1970916 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 21617
/proc/meminfo: memFree=25175912/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=2767272 memory=2698944 CPUtime=222.22 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 650219 0 0 0 22140 82 0 0 20 0 1 0 433846640 2833686528 674736 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 691818 674736 846 493 0 685123 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 2767272 KiB
Current children cumulated memory: 2698944 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21621
/proc/meminfo: memFree=24446560/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=3463032 memory=3424584 CPUtime=282.2 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 823966 0 0 0 28116 104 0 0 20 0 1 0 433846640 3546144768 856146 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 865758 856146 846 493 0 859063 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 3463032 KiB
Current children cumulated memory: 3424584 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21625
/proc/meminfo: memFree=23716436/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=4239868 memory=4152916 CPUtime=342.18 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 997948 0 0 0 34090 128 0 0 20 0 1 0 433846640 4341624832 1038229 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 1059967 1038229 846 493 0 1053272 0
Current children cumulated CPU time: 342.18 s
Current children cumulated vsize: 4239868 KiB
Current children cumulated memory: 4152916 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 21631
/proc/meminfo: memFree=22989308/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=4933792 memory=4880248 CPUtime=402.16 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 1171629 0 0 0 40064 152 0 0 20 0 1 0 433846640 5052203008 1220062 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 1233448 1220062 846 493 0 1226753 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 4933792 KiB
Current children cumulated memory: 4880248 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 21635
/proc/meminfo: memFree=22262220/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=5753784 memory=5604560 CPUtime=462.15 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 1345605 0 0 0 46038 177 0 0 20 0 1 0 433846640 5891874816 1401140 33554432000 4194304 6211092 140735653703584 140735653685368 5012856 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 1438446 1401140 846 493 0 1431751 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 5753784 KiB
Current children cumulated memory: 5604560 KiB


################
# More data... #
################

Current children cumulated vsize: 9410728 KiB
Current children cumulated memory: 9237744 KiB

[startup+822.3 s]
/proc/loadavg: 2.03 2.09 2.01 3/199 21670
/proc/meminfo: memFree=17895672/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=10108456 memory=9964388 CPUtime=822.05 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 2387494 0 0 0 81875 330 0 0 20 0 1 0 433846640 10351058944 2491097 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 2527114 2491097 846 493 0 2520419 0
Current children cumulated CPU time: 822.05 s
Current children cumulated vsize: 10108456 KiB
Current children cumulated memory: 9964388 KiB

[startup+882.3 s]
/proc/loadavg: 2.13 2.11 2.02 3/199 21674
/proc/meminfo: memFree=17164268/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=10802248 memory=10692088 CPUtime=882.03 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 2561313 0 0 0 87842 361 0 0 20 0 1 0 433846640 11061501952 2673022 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 2700562 2673022 846 493 0 2693867 0
Current children cumulated CPU time: 882.03 s
Current children cumulated vsize: 10802248 KiB
Current children cumulated memory: 10692088 KiB

[startup+942.3 s]
/proc/loadavg: 2.10 2.10 2.02 3/199 21678
/proc/meminfo: memFree=16439428/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=11494984 memory=11415592 CPUtime=942.02 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 2734638 0 0 0 93810 392 0 0 20 0 1 0 433846640 11770863616 2853898 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 2873746 2853898 846 493 0 2867051 0
Current children cumulated CPU time: 942.02 s
Current children cumulated vsize: 11494984 KiB
Current children cumulated memory: 11415592 KiB

[startup+1002.3 s]
/proc/loadavg: 2.14 2.12 2.04 3/199 21684
/proc/meminfo: memFree=15712604/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=12186532 memory=12140088 CPUtime=1002 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 2907704 0 0 0 99771 429 0 0 20 0 1 0 433846640 12479008768 3035022 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3046633 3035022 846 493 0 3039938 0
Current children cumulated CPU time: 1002 s
Current children cumulated vsize: 12186532 KiB
Current children cumulated memory: 12140088 KiB

[startup+1062.3 s]
/proc/loadavg: 2.10 2.11 2.04 3/199 21688
/proc/meminfo: memFree=14985616/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=13158096 memory=12864644 CPUtime=1061.98 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3081302 0 0 0 105727 471 0 0 20 0 1 0 433846640 13473890304 3216161 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3289524 3216161 846 493 0 3282829 0
Current children cumulated CPU time: 1061.98 s
Current children cumulated vsize: 13158096 KiB
Current children cumulated memory: 12864644 KiB

[startup+1122.3 s]
/proc/loadavg: 2.04 2.09 2.04 3/199 21692
/proc/meminfo: memFree=14260468/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=13856144 memory=13588764 CPUtime=1121.96 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3254233 0 0 0 111686 510 0 0 20 0 1 0 433846640 14188691456 3397191 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3464036 3397191 846 493 0 3457341 0
Current children cumulated CPU time: 1121.96 s
Current children cumulated vsize: 13856144 KiB
Current children cumulated memory: 13588764 KiB

[startup+1182.3 s]
/proc/loadavg: 2.01 2.07 2.04 3/199 21698
/proc/meminfo: memFree=13535944/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=14546636 memory=14312200 CPUtime=1181.94 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3427004 0 0 0 117644 550 0 0 20 0 1 0 433846640 14895755264 3578050 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3636659 3578050 846 493 0 3629964 0
Current children cumulated CPU time: 1181.94 s
Current children cumulated vsize: 14546636 KiB
Current children cumulated memory: 14312200 KiB

[startup+1242.3 s]
/proc/loadavg: 2.05 2.07 2.05 3/201 21711
/proc/meminfo: memFree=12810392/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15237656 memory=15035896 CPUtime=1241.92 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3599877 0 0 0 123600 592 0 0 20 0 1 0 433846640 15603359744 3758974 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3809414 3758974 846 493 0 3802719 0
Current children cumulated CPU time: 1241.92 s
Current children cumulated vsize: 15237656 KiB
Current children cumulated memory: 15035896 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1297.5 s]
/proc/loadavg: 2.02 2.06 2.05 3/201 21715
/proc/meminfo: memFree=12145736/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.1 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 4202496 3758726 0 0 0 129077 633 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 140052065917925 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.1 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1300.26 s]
# the end of solver process 21592 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1291.04 s, system=7.10803 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1297.6 s]
/proc/loadavg: 2.02 2.06 2.05 3/201 21715
/proc/meminfo: memFree=12145736/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.11 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) S 21589 21592 21043 0 -1 512 3758730 0 0 0 129078 633 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.11 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

[startup+1298.4 s]
/proc/loadavg: 2.02 2.06 2.05 4/202 21716
/proc/meminfo: memFree=11918116/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.23 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) R 21589 21592 21043 0 -1 512 3758730 0 0 0 129089 634 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.23 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

[startup+1299.2 s]
/proc/loadavg: 2.02 2.06 2.05 4/202 21716
/proc/meminfo: memFree=11422384/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.33 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) S 21589 21592 21043 0 -1 512 3758730 0 0 0 129099 634 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.33 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

[startup+1299.4 s]
/proc/loadavg: 2.02 2.06 2.05 4/202 21716
/proc/meminfo: memFree=11422384/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.36 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) S 21589 21592 21043 0 -1 512 3758730 0 0 0 129102 634 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.36 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

[startup+1299.5 s]
/proc/loadavg: 2.02 2.06 2.05 4/202 21716
/proc/meminfo: memFree=11422384/32770624 swapFree=66999944/67108860
[pid=21592] ppid=21589 vsize=15872708 memory=15703704 CPUtime=1297.37 cores=0,2,4,6
/proc/21592/stat : 21592 (cosoco) S 21589 21592 21043 0 -1 512 3758730 0 0 0 129103 634 0 0 20 0 1 0 433846640 16253652992 3925926 33554432000 4194304 6211092 140735653703584 140735653685368 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 37601280 140735653708811 140735653708913 140735653708913 140735653711822 0
/proc/21592/statm: 3968177 3925926 846 493 0 3961482 0
Current children cumulated CPU time: 1297.37 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15703704 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1300.26
CPU time (s): 1298.14
CPU user time (s): 1291.04
CPU system time (s): 7.10803
CPU usage (%): 99.8371
Max. virtual memory (cumulated for all children) (KiB): 15872708
Max. memory (cumulated for all children) (KiB): 15703704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1291.04
system time used= 7.10803
maximum resident set size= 15703736
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3758730
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 119209
involuntary context switches= 1619


# summary of solver processes directly reported to runsolver:
#   pid: 21592
#   total CPU time (s): 1298.14
#   total CPU user time (s): 1291.04
#   total CPU system time (s): 7.10803

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.77946 second user time and 8.9454 second system time

The end

Launcher Data 

Begin job on node123 at 2019-09-15 21:29:39
IDJOB=4397825
IDBENCH=122975
IDSOLVER=2850
FILE ID=node123/4397825-1568575818
RUNJOBID= node123-1568572745-21074
PBS_JOBID= 21703327
Free space on /tmp= 59184 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-031-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397825-1568575818/watcher-4397825-1568575818 -o /tmp/evaluation-result-4397825-1568575818/solver-4397825-1568575818 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1568572745-21074 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397825-1568575818.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c781bc55b7ee4c4bb57d86a03397642c
RANDOM SEED=1662273607

node123.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27871924 kB
MemAvailable:   31818712 kB
Buffers:          165368 kB
Cached:          4055240 kB
SwapCached:         7372 kB
Active:          1371104 kB
Inactive:        2911568 kB
Active(anon):      55320 kB
Inactive(anon):    56244 kB
Active(file):    1315784 kB
Inactive(file):  2855324 kB
Unevictable:      108772 kB
Mlocked:          108772 kB
SwapTotal:      67108860 kB
SwapFree:       66999944 kB
Dirty:              2736 kB
Writeback:             0 kB
AnonPages:        163704 kB
Mapped:            48708 kB
Shmem:             40884 kB
Slab:             212504 kB
SReclaimable:     183032 kB
SUnreclaim:        29472 kB
KernelStack:        3520 kB
PageTables:         5608 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     585916 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    114688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 58716 MiB
End job on node123 at 2019-09-15 21:51:19