Trace number 4396933

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (MO) 2032.29 2034.32

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-85-085-36-36-15.xml
MD5SUMe7b94b237cf4deebd8c7bf96e74cfc29
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7225
Number of constraints3741
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":7225}]
Minimum variable degree87
Maximum variable degree87
Distribution of variable degrees[{"degree":87,"count":7225}]
Minimum constraint arity85
Maximum constraint arity7225
Distribution of constraint arities[{"arity":85,"count":170},{"arity":170,"count":3570},{"arity":7225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":3740}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11339 MiB free)
  memory of node 1: 16384 MiB (12484 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396933-1568577864/watcher-4396933-1568577864 -o /tmp/evaluation-result-4396933-1568577864/solver-4396933-1568577864 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1568572744-8045 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396933-1568577864.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=9277, runsolver pid=9274

[startup+0.100198 s]*
/proc/loadavg: 1.86 1.98 2.03 3/200 9278
/proc/meminfo: memFree=24369964/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=38096 memory=14304 CPUtime=0.1 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3801 0 0 0 10 0 0 0 20 0 1 0 434055224 39010304 3576 33554432000 4194304 6211092 140736846495712 140736846492248 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 9524 3576 842 493 0 2829 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38096 KiB
Current children cumulated memory: 14304 KiB

[startup+0.210091 s]*
/proc/loadavg: 1.86 1.98 2.03 3/200 9278
/proc/meminfo: memFree=24354584/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=38920 memory=15360 CPUtime=0.21 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 4012 0 0 0 21 0 0 0 20 0 1 0 434055224 39854080 3840 33554432000 4194304 6211092 140736846495712 140736846492248 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 9730 3840 842 493 0 3035 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38920 KiB
Current children cumulated memory: 15360 KiB

[startup+0.309172 s]*
/proc/loadavg: 1.86 1.98 2.03 3/200 9278
/proc/meminfo: memFree=24339912/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=39732 memory=16152 CPUtime=0.31 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 4205 0 0 0 31 0 0 0 20 0 1 0 434055224 40685568 4038 33554432000 4194304 6211092 140736846495712 140736846492248 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 9933 4038 842 493 0 3238 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 39732 KiB
Current children cumulated memory: 16152 KiB

[startup+0.700337 s]
/proc/loadavg: 1.86 1.98 2.03 3/200 9278
/proc/meminfo: memFree=24310512/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=42716 memory=19056 CPUtime=0.69 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 4950 0 0 0 69 0 0 0 20 0 1 0 434055224 43741184 4764 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 10679 4764 842 493 0 3984 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 42716 KiB
Current children cumulated memory: 19056 KiB

[startup+1.50034 s]
/proc/loadavg: 1.87 1.98 2.03 3/200 9278
/proc/meminfo: memFree=24240940/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=48912 memory=25244 CPUtime=1.5 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 6504 0 0 0 149 1 0 0 20 0 1 0 434055224 50085888 6311 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 12228 6311 842 493 0 5533 0
Current children cumulated CPU time: 1.5 s
Current children cumulated vsize: 48912 KiB
Current children cumulated memory: 25244 KiB

[startup+3.10972 s]
/proc/loadavg: 1.87 1.98 2.03 3/200 9278
/proc/meminfo: memFree=23949568/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=61504 memory=37732 CPUtime=3.1 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 9703 0 0 0 309 1 0 0 20 0 1 0 434055224 62980096 9433 33554432000 4194304 6211092 140736846495712 140736846456952 139821301184048 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 15376 9433 842 493 0 8681 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 61504 KiB
Current children cumulated memory: 37732 KiB

[startup+6.30034 s]
/proc/loadavg: 1.88 1.98 2.03 3/200 9278
/proc/meminfo: memFree=23514084/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=86504 memory=62604 CPUtime=6.29 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 15969 0 0 0 628 1 0 0 20 0 1 0 434055224 88580096 15651 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 21626 15651 842 493 0 14931 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 86504 KiB
Current children cumulated memory: 62604 KiB

[startup+12.7003 s]
/proc/loadavg: 1.89 1.98 2.03 3/200 9280
/proc/meminfo: memFree=22641988/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=136812 memory=112392 CPUtime=12.69 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 28481 0 0 0 1267 2 0 0 20 0 1 0 434055224 140095488 28098 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 34203 28098 842 493 0 27508 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 136812 KiB
Current children cumulated memory: 112392 KiB

[startup+25.5004 s]
/proc/loadavg: 1.90 1.98 2.03 3/200 9281
/proc/meminfo: memFree=20752796/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=235800 memory=211896 CPUtime=25.49 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 53518 0 0 0 2542 7 0 0 20 0 1 0 434055224 241459200 52974 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 58950 52974 842 493 0 52255 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 235800 KiB
Current children cumulated memory: 211896 KiB

[startup+51.1099 s]
/proc/loadavg: 1.94 1.99 2.03 3/200 9281
/proc/meminfo: memFree=16980604/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=436164 memory=411580 CPUtime=51.1 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 102993 0 0 0 5098 12 0 0 20 0 1 0 434055224 446631936 102895 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 109041 102895 842 493 0 102346 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 436164 KiB
Current children cumulated memory: 411580 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/200 9287
/proc/meminfo: memFree=9579716/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=837716 memory=810716 CPUtime=102.29 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 201804 0 0 0 10203 26 0 0 20 0 1 0 434055224 857821184 202679 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 209429 202679 842 493 0 202734 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 837716 KiB
Current children cumulated memory: 810716 KiB

[startup+162.3 s]
/proc/loadavg: 2.23 2.07 2.06 3/199 9355
/proc/meminfo: memFree=23840432/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=1304580 memory=1274904 CPUtime=162.28 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 316295 0 0 0 16189 39 0 0 20 0 1 0 434055224 1335889920 318726 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 326145 318726 842 493 0 319450 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1304580 KiB
Current children cumulated memory: 1274904 KiB

[startup+222.3 s]
/proc/loadavg: 2.08 2.06 2.06 3/199 9359
/proc/meminfo: memFree=23373284/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=1778100 memory=1742324 CPUtime=222.26 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 430611 0 0 0 22174 52 0 0 20 0 1 0 434055224 1820774400 435581 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 444525 435581 842 493 0 437830 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 1778100 KiB
Current children cumulated memory: 1742324 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.05 2.05 3/199 9365
/proc/meminfo: memFree=22903664/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=2235216 memory=2209528 CPUtime=282.25 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 544889 0 0 0 28159 66 0 0 20 0 1 0 434055224 2288861184 552382 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 558804 552382 842 493 0 552109 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 2235216 KiB
Current children cumulated memory: 2209528 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/199 9369
/proc/meminfo: memFree=22437836/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=2716936 memory=2677060 CPUtime=342.24 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 659691 0 0 0 34144 80 0 0 20 0 1 0 434055224 2782142464 669265 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 679234 669265 842 493 0 672539 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 2716936 KiB
Current children cumulated memory: 2677060 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 9381
/proc/meminfo: memFree=21969580/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=3174184 memory=3142328 CPUtime=402.23 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 774025 0 0 0 40129 94 0 0 20 0 1 0 434055224 3250364416 785582 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 793546 785582 842 493 0 786851 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 3174184 KiB
Current children cumulated memory: 3142328 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 9387
/proc/meminfo: memFree=21501316/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=3668212 memory=3609732 CPUtime=462.21 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 888912 0 0 0 46113 108 0 0 20 0 1 0 434055224 3756249088 902433 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 917053 902433 842 493 0 910358 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 3668212 KiB
Current children cumulated memory: 3609732 KiB


################
# More data... #
################

Current children cumulated vsize: 11572444 KiB
Current children cumulated memory: 11540760 KiB

[startup+1542.3 s]
/proc/loadavg: 2.22 2.05 2.06 3/199 9482
/proc/meminfo: memFree=13088596/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=12153072 memory=12007224 CPUtime=1542.07 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 2949409 0 0 0 153739 468 0 0 20 0 1 0 434055224 12444745728 3001806 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3038268 3001806 842 493 0 3031573 0
Current children cumulated CPU time: 1542.07 s
Current children cumulated vsize: 12153072 KiB
Current children cumulated memory: 12007224 KiB

[startup+1602.3 s]
/proc/loadavg: 2.42 2.16 2.09 3/200 9494
/proc/meminfo: memFree=12623760/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=12609396 memory=12471852 CPUtime=1602.05 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3063704 0 0 0 159712 493 0 0 20 0 1 0 434055224 12912021504 3117963 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3152349 3117963 842 493 0 3145654 0
Current children cumulated CPU time: 1602.05 s
Current children cumulated vsize: 12609396 KiB
Current children cumulated memory: 12471852 KiB

[startup+1662.3 s]
/proc/loadavg: 2.15 2.13 2.09 3/200 9498
/proc/meminfo: memFree=12156372/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=13065720 memory=12938256 CPUtime=1662.05 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3177984 0 0 0 165684 521 0 0 20 0 1 0 434055224 13379297280 3234564 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3266430 3234564 842 493 0 3259735 0
Current children cumulated CPU time: 1662.05 s
Current children cumulated vsize: 13065720 KiB
Current children cumulated memory: 12938256 KiB

[startup+1722.3 s]
/proc/loadavg: 2.06 2.10 2.08 3/200 9504
/proc/meminfo: memFree=11688700/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=13521912 memory=13404660 CPUtime=1722.04 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3292228 0 0 0 171655 549 0 0 20 0 1 0 434055224 13846437888 3351165 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3380478 3351165 842 493 0 3373783 0
Current children cumulated CPU time: 1722.04 s
Current children cumulated vsize: 13521912 KiB
Current children cumulated memory: 13404660 KiB

[startup+1782.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/200 9508
/proc/meminfo: memFree=11221264/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=13978104 memory=13871064 CPUtime=1782.04 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3406494 0 0 0 177627 577 0 0 20 0 1 0 434055224 14313578496 3467766 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3494526 3467766 842 493 0 3487831 0
Current children cumulated CPU time: 1782.04 s
Current children cumulated vsize: 13978104 KiB
Current children cumulated memory: 13871064 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 9512
/proc/meminfo: memFree=10756380/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=14434296 memory=14335424 CPUtime=1842.03 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3520725 0 0 0 183598 605 0 0 20 0 1 0 434055224 14780719104 3583856 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3608574 3583856 842 493 0 3601879 0
Current children cumulated CPU time: 1842.03 s
Current children cumulated vsize: 14434296 KiB
Current children cumulated memory: 14335424 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/199 9518
/proc/meminfo: memFree=10289712/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=14890092 memory=14801564 CPUtime=1902.01 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3634896 0 0 0 189569 632 0 0 20 0 1 0 434055224 15247454208 3700391 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3722523 3700391 842 493 0 3715828 0
Current children cumulated CPU time: 1902.01 s
Current children cumulated vsize: 14890092 KiB
Current children cumulated memory: 14801564 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/199 9522
/proc/meminfo: memFree=9822588/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15345756 memory=15267436 CPUtime=1962 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3749019 0 0 0 195535 665 0 0 20 0 1 0 434055224 15714054144 3816859 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3836439 3816859 842 493 0 3829744 0
Current children cumulated CPU time: 1962 s
Current children cumulated vsize: 15345756 KiB
Current children cumulated memory: 15267436 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 9526
/proc/meminfo: memFree=9356220/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15801684 memory=15733684 CPUtime=2022 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3863236 0 0 0 201503 697 0 0 20 0 1 0 434055224 16180924416 3933421 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3950421 3933421 842 493 0 3943726 0
Current children cumulated CPU time: 2022 s
Current children cumulated vsize: 15801684 KiB
Current children cumulated memory: 15733684 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+2031.6 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 9526
/proc/meminfo: memFree=9287768/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15872304 memory=15804168 CPUtime=2031.3 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 4202496 3880888 0 0 0 202427 703 0 0 20 0 1 0 434055224 16253239296 3951042 33554432000 4194304 6211092 140736846495712 140736846456952 139821300259813 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3968076 3951042 842 493 0 3961381 0
Current children cumulated CPU time: 2031.3 s
Current children cumulated vsize: 15872304 KiB
Current children cumulated memory: 15804168 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2034.32 s]
# the end of solver process 9277 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2024.53 s, system=7.75981 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2032 s]*
/proc/loadavg: 2.00 2.04 2.05 3/200 9527
/proc/meminfo: memFree=9094456/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15872304 memory=15804168 CPUtime=2031.35 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) S 9274 9277 8014 0 -1 512 3880892 0 0 0 202432 703 0 0 20 0 1 0 434055224 16253239296 3951042 33554432000 4194304 6211092 140736846495712 140736846456952 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3968076 3951042 842 493 0 3961381 0
Current children cumulated CPU time: 2031.35 s
Current children cumulated vsize: 15872304 KiB
Current children cumulated memory: 15804168 KiB

[startup+2032.8 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9527
/proc/meminfo: memFree=9094456/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15872304 memory=15804168 CPUtime=2031.46 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) S 9274 9277 8014 0 -1 512 3880892 0 0 0 202442 704 0 0 20 0 1 0 434055224 16253239296 3951042 33554432000 4194304 6211092 140736846495712 140736846456952 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3968076 3951042 842 493 0 3961381 0
Current children cumulated CPU time: 2031.46 s
Current children cumulated vsize: 15872304 KiB
Current children cumulated memory: 15804168 KiB

[startup+2033.2 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9527
/proc/meminfo: memFree=8604472/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15872304 memory=15804168 CPUtime=2031.51 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) R 9274 9277 8014 0 -1 512 3880892 0 0 0 202447 704 0 0 20 0 1 0 434055224 16253239296 3951042 33554432000 4194304 6211092 140736846495712 140736846456952 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3968076 3951042 842 493 0 3961381 0
Current children cumulated CPU time: 2031.51 s
Current children cumulated vsize: 15872304 KiB
Current children cumulated memory: 15804168 KiB

[startup+2033.6 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9527
/proc/meminfo: memFree=8604472/32770624 swapFree=66998528/67108860
[pid=9277] ppid=9274 vsize=15872304 memory=15804168 CPUtime=2031.57 cores=0,2,4,6
/proc/9277/stat : 9277 (cosoco) S 9274 9277 8014 0 -1 512 3880892 0 0 0 202453 704 0 0 20 0 1 0 434055224 16253239296 3951042 33554432000 4194304 6211092 140736846495712 140736846456952 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8312316 8317760 31801344 140736846496779 140736846496881 140736846496881 140736846499790 0
/proc/9277/statm: 3968076 3951042 842 493 0 3961381 0
Current children cumulated CPU time: 2031.57 s
Current children cumulated vsize: 15872304 KiB
Current children cumulated memory: 15804168 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2034.32
CPU time (s): 2032.29
CPU user time (s): 2024.53
CPU system time (s): 7.75981
CPU usage (%): 99.9005
Max. virtual memory (cumulated for all children) (KiB): 15872304
Max. memory (cumulated for all children) (KiB): 15804168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2024.53
system time used= 7.75981
maximum resident set size= 15804332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3880892
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121496
involuntary context switches= 1204


# summary of solver processes directly reported to runsolver:
#   pid: 9277
#   total CPU time (s): 2032.29
#   total CPU user time (s): 2024.53
#   total CPU system time (s): 7.75981

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.5302 second user time and 11.4475 second system time

The end

Launcher Data 

Begin job on node127 at 2019-09-15 22:03:44
IDJOB=4396933
IDBENCH=124071
IDSOLVER=2848
FILE ID=node127/4396933-1568577864
RUNJOBID= node127-1568572744-8045
PBS_JOBID= 21703323
Free space on /tmp= 61296 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-85-085-36-36-15.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396933-1568577864/watcher-4396933-1568577864 -o /tmp/evaluation-result-4396933-1568577864/solver-4396933-1568577864 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1568572744-8045 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396933-1568577864.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7b94b237cf4deebd8c7bf96e74cfc29
RANDOM SEED=1142553565

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24397664 kB
MemAvailable:   30936536 kB
Buffers:          204356 kB
Cached:          6607716 kB
SwapCached:         6772 kB
Active:          3731280 kB
Inactive:        4017948 kB
Active(anon):     931584 kB
Inactive(anon):    55240 kB
Active(file):    2799696 kB
Inactive(file):  3962708 kB
Unevictable:      110552 kB
Mlocked:          110552 kB
SwapTotal:      67108860 kB
SwapFree:       66998528 kB
Dirty:              3000 kB
Writeback:             0 kB
AnonPages:       1029612 kB
Mapped:            48876 kB
Shmem:             40892 kB
Slab:             214844 kB
SReclaimable:     184608 kB
SUnreclaim:        30236 kB
KernelStack:        3568 kB
PageTables:         7132 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1466132 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    143360 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 60836 MiB
End job on node127 at 2019-09-15 22:37:38