Trace number 4398201

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.O parallel? (TO) 2521 2523.04

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-57-076-20-15-05.xml
MD5SUM103999ad3c646e4e3c5e6682f24aa76f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4332
Number of constraints1730
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":4332}]
Minimum variable degree59
Maximum variable degree59
Distribution of variable degrees[{"degree":59,"count":4332}]
Minimum constraint arity57
Maximum constraint arity4332
Distribution of constraint arities[{"arity":57,"count":76},{"arity":76,"count":57},{"arity":152,"count":1596},{"arity":4332,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":1729}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14705 MiB free)
  memory of node 1: 16384 MiB (15924 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398201-1568601333/watcher-4398201-1568601333 -o /tmp/evaluation-result-4398201-1568601333/solver-4398201-1568601333 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node136-1568598203-6097 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398201-1568601333.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=6601, runsolver pid=6598
Current StackSize limit: 8192 KiB


[startup+0.100158 s]*
/proc/loadavg: 8.01 8.08 7.96 2/192 6602
/proc/meminfo: memFree=31327420/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=66768 memory=43248 CPUtime=0.1 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 10999 0 0 0 9 1 0 0 20 0 1 0 436381965 68370432 10812 33554432000 4194304 6211092 140725505420400 140725505416280 5443106 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 16725 10812 839 493 0 10030 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 66768 KiB
Current children cumulated memory: 43248 KiB

[startup+0.209103 s]*
/proc/loadavg: 8.01 8.08 7.96 2/192 6602
/proc/meminfo: memFree=31325640/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=67824 memory=44304 CPUtime=0.2 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 11243 0 0 0 19 1 0 0 20 0 1 0 436381965 69451776 11076 33554432000 4194304 6211092 140725505420400 140725505416280 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 16956 11076 842 493 0 10261 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 67824 KiB
Current children cumulated memory: 44304 KiB

[startup+0.308694 s]*
/proc/loadavg: 8.01 8.08 7.96 2/192 6602
/proc/meminfo: memFree=31325020/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=68652 memory=45096 CPUtime=0.3 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 11467 0 0 0 29 1 0 0 20 0 1 0 436381965 70299648 11274 33554432000 4194304 6211092 140725505420400 140725505416280 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 17163 11274 842 493 0 10468 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 68652 KiB
Current children cumulated memory: 45096 KiB

[startup+0.700328 s]
/proc/loadavg: 8.01 8.08 7.96 2/192 6602
/proc/meminfo: memFree=31323284/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=72176 memory=48528 CPUtime=0.68 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 12325 0 0 0 67 1 0 0 20 0 1 0 436381965 73908224 12132 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 18044 12132 842 493 0 11349 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 72176 KiB
Current children cumulated memory: 48528 KiB

[startup+1.50033 s]
/proc/loadavg: 8.01 8.08 7.96 2/192 6602
/proc/meminfo: memFree=31318248/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=79420 memory=55660 CPUtime=1.49 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 14115 0 0 0 147 2 0 0 20 0 1 0 436381965 81326080 13915 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 19855 13915 842 493 0 13160 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 79420 KiB
Current children cumulated memory: 55660 KiB

[startup+3.10874 s]
/proc/loadavg: 7.45 7.96 7.92 2/192 6602
/proc/meminfo: memFree=31300268/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=93736 memory=70120 CPUtime=3.1 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 17901 0 0 0 308 2 0 0 20 0 1 0 436381965 95985664 17530 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 23434 17530 842 493 0 16739 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 93736 KiB
Current children cumulated memory: 70120 KiB

[startup+6.30032 s]
/proc/loadavg: 7.45 7.96 7.92 2/192 6602
/proc/meminfo: memFree=31273444/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=122432 memory=98824 CPUtime=6.29 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 25239 0 0 0 626 3 0 0 20 0 1 0 436381965 125370368 24706 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 30608 24706 842 493 0 23913 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 122432 KiB
Current children cumulated memory: 98824 KiB

[startup+12.7003 s]
/proc/loadavg: 6.93 7.85 7.88 2/193 6604
/proc/meminfo: memFree=31220064/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=180264 memory=155944 CPUtime=12.68 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 39768 0 0 0 1263 5 0 0 20 0 1 0 436381965 184590336 38986 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 45066 38986 842 493 0 38371 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 180264 KiB
Current children cumulated memory: 155944 KiB

[startup+25.5003 s]
/proc/loadavg: 5.62 7.51 7.77 2/191 6604
/proc/meminfo: memFree=31103432/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=296304 memory=270732 CPUtime=25.48 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 68747 0 0 0 2539 9 0 0 20 0 1 0 436381965 303415296 67683 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 74076 67683 842 493 0 67381 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 296304 KiB
Current children cumulated memory: 270732 KiB

[startup+51.1094 s]
/proc/loadavg: 4.04 6.99 7.59 2/191 6605
/proc/meminfo: memFree=30870148/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=524680 memory=500588 CPUtime=51.08 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 125765 0 0 0 5092 16 0 0 20 0 1 0 436381965 537272320 125147 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 131170 125147 842 493 0 124475 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 524680 KiB
Current children cumulated memory: 500588 KiB

[startup+102.3 s]
/proc/loadavg: 2.32 6.07 7.25 2/193 6611
/proc/meminfo: memFree=30411016/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=987328 memory=959592 CPUtime=102.26 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 239660 0 0 0 10194 32 0 0 20 0 1 0 436381965 1011023872 239898 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 246832 239898 842 493 0 240137 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 987328 KiB
Current children cumulated memory: 959592 KiB

[startup+162.3 s]
/proc/loadavg: 1.49 5.15 6.86 2/192 6614
/proc/meminfo: memFree=29869656/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=1525716 memory=1499412 CPUtime=162.25 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 372033 0 0 0 16175 50 0 0 20 0 1 0 436381965 1562333184 374853 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 381429 374853 842 493 0 374734 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1525716 KiB
Current children cumulated memory: 1499412 KiB

[startup+222.3 s]
/proc/loadavg: 1.18 4.39 6.49 2/192 6617
/proc/meminfo: memFree=29329856/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=2070420 memory=2037748 CPUtime=222.24 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 504688 0 0 0 22160 64 0 0 20 0 1 0 436381965 2120110080 509437 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 517605 509437 842 493 0 510910 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 2070420 KiB
Current children cumulated memory: 2037748 KiB

[startup+282.3 s]
/proc/loadavg: 1.06 3.77 6.15 2/193 6622
/proc/meminfo: memFree=28794236/32770624 swapFree=67001828/67108860
[pid=6601] ppid=6598 vsize=2623408 memory=2574500 CPUtime=282.23 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 636832 0 0 0 28145 78 0 0 20 0 1 0 436381965 2686369792 643625 33554432000 4194304 6211092 140725505420400 140725505385096 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 655852 643625 842 493 0 649157 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 2623408 KiB
Current children cumulated memory: 2574500 KiB

[startup+342.3 s]
/proc/loadavg: 1.02 3.27 5.82 2/193 6633
/proc/meminfo: memFree=28255156/32770624 swapFree=67001836/67108860
[pid=6601] ppid=6598 vsize=3152380 memory=3112340 CPUtime=342.23 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 769536 0 0 0 34132 91 0 0 20 0 1 0 436381965 3228037120 778085 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 788095 778085 842 493 0 781400 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 3152380 KiB
Current children cumulated memory: 3112340 KiB

[startup+402.3 s]
/proc/loadavg: 1.36 2.97 5.56 2/192 6636
/proc/meminfo: memFree=27714648/32770624 swapFree=67001836/67108860
[pid=6601] ppid=6598 vsize=3679060 memory=3652152 CPUtime=402.22 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 901681 0 0 0 40116 106 0 0 20 0 1 0 436381965 3767357440 913038 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 919765 913038 842 493 0 913070 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 3679060 KiB
Current children cumulated memory: 3652152 KiB

[startup+462.3 s]
/proc/loadavg: 1.13 2.61 5.28 2/193 6641
/proc/meminfo: memFree=27175608/32770624 swapFree=67001836/67108860
[pid=6601] ppid=6598 vsize=4242652 memory=4190000 CPUtime=462.22 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 1034433 0 0 0 46103 119 0 0 20 0 1 0 436381965 4344475648 1047500 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 1060663 1047500 842 493 0 1053968 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 4242652 KiB
Current children cumulated memory: 4190000 KiB


################
# More data... #
################

Current children cumulated vsize: 17170728 KiB
Current children cumulated memory: 17080720 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.86 2/191 6772
/proc/meminfo: memFree=13720048/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=17696088 memory=17618544 CPUtime=1962.05 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4338833 0 0 0 195489 716 0 0 20 0 1 0 436381965 18120794112 4404636 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 4424022 4404636 842 493 0 4417327 0
Current children cumulated CPU time: 1962.05 s
Current children cumulated vsize: 17696088 KiB
Current children cumulated memory: 17618544 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.80 2/191 6775
/proc/meminfo: memFree=13183556/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=18221184 memory=18154012 CPUtime=2022.03 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4470747 0 0 0 201449 754 0 0 20 0 1 0 436381965 18658492416 4538503 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 4555296 4538503 842 493 0 4548601 0
Current children cumulated CPU time: 2022.03 s
Current children cumulated vsize: 18221184 KiB
Current children cumulated memory: 18154012 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.75 2/192 6780
/proc/meminfo: memFree=12646332/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=18746016 memory=18691132 CPUtime=2082.03 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4602688 0 0 0 207412 791 0 0 20 0 1 0 436381965 19195920384 4672783 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 4686504 4672783 842 493 0 4679809 0
Current children cumulated CPU time: 2082.03 s
Current children cumulated vsize: 18746016 KiB
Current children cumulated memory: 18691132 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.71 2/192 6791
/proc/meminfo: memFree=12110152/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=19270452 memory=19225804 CPUtime=2142.02 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4734431 0 0 0 213375 827 0 0 20 0 1 0 436381965 19732942848 4806451 33554432000 4194304 6211092 140725505420400 140725505385096 5452207 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 4817646 4806451 842 493 0 4810951 0
Current children cumulated CPU time: 2142.02 s
Current children cumulated vsize: 19270452 KiB
Current children cumulated memory: 19225804 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.66 2/192 6794
/proc/meminfo: memFree=11574368/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=19795152 memory=19760884 CPUtime=2202.01 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4866367 0 0 0 219338 863 0 0 20 0 1 0 436381965 20270235648 4940221 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 4948788 4940221 842 493 0 4942093 0
Current children cumulated CPU time: 2202.01 s
Current children cumulated vsize: 19795152 KiB
Current children cumulated memory: 19760884 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.62 2/193 6799
/proc/meminfo: memFree=11036904/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=20507104 memory=20297592 CPUtime=2262 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 4999087 0 0 0 225297 903 0 0 20 0 1 0 436381965 20999274496 5074398 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5126776 5074398 842 493 0 5120081 0
Current children cumulated CPU time: 2262 s
Current children cumulated vsize: 20507104 KiB
Current children cumulated memory: 20297592 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.58 2/192 6802
/proc/meminfo: memFree=10499444/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=21032068 memory=20832892 CPUtime=2322 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 5131079 0 0 0 231256 944 0 0 20 0 1 0 436381965 21536837632 5208223 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5258017 5208223 842 493 0 5251322 0
Current children cumulated CPU time: 2322 s
Current children cumulated vsize: 21032068 KiB
Current children cumulated memory: 20832892 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.55 2/192 6805
/proc/meminfo: memFree=9962632/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=21556372 memory=21369396 CPUtime=2381.99 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 5262773 0 0 0 237217 982 0 0 20 0 1 0 436381965 22073724928 5342349 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5389093 5342349 842 493 0 5382398 0
Current children cumulated CPU time: 2381.99 s
Current children cumulated vsize: 21556372 KiB
Current children cumulated memory: 21369396 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.51 2/192 6810
/proc/meminfo: memFree=9426512/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22081204 memory=21904424 CPUtime=2441.98 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 5394703 0 0 0 243174 1024 0 0 20 0 1 0 436381965 22611152896 5476106 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5520301 5476106 842 493 0 5513606 0
Current children cumulated CPU time: 2441.98 s
Current children cumulated vsize: 22081204 KiB
Current children cumulated memory: 21904424 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.48 2/191 6813
/proc/meminfo: memFree=8888296/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22605640 memory=22441192 CPUtime=2501.97 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 5526442 0 0 0 249133 1064 0 0 20 0 1 0 436381965 23148175360 5610298 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5651410 5610298 842 493 0 5644715 0
Current children cumulated CPU time: 2501.97 s
Current children cumulated vsize: 22605640 KiB
Current children cumulated memory: 22441192 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.47 2/191 6814
/proc/meminfo: memFree=8728368/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22760608 memory=22598284 CPUtime=2519.68 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 4202496 5565425 0 0 0 250892 1076 0 0 20 0 1 0 436381965 23306862592 5649571 33554432000 4194304 6211092 140725505420400 140725505385096 140170855984101 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5690152 5649571 842 493 0 5683457 0
Current children cumulated CPU time: 2519.68 s
Current children cumulated vsize: 22760608 KiB
Current children cumulated memory: 22598284 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.04 s]
# the end of solver process 6601 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2509.19 s, system=11.8037 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.47 2/191 6814
/proc/meminfo: memFree=8728368/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22760608 memory=22598284 CPUtime=2519.79 cores=0-7
/proc/6601/stat : 6601 (cosoco) S 6598 6601 6070 0 -1 512 5565432 0 0 0 250903 1076 0 0 20 0 1 0 436381965 23306862592 5649571 33554432000 4194304 6211092 140725505420400 140725505385096 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5690152 5649571 842 493 0 5683457 0
Current children cumulated CPU time: 2519.79 s
Current children cumulated vsize: 22760608 KiB
Current children cumulated memory: 22598284 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.47 3/192 6815
/proc/meminfo: memFree=8206484/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22760608 memory=22598284 CPUtime=2519.91 cores=0-7
/proc/6601/stat : 6601 (cosoco) S 6598 6601 6070 0 -1 512 5565432 0 0 0 250914 1077 0 0 20 0 1 0 436381965 23306862592 5649571 33554432000 4194304 6211092 140725505420400 140725505385096 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5690152 5649571 842 493 0 5683457 0
Current children cumulated CPU time: 2519.91 s
Current children cumulated vsize: 22760608 KiB
Current children cumulated memory: 22598284 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.01 1.47 2/192 6815
/proc/meminfo: memFree=7716808/32770624 swapFree=67001844/67108860
[pid=6601] ppid=6598 vsize=22760608 memory=22598284 CPUtime=2519.96 cores=0-7
/proc/6601/stat : 6601 (cosoco) R 6598 6601 6070 0 -1 512 5565432 0 0 0 250919 1077 0 0 20 0 1 0 436381965 23306862592 5649571 33554432000 4194304 6211092 140725505420400 140725505385096 5189550 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 19656704 140725505422353 140725505422445 140725505422445 140725505425358 0
/proc/6601/statm: 5690152 5649571 842 493 0 5683457 0
Current children cumulated CPU time: 2519.96 s
Current children cumulated vsize: 22760608 KiB
Current children cumulated memory: 22598284 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.04
CPU time (s): 2521
CPU user time (s): 2509.19
CPU system time (s): 11.8037
CPU usage (%): 99.9191
Max. virtual memory (cumulated for all children) (KiB): 22760608
Max. memory (cumulated for all children) (KiB): 22598284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2509.19
system time used= 11.8037
maximum resident set size= 22598400
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5565432
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 126502
involuntary context switches= 1477


# summary of solver processes directly reported to runsolver:
#   pid: 6601
#   total CPU time (s): 2521
#   total CPU user time (s): 2509.19
#   total CPU system time (s): 11.8037

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.875 second user time and 14.651 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-16 04:34:49
IDJOB=4398201
IDBENCH=124102
IDSOLVER=2851
FILE ID=node136/4398201-1568601333
RUNJOBID= node136-1568598203-6097
PBS_JOBID= 21703420
Free space on /tmp= 61172 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-57-076-20-15-05.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398201-1568601333/watcher-4398201-1568601333 -o /tmp/evaluation-result-4398201-1568601333/solver-4398201-1568601333 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node136-1568598203-6097 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398201-1568601333.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 103999ad3c646e4e3c5e6682f24aa76f
RANDOM SEED=1350074421

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31366276 kB
MemAvailable:   31893440 kB
Buffers:           80560 kB
Cached:           740900 kB
SwapCached:         3560 kB
Active:           525092 kB
Inactive:         301544 kB
Active(anon):       4692 kB
Inactive(anon):    49404 kB
Active(file):     520400 kB
Inactive(file):   252140 kB
Unevictable:      109740 kB
Mlocked:          109740 kB
SwapTotal:      67108860 kB
SwapFree:       67001828 kB
Dirty:              2624 kB
Writeback:             0 kB
AnonPages:        112848 kB
Mapped:            45780 kB
Shmem:             40208 kB
Slab:             170160 kB
SReclaimable:     140920 kB
SUnreclaim:        29240 kB
KernelStack:        3568 kB
PageTables:         6064 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     507352 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 60680 MiB
End job on node136 at 2019-09-16 05:16:52