Trace number 4409473

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0 parallel? (TO) 2520.67 2522.89

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-85-085-36-36-15.xml
MD5SUMe7b94b237cf4deebd8c7bf96e74cfc29
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7225
Number of constraints3741
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":7225}]
Minimum variable degree87
Maximum variable degree87
Distribution of variable degrees[{"degree":87,"count":7225}]
Minimum constraint arity85
Maximum constraint arity7225
Distribution of constraint arities[{"arity":85,"count":170},{"arity":170,"count":3570},{"arity":7225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":3740}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15465 MiB free)
  memory of node 1: 16384 MiB (15709 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409473-1569822362/watcher-4409473-1569822362 -o /tmp/evaluation-result-4409473-1569822362/solver-4409473-1569822362 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1569817401-14086 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409473-1569822362.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=14734, runsolver pid=14731
Current StackSize limit: 8192 KiB


[startup+0.100196 s]*
/proc/loadavg: 3.72 7.40 8.23 2/192 14735
/proc/meminfo: memFree=31885436/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=65588 memory=41752 CPUtime=0.08 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 10640 0 1 0 7 1 0 0 20 0 1 0 558508472 67162112 10438 33554432000 4194304 6211132 140724547281008 140724547277544 140581710346144 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 16397 10438 836 493 0 9702 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 65588 KiB
Current children cumulated memory: 41752 KiB

[startup+0.209394 s]*
/proc/loadavg: 3.72 7.40 8.23 2/192 14735
/proc/meminfo: memFree=31844764/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=101760 memory=77924 CPUtime=0.19 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 19698 0 1 0 17 2 0 0 20 0 1 0 558508472 104202240 19481 33554432000 4194304 6211132 140724547281008 140724547275032 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 25440 19481 840 493 0 18745 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 101760 KiB
Current children cumulated memory: 77924 KiB

[startup+0.308656 s]*
/proc/loadavg: 3.72 7.40 8.23 2/192 14735
/proc/meminfo: memFree=31843648/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=102552 memory=78716 CPUtime=0.29 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 19889 0 1 0 27 2 0 0 20 0 1 0 558508472 105013248 19679 33554432000 4194304 6211132 140724547281008 140724547275032 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 25638 19679 842 493 0 18943 0
Current children cumulated CPU time: 0.29 s
Current children cumulated vsize: 102552 KiB
Current children cumulated memory: 78716 KiB

[startup+0.700328 s]
/proc/loadavg: 3.72 7.40 8.23 2/192 14735
/proc/meminfo: memFree=31842160/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=105480 memory=81620 CPUtime=0.67 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 20626 0 1 0 65 2 0 0 20 0 1 0 558508472 108011520 20405 33554432000 4194304 6211132 140724547281008 140724547275032 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 26370 20405 842 493 0 19675 0
Current children cumulated CPU time: 0.67 s
Current children cumulated vsize: 105480 KiB
Current children cumulated memory: 81620 KiB

[startup+1.50033 s]
/proc/loadavg: 3.72 7.40 8.23 2/191 14735
/proc/meminfo: memFree=31837960/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=111676 memory=87916 CPUtime=1.47 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 22157 0 1 0 145 2 0 0 20 0 1 0 558508472 114356224 21979 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 27919 21979 842 493 0 21224 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 111676 KiB
Current children cumulated memory: 87916 KiB

[startup+3.10845 s]
/proc/loadavg: 3.50 7.29 8.19 2/191 14735
/proc/meminfo: memFree=31822940/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=124004 memory=100140 CPUtime=3.08 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 25493 0 1 0 305 3 0 0 20 0 1 0 558508472 126980096 25035 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 31001 25035 842 493 0 24306 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 124004 KiB
Current children cumulated memory: 100140 KiB

[startup+6.30032 s]
/proc/loadavg: 3.50 7.29 8.19 2/191 14735
/proc/meminfo: memFree=31799216/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=148608 memory=124484 CPUtime=6.28 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 31861 0 1 0 624 4 0 0 20 0 1 0 558508472 152174592 31121 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 37152 31121 842 493 0 30457 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 148608 KiB
Current children cumulated memory: 124484 KiB

[startup+12.7003 s]
/proc/loadavg: 3.30 7.19 8.16 2/191 14735
/proc/meminfo: memFree=31753584/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=198256 memory=173480 CPUtime=12.67 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 44376 0 1 0 1262 5 0 0 20 0 1 0 558508472 203014144 43370 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 49564 43370 842 493 0 42869 0
Current children cumulated CPU time: 12.67 s
Current children cumulated vsize: 198256 KiB
Current children cumulated memory: 173480 KiB

[startup+25.5003 s]
/proc/loadavg: 2.79 6.89 8.04 2/191 14736
/proc/meminfo: memFree=31653724/32770624 swapFree=66904192/67108860
[pid=14734] ppid=14731 vsize=295660 memory=271692 CPUtime=25.46 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 69397 0 1 0 2537 9 0 0 20 0 1 0 558508472 302755840 67923 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 73915 67923 842 493 0 67220 0
Current children cumulated CPU time: 25.46 s
Current children cumulated vsize: 295660 KiB
Current children cumulated memory: 271692 KiB

[startup+51.109 s]
/proc/loadavg: 2.18 6.41 7.85 2/191 14738
/proc/meminfo: memFree=31449936/32770624 swapFree=66904212/67108860
[pid=14734] ppid=14731 vsize=493648 memory=469604 CPUtime=51.06 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 118452 0 1 0 5090 16 0 0 20 0 1 0 558508472 505495552 117401 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 123412 117401 842 493 0 116717 0
Current children cumulated CPU time: 51.06 s
Current children cumulated vsize: 493648 KiB
Current children cumulated memory: 469604 KiB

[startup+102.3 s]
/proc/loadavg: 1.73 5.63 7.51 2/192 14748
/proc/meminfo: memFree=31050988/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=891108 memory=862420 CPUtime=102.23 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 215675 0 1 0 10195 28 0 0 20 0 1 0 558508472 912494592 215605 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 222777 215605 842 493 0 216082 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 891108 KiB
Current children cumulated memory: 862420 KiB

[startup+162.3 s]
/proc/loadavg: 1.27 4.79 7.10 2/192 14751
/proc/meminfo: memFree=30587644/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=1354012 memory=1324676 CPUtime=162.21 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 329191 0 1 0 16178 43 0 0 20 0 1 0 558508472 1386508288 331169 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 338503 331169 842 493 0 331808 0
Current children cumulated CPU time: 162.21 s
Current children cumulated vsize: 1354012 KiB
Current children cumulated memory: 1324676 KiB

[startup+222.3 s]
/proc/loadavg: 1.10 4.10 6.72 2/192 14756
/proc/meminfo: memFree=30124428/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=1822384 memory=1786876 CPUtime=222.19 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 442692 0 1 0 22160 59 0 0 20 0 1 0 558508472 1866121216 446719 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 455596 446719 842 493 0 448901 0
Current children cumulated CPU time: 222.19 s
Current children cumulated vsize: 1822384 KiB
Current children cumulated memory: 1786876 KiB

[startup+282.3 s]
/proc/loadavg: 1.04 3.53 6.36 2/192 14759
/proc/meminfo: memFree=29664476/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=2274220 memory=2247020 CPUtime=282.18 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 555659 0 1 0 28144 74 0 0 20 0 1 0 558508472 2328801280 561755 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 568555 561755 842 493 0 561860 0
Current children cumulated CPU time: 282.18 s
Current children cumulated vsize: 2274220 KiB
Current children cumulated memory: 2247020 KiB

[startup+342.3 s]
/proc/loadavg: 1.01 3.07 6.03 2/190 14762
/proc/meminfo: memFree=29201528/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=2750528 memory=2709012 CPUtime=342.16 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 669111 0 1 0 34127 89 0 0 20 0 1 0 558508472 2816540672 677253 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 687632 677253 842 493 0 680937 0
Current children cumulated CPU time: 342.16 s
Current children cumulated vsize: 2750528 KiB
Current children cumulated memory: 2709012 KiB

[startup+402.3 s]
/proc/loadavg: 1.00 2.69 5.71 2/190 14769
/proc/meminfo: memFree=28738960/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=3202496 memory=3171152 CPUtime=402.15 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 782113 0 1 0 40112 103 0 0 20 0 1 0 558508472 3279355904 792788 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 800624 792788 842 493 0 793929 0
Current children cumulated CPU time: 402.15 s
Current children cumulated vsize: 3202496 KiB
Current children cumulated memory: 3171152 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 2.39 5.42 2/190 14772
/proc/meminfo: memFree=28277876/32770624 swapFree=66904276/67108860
[pid=14734] ppid=14731 vsize=3691244 memory=3630904 CPUtime=462.14 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 895550 0 1 0 46094 120 0 0 20 0 1 0 558508472 3779833856 907726 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 922811 907726 842 493 0 916116 0
Current children cumulated CPU time: 462.14 s
Current children cumulated vsize: 3691244 KiB
Current children cumulated memory: 3630904 KiB


################
# More data... #
################

Current children cumulated vsize: 14786272 KiB
Current children cumulated memory: 14694220 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.88 2/191 14910
/proc/meminfo: memFree=16731396/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=15237184 memory=15155116 CPUtime=1961.9 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 3721133 0 1 0 195534 656 0 0 20 0 1 0 558508472 15602876416 3788779 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 3809296 3788779 842 493 0 3802601 0
Current children cumulated CPU time: 1961.9 s
Current children cumulated vsize: 15237184 KiB
Current children cumulated memory: 15155116 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.83 2/191 14915
/proc/meminfo: memFree=16269396/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=15688096 memory=15616540 CPUtime=2021.9 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 3834003 0 1 0 201509 681 0 0 20 0 1 0 558508472 16064610304 3904135 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 3922024 3904135 842 493 0 3915329 0
Current children cumulated CPU time: 2021.9 s
Current children cumulated vsize: 15688096 KiB
Current children cumulated memory: 15616540 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.77 2/191 14918
/proc/meminfo: memFree=15809536/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=16138612 memory=16075028 CPUtime=2081.89 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 3946784 0 1 0 207478 711 0 0 20 0 1 0 558508472 16525938688 4018757 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4034653 4018757 842 493 0 4027958 0
Current children cumulated CPU time: 2081.89 s
Current children cumulated vsize: 16138612 KiB
Current children cumulated memory: 16075028 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.73 2/190 14921
/proc/meminfo: memFree=15347732/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=16588468 memory=16535396 CPUtime=2141.88 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4059392 0 1 0 213443 745 0 0 20 0 1 0 558508472 16986591232 4133849 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4147117 4133849 842 493 0 4140422 0
Current children cumulated CPU time: 2141.88 s
Current children cumulated vsize: 16588468 KiB
Current children cumulated memory: 16535396 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.68 2/189 14927
/proc/meminfo: memFree=14885944/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=17038456 memory=16995400 CPUtime=2201.86 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4172031 0 1 0 219406 780 0 0 20 0 1 0 558508472 17447378944 4248850 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4259614 4248850 842 493 0 4252919 0
Current children cumulated CPU time: 2201.86 s
Current children cumulated vsize: 17038456 KiB
Current children cumulated memory: 16995400 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.64 2/189 14930
/proc/meminfo: memFree=14426568/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=17488708 memory=17453988 CPUtime=2261.85 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4284720 0 1 0 225369 816 0 0 20 0 1 0 558508472 17908436992 4363497 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4372177 4363497 842 493 0 4365482 0
Current children cumulated CPU time: 2261.85 s
Current children cumulated vsize: 17488708 KiB
Current children cumulated memory: 17453988 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.60 2/189 14933
/proc/meminfo: memFree=13965520/32770624 swapFree=66904300/67108860
[pid=14734] ppid=14731 vsize=17938960 memory=17914520 CPUtime=2321.84 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4397452 0 1 0 231332 852 0 0 20 0 1 0 558508472 18369495040 4478630 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4484740 4478630 842 493 0 4478045 0
Current children cumulated CPU time: 2321.84 s
Current children cumulated vsize: 17938960 KiB
Current children cumulated memory: 17914520 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.56 2/189 14939
/proc/meminfo: memFree=13504228/32770624 swapFree=66904304/67108860
[pid=14734] ppid=14731 vsize=18576068 memory=18374180 CPUtime=2381.83 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4510488 0 1 0 237292 891 0 0 20 0 1 0 558508472 19021893632 4593545 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4644017 4593545 842 493 0 4637322 0
Current children cumulated CPU time: 2381.83 s
Current children cumulated vsize: 18576068 KiB
Current children cumulated memory: 18374180 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.53 2/189 14942
/proc/meminfo: memFree=13042784/32770624 swapFree=66904304/67108860
[pid=14734] ppid=14731 vsize=19026452 memory=18834976 CPUtime=2441.81 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4623234 0 1 0 243252 929 0 0 20 0 1 0 558508472 19483086848 4708744 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4756613 4708744 842 493 0 4749918 0
Current children cumulated CPU time: 2441.81 s
Current children cumulated vsize: 19026452 KiB
Current children cumulated memory: 18834976 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.49 2/189 14952
/proc/meminfo: memFree=12583596/32770624 swapFree=66904312/67108860
[pid=14734] ppid=14731 vsize=19476044 memory=19292772 CPUtime=2501.8 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4735783 0 1 0 249212 968 0 0 20 0 1 0 558508472 19943469056 4823193 33554432000 4194304 6211132 140724547281008 140724547242248 140581710298085 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4869011 4823193 842 493 0 4862316 0
Current children cumulated CPU time: 2501.8 s
Current children cumulated vsize: 19476044 KiB
Current children cumulated memory: 19292772 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.48 2/190 14954
/proc/meminfo: memFree=12444120/32770624 swapFree=66904312/67108860
[pid=14734] ppid=14731 vsize=19608968 memory=19429716 CPUtime=2519.5 cores=0-7
/proc/14734/stat : 14734 (cosoco) R 14731 14734 14059 0 -1 4202496 4769064 0 1 0 250971 979 0 0 20 0 1 0 558508472 20079583232 4857429 33554432000 4194304 6211132 140724547281008 140724547242248 140581720243032 0 0 4096 8405026 0 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4902242 4857429 842 493 0 4895547 0
Current children cumulated CPU time: 2519.5 s
Current children cumulated vsize: 19608968 KiB
Current children cumulated memory: 19429716 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2522.89 s]
# the end of solver process 14734 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2509.99 s, system=10.6762 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.00 1.01 1.48 2/190 14954
/proc/meminfo: memFree=12444120/32770624 swapFree=66904312/67108860
[pid=14734] ppid=14731 vsize=19608968 memory=19429716 CPUtime=2519.61 cores=0-7
/proc/14734/stat : 14734 (cosoco) S 14731 14734 14059 0 -1 512 4769068 0 1 0 250982 979 0 0 20 0 1 0 558508472 20079583232 4857429 33554432000 4194304 6211132 140724547281008 140724547242248 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4902242 4857429 842 493 0 4895547 0
Current children cumulated CPU time: 2519.61 s
Current children cumulated vsize: 19608968 KiB
Current children cumulated memory: 19429716 KiB

[startup+2521.6 s]
/proc/loadavg: 1.00 1.01 1.48 2/190 14955
/proc/meminfo: memFree=11963900/32770624 swapFree=66904316/67108860
[pid=14734] ppid=14731 vsize=19608968 memory=19429716 CPUtime=2519.72 cores=0-7
/proc/14734/stat : 14734 (cosoco) S 14731 14734 14059 0 -1 512 4769068 0 1 0 250993 979 0 0 20 0 1 0 558508472 20079583232 4857429 33554432000 4194304 6211132 140724547281008 140724547242248 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4902242 4857429 842 493 0 4895547 0
Current children cumulated CPU time: 2519.72 s
Current children cumulated vsize: 19608968 KiB
Current children cumulated memory: 19429716 KiB

[startup+2522 s]*
/proc/loadavg: 1.00 1.01 1.48 2/190 14955
/proc/meminfo: memFree=11445348/32770624 swapFree=66904316/67108860
[pid=14734] ppid=14731 vsize=19608968 memory=19429716 CPUtime=2519.77 cores=0-7
/proc/14734/stat : 14734 (cosoco) S 14731 14734 14059 0 -1 512 4769068 0 1 0 250998 979 0 0 20 0 1 0 558508472 20079583232 4857429 33554432000 4194304 6211132 140724547281008 140724547242248 5189582 0 16384 4096 8405026 18446744071580971376 0 0 17 6 0 0 1 0 0 8312316 8317760 11497472 140724547286033 140724547286125 140724547286125 140724547289038 0
/proc/14734/statm: 4902242 4857429 842 493 0 4895547 0
Current children cumulated CPU time: 2519.77 s
Current children cumulated vsize: 19608968 KiB
Current children cumulated memory: 19429716 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2522.89
CPU time (s): 2520.67
CPU user time (s): 2509.99
CPU system time (s): 10.6762
CPU usage (%): 99.912
Max. virtual memory (cumulated for all children) (KiB): 19608968
Max. memory (cumulated for all children) (KiB): 19429716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2509.99
system time used= 10.6762
maximum resident set size= 19429884
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4769068
page faults= 1
swaps= 0
block input operations= 9928
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124651
involuntary context switches= 1373


# summary of solver processes directly reported to runsolver:
#   pid: 14734
#   total CPU time (s): 2520.67
#   total CPU user time (s): 2509.99
#   total CPU system time (s): 10.6762

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.14355 second user time and 15.7097 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-30 07:48:30
IDJOB=4409473
IDBENCH=124071
IDSOLVER=2877
FILE ID=node139/4409473-1569822362
RUNJOBID= node139-1569817401-14086
PBS_JOBID= 21705915
Free space on /tmp= 62032 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-85-085-36-36-15.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409473-1569822362/watcher-4409473-1569822362 -o /tmp/evaluation-result-4409473-1569822362/solver-4409473-1569822362 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1569817401-14086 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409473-1569822362.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e7b94b237cf4deebd8c7bf96e74cfc29
RANDOM SEED=1179155672

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31923816 kB
MemAvailable:   31867240 kB
Buffers:           57084 kB
Cached:           175300 kB
SwapCached:        75136 kB
Active:            74136 kB
Inactive:         234600 kB
Active(anon):      11448 kB
Inactive(anon):   107360 kB
Active(file):      62688 kB
Inactive(file):   127240 kB
Unevictable:      109076 kB
Mlocked:          109076 kB
SwapTotal:      67108860 kB
SwapFree:       66904192 kB
Dirty:              2644 kB
Writeback:            36 kB
AnonPages:        116804 kB
Mapped:            20656 kB
Shmem:             33756 kB
Slab:             132472 kB
SReclaimable:     103340 kB
SUnreclaim:        29132 kB
KernelStack:        3456 kB
PageTables:         5164 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     529500 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     73728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 61548 MiB
End job on node139 at 2019-09-30 08:30:33