Trace number 4389630

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (MO) 1391.02 1392.84

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-22-033-12-08-04.xml
MD5SUMf3f766a62b1d9930afd3b37b1c8667ba
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables726
Number of constraints287
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":726}]
Minimum variable degree24
Maximum variable degree24
Distribution of variable degrees[{"degree":24,"count":726}]
Minimum constraint arity22
Maximum constraint arity726
Distribution of constraint arities[{"arity":22,"count":33},{"arity":33,"count":22},{"arity":66,"count":231},{"arity":726,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":286}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15349 MiB free)
  memory of node 1: 16384 MiB (10199 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389630-1568325427/watcher-4389630-1568325427 -o /tmp/evaluation-result-4389630-1568325427/solver-4389630-1568325427 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568313599-15140 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389630-1568325427.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=17716, runsolver pid=17713

[startup+0.100213 s]*
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26161428/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=28972 memory=5452 CPUtime=0.1 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 1536 0 0 0 10 0 0 0 20 0 1 0 408480589 29667328 1363 33554432000 4194304 6210612 140720847459536 140720847440744 5453752 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 7243 1363 840 493 0 548 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28972 KiB
Current children cumulated memory: 5452 KiB

[startup+0.20949 s]*
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26158888/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=30252 memory=6508 CPUtime=0.21 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 1841 0 0 0 21 0 0 0 20 0 1 0 408480589 30978048 1627 33554432000 4194304 6210612 140720847459536 140720847440744 139823841549285 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 7563 1627 840 493 0 868 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30252 KiB
Current children cumulated memory: 6508 KiB

[startup+0.309162 s]*
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26157028/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=31348 memory=7564 CPUtime=0.31 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 2118 0 0 0 31 0 0 0 20 0 1 0 408480589 32100352 1891 33554432000 4194304 6210612 140720847459536 140720847440744 139823841549285 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 7837 1891 840 493 0 1142 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31348 KiB
Current children cumulated memory: 7564 KiB

[startup+0.700267 s]
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26152936/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=35648 memory=11988 CPUtime=0.68 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3192 0 0 0 68 0 0 0 20 0 1 0 408480589 36503552 2997 33554432000 4194304 6210612 140720847459536 140720847440744 5442785 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 8912 2997 840 493 0 2217 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 35648 KiB
Current children cumulated memory: 11988 KiB

[startup+1.50026 s]
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26142396/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=44704 memory=20896 CPUtime=1.48 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 5431 0 0 0 148 0 0 0 20 0 1 0 408480589 45776896 5224 33554432000 4194304 6210612 140720847459536 140720847440744 5442750 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 11176 5224 840 493 0 4481 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 44704 KiB
Current children cumulated memory: 20896 KiB

[startup+3.10944 s]
/proc/loadavg: 2.00 2.06 2.09 3/200 17717
/proc/meminfo: memFree=26101548/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=63096 memory=38852 CPUtime=3.09 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 10005 0 0 0 308 1 0 0 20 0 1 0 408480589 64610304 9713 33554432000 4194304 6210612 140720847459536 140720847440744 139823851494208 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 15774 9713 840 493 0 9079 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 63096 KiB
Current children cumulated memory: 38852 KiB

[startup+6.30022 s]
/proc/loadavg: 2.00 2.05 2.09 3/200 17717
/proc/meminfo: memFree=26040676/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=99628 memory=74440 CPUtime=6.29 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 18969 0 0 0 627 2 0 0 20 0 1 0 408480589 102019072 18610 33554432000 4194304 6210612 140720847459536 140720847440744 5451997 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 24907 18610 840 493 0 18212 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 99628 KiB
Current children cumulated memory: 74440 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.05 2.09 3/200 17717
/proc/meminfo: memFree=25916296/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=170640 memory=146128 CPUtime=12.68 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 36923 0 0 0 1264 4 0 0 20 0 1 0 408480589 174735360 36532 33554432000 4194304 6210612 140720847459536 140720847440744 5452047 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 42660 36532 840 493 0 35965 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 170640 KiB
Current children cumulated memory: 146128 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.05 2.09 3/200 17717
/proc/meminfo: memFree=25647088/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=316428 memory=291344 CPUtime=25.48 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 72312 0 0 0 2540 8 0 0 20 0 1 0 408480589 324022272 72836 33554432000 4194304 6210612 140720847459536 140720847440744 139823842469776 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 79107 72836 840 493 0 72412 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 316428 KiB
Current children cumulated memory: 291344 KiB

[startup+51.1095 s]
/proc/loadavg: 2.08 2.06 2.09 3/200 17720
/proc/meminfo: memFree=25107520/32770624 swapFree=66917340/67108860
[pid=17716] ppid=17713 vsize=610692 memory=575936 CPUtime=51.09 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 141990 0 0 0 5093 16 0 0 20 0 1 0 408480589 625348608 143984 33554432000 4194304 6210612 140720847459536 140720847440744 139823842472794 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 152673 143984 840 493 0 145978 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 610692 KiB
Current children cumulated memory: 575936 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.05 2.09 3/201 17726
/proc/meminfo: memFree=24052528/32770624 swapFree=66917344/67108860
[pid=17716] ppid=17713 vsize=1178844 memory=1150252 CPUtime=102.28 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 280504 0 0 0 10195 33 0 0 20 0 1 0 408480589 1207136256 287563 33554432000 4194304 6210612 140720847459536 140720847440744 139823842475423 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 294711 287563 840 493 0 288016 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1178844 KiB
Current children cumulated memory: 1150252 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.04 2.08 3/200 17730
/proc/meminfo: memFree=22812016/32770624 swapFree=66917344/67108860
[pid=17716] ppid=17713 vsize=1848244 memory=1819252 CPUtime=162.28 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 441649 0 0 0 16175 53 0 0 20 0 1 0 408480589 1892601856 454813 33554432000 4194304 6210612 140720847459536 140720847440744 5455474 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 462061 454813 840 493 0 455366 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 1848244 KiB
Current children cumulated memory: 1819252 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.04 2.08 3/202 17744
/proc/meminfo: memFree=21566956/32770624 swapFree=66917356/67108860
[pid=17716] ppid=17713 vsize=2532648 memory=2490260 CPUtime=222.28 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 602798 0 0 0 22152 76 0 0 20 0 1 0 408480589 2593431552 622565 33554432000 4194304 6210612 140720847459536 140720847440744 139823842472790 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 633162 622565 840 493 0 626467 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2532648 KiB
Current children cumulated memory: 2490260 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.07 3/201 17773
/proc/meminfo: memFree=20323400/32770624 swapFree=66917372/67108860
[pid=17716] ppid=17713 vsize=3238884 memory=3162584 CPUtime=282.27 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 764348 0 0 0 28130 97 0 0 20 0 1 0 408480589 3316617216 790646 33554432000 4194304 6210612 140720847459536 140720847440744 139823842469809 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 809721 790646 840 493 0 803026 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 3238884 KiB
Current children cumulated memory: 3162584 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.07 3/201 17777
/proc/meminfo: memFree=19081624/32770624 swapFree=66917372/67108860
[pid=17716] ppid=17713 vsize=3879084 memory=3833748 CPUtime=342.26 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 924564 0 0 0 34107 119 0 0 20 0 1 0 408480589 3972182016 958437 33554432000 4194304 6210612 140720847459536 140720847440744 5446078 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 969771 958437 840 493 0 963076 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 3879084 KiB
Current children cumulated memory: 3833748 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.06 3/201 17783
/proc/meminfo: memFree=17845304/32770624 swapFree=66917372/67108860
[pid=17716] ppid=17713 vsize=4618732 memory=4501584 CPUtime=402.27 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 1085672 0 0 0 40082 145 0 0 20 0 1 0 408480589 4729581568 1125396 33554432000 4194304 6210612 140720847459536 140720847440744 5446483 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 1154683 1125396 840 493 0 1147988 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 4618732 KiB
Current children cumulated memory: 4501584 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17787
/proc/meminfo: memFree=16600840/32770624 swapFree=66917372/67108860
[pid=17716] ppid=17713 vsize=5258404 memory=5174284 CPUtime=462.26 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 1245805 0 0 0 46058 168 0 0 20 0 1 0 408480589 5384605696 1293571 33554432000 4194304 6210612 140720847459536 140720847440744 5012594 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 1314601 1293571 840 493 0 1307906 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 5258404 KiB
Current children cumulated memory: 5174284 KiB


################
# More data... #
################

Current children cumulated vsize: 9282784 KiB
Current children cumulated memory: 9194840 KiB

[startup+882.3 s]
/proc/loadavg: 2.03 2.07 2.08 3/200 17829
/proc/meminfo: memFree=7921564/32770624 swapFree=66917388/67108860
[pid=17716] ppid=17713 vsize=9922984 memory=9865592 CPUtime=882.24 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 2368838 0 0 0 87871 353 0 0 20 0 1 0 408480589 10161135616 2466398 33554432000 4194304 6210612 140720847459536 140720847440744 139823851494218 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 2480746 2466398 840 493 0 2474051 0
Current children cumulated CPU time: 882.24 s
Current children cumulated vsize: 9922984 KiB
Current children cumulated memory: 9865592 KiB

[startup+942.3 s]
/proc/loadavg: 2.01 2.06 2.07 3/201 17835
/proc/meminfo: memFree=6680168/32770624 swapFree=66917388/67108860
[pid=17716] ppid=17713 vsize=10749644 memory=10533740 CPUtime=942.24 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 2529429 0 0 0 93841 383 0 0 20 0 1 0 408480589 11007635456 2633435 33554432000 4194304 6210612 140720847459536 140720847440744 5442936 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 2687411 2633435 840 493 0 2680716 0
Current children cumulated CPU time: 942.24 s
Current children cumulated vsize: 10749644 KiB
Current children cumulated memory: 10533740 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/200 17839
/proc/meminfo: memFree=5439876/32770624 swapFree=66917388/67108860
[pid=17716] ppid=17713 vsize=11388920 memory=11203640 CPUtime=1002.24 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 2689569 0 0 0 99811 413 0 0 20 0 1 0 408480589 11662254080 2800910 33554432000 4194304 6210612 140720847459536 140720847440744 139823851494214 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 2847230 2800910 840 493 0 2840535 0
Current children cumulated CPU time: 1002.24 s
Current children cumulated vsize: 11388920 KiB
Current children cumulated memory: 11203640 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/200 17843
/proc/meminfo: memFree=4200520/32770624 swapFree=66917388/67108860
[pid=17716] ppid=17713 vsize=12028724 memory=11874068 CPUtime=1062.23 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 2849828 0 0 0 105778 445 0 0 20 0 1 0 408480589 12317413376 2968517 33554432000 4194304 6210612 140720847459536 140720847440744 5478246 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3007181 2968517 840 493 0 3000486 0
Current children cumulated CPU time: 1062.23 s
Current children cumulated vsize: 12028724 KiB
Current children cumulated memory: 11874068 KiB

[startup+1122.3 s]
/proc/loadavg: 2.36 2.13 2.09 3/201 17976
/proc/meminfo: memFree=19036552/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=12667076 memory=12543248 CPUtime=1122.22 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3009660 0 0 0 111744 478 0 0 20 0 1 0 408480589 12971085824 3135812 33554432000 4194304 6210612 140720847459536 140720847440744 5451376 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3166769 3135812 840 493 0 3160074 0
Current children cumulated CPU time: 1122.22 s
Current children cumulated vsize: 12667076 KiB
Current children cumulated memory: 12543248 KiB

[startup+1182.3 s]
/proc/loadavg: 2.13 2.10 2.08 3/200 17980
/proc/meminfo: memFree=18361900/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=13365676 memory=13216964 CPUtime=1182.21 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3171130 0 0 0 117711 510 0 0 20 0 1 0 408480589 13686452224 3304241 33554432000 4194304 6210612 140720847459536 140720847440744 5453748 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3341419 3304241 840 493 0 3334724 0
Current children cumulated CPU time: 1182.21 s
Current children cumulated vsize: 13365676 KiB
Current children cumulated memory: 13216964 KiB

[startup+1242.3 s]
/proc/loadavg: 2.05 2.08 2.07 3/200 17984
/proc/meminfo: memFree=17683968/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=14009044 memory=13893188 CPUtime=1242.2 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3332159 0 0 0 123675 545 0 0 20 0 1 0 408480589 14345261056 3473297 33554432000 4194304 6210612 140720847459536 140720847440744 139823842475428 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3502261 3473297 840 493 0 3495566 0
Current children cumulated CPU time: 1242.2 s
Current children cumulated vsize: 14009044 KiB
Current children cumulated memory: 13893188 KiB

[startup+1302.3 s]
/proc/loadavg: 2.02 2.07 2.07 3/201 17990
/proc/meminfo: memFree=16994380/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=14652016 memory=14566968 CPUtime=1302.19 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3493064 0 0 0 129641 578 0 0 20 0 1 0 408480589 15003664384 3641742 33554432000 4194304 6210612 140720847459536 140720847440744 139823841549285 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3663004 3641742 840 493 0 3656309 0
Current children cumulated CPU time: 1302.19 s
Current children cumulated vsize: 14652016 KiB
Current children cumulated memory: 14566968 KiB

[startup+1362.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/200 17994
/proc/meminfo: memFree=16322008/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15575268 memory=15238632 CPUtime=1362.18 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3654481 0 0 0 135604 614 0 0 20 0 1 0 408480589 15949074432 3809658 33554432000 4194304 6210612 140720847459536 140720847440744 5452066 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3893817 3809658 840 493 0 3887122 0
Current children cumulated CPU time: 1362.18 s
Current children cumulated vsize: 15575268 KiB
Current children cumulated memory: 15238632 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1390 s]*
/proc/loadavg: 2.00 2.05 2.06 3/201 17996
/proc/meminfo: memFree=16006720/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15872532 memory=15550164 CPUtime=1389.88 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) R 17713 17716 15109 0 -1 4202496 3728883 0 0 0 138359 629 0 0 20 0 1 0 408480589 16253472768 3887541 33554432000 4194304 6210612 140720847459536 140720847440744 139823841549285 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3968133 3887541 840 493 0 3961438 0
Current children cumulated CPU time: 1389.88 s
Current children cumulated vsize: 15872532 KiB
Current children cumulated memory: 15550164 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1392.84 s]
# the end of solver process 17716 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1383.87 s, system=7.14424 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1390.4 s]
/proc/loadavg: 2.00 2.05 2.06 3/201 17996
/proc/meminfo: memFree=16006720/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15872532 memory=15550164 CPUtime=1389.94 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) S 17713 17716 15109 0 -1 512 3728889 0 0 0 138364 630 0 0 20 0 1 0 408480589 16253472768 3887541 33554432000 4194304 6210612 140720847459536 140720847440744 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 2 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3968133 3887541 840 493 0 3961438 0
Current children cumulated CPU time: 1389.94 s
Current children cumulated vsize: 15872532 KiB
Current children cumulated memory: 15550164 KiB

[startup+1391.2 s]
/proc/loadavg: 2.00 2.05 2.06 3/202 17997
/proc/meminfo: memFree=15475736/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15872532 memory=15550164 CPUtime=1390.06 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) S 17713 17716 15109 0 -1 512 3728889 0 0 0 138376 630 0 0 20 0 1 0 408480589 16253472768 3887541 33554432000 4194304 6210612 140720847459536 140720847440744 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3968133 3887541 840 493 0 3961438 0
Current children cumulated CPU time: 1390.06 s
Current children cumulated vsize: 15872532 KiB
Current children cumulated memory: 15550164 KiB

[startup+1391.6 s]
/proc/loadavg: 2.00 2.05 2.06 3/202 17997
/proc/meminfo: memFree=15475736/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15872532 memory=15550164 CPUtime=1390.11 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) S 17713 17716 15109 0 -1 512 3728889 0 0 0 138381 630 0 0 20 0 1 0 408480589 16253472768 3887541 33554432000 4194304 6210612 140720847459536 140720847440744 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3968133 3887541 840 493 0 3961438 0
Current children cumulated CPU time: 1390.11 s
Current children cumulated vsize: 15872532 KiB
Current children cumulated memory: 15550164 KiB

[startup+1392 s]*
/proc/loadavg: 2.00 2.05 2.06 4/202 17997
/proc/meminfo: memFree=14955928/32770624 swapFree=66917392/67108860
[pid=17716] ppid=17713 vsize=15872532 memory=15550164 CPUtime=1390.18 cores=0,2,4,6
/proc/17716/stat : 17716 (cosoco) S 17713 17716 15109 0 -1 512 3728889 0 0 0 138387 631 0 0 20 0 1 0 408480589 16253472768 3887541 33554432000 4194304 6210612 140720847459536 140720847440744 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8308220 8313664 10014720 140720847463435 140720847463537 140720847463537 140720847466446 0
/proc/17716/statm: 3968133 3887541 840 493 0 3961438 0
Current children cumulated CPU time: 1390.18 s
Current children cumulated vsize: 15872532 KiB
Current children cumulated memory: 15550164 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1392.84
CPU time (s): 1391.02
CPU user time (s): 1383.87
CPU system time (s): 7.14424
CPU usage (%): 99.8688
Max. virtual memory (cumulated for all children) (KiB): 15872532
Max. memory (cumulated for all children) (KiB): 15550164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1383.87
system time used= 7.14424
maximum resident set size= 15550332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3728889
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129113
involuntary context switches= 1513


# summary of solver processes directly reported to runsolver:
#   pid: 17716
#   total CPU time (s): 1391.02
#   total CPU user time (s): 1383.87
#   total CPU system time (s): 7.14424

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.14385 second user time and 9.33173 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-12 23:56:25
IDJOB=4389630
IDBENCH=124081
IDSOLVER=2829
FILE ID=node141/4389630-1568325427
RUNJOBID= node141-1568313599-15140
PBS_JOBID= 21701135
Free space on /tmp= 56108 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-22-033-12-08-04.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389630-1568325427/watcher-4389630-1568325427 -o /tmp/evaluation-result-4389630-1568325427/solver-4389630-1568325427 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568313599-15140 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389630-1568325427.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f3f766a62b1d9930afd3b37b1c8667ba
RANDOM SEED=808330356

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26163068 kB
MemAvailable:   26356964 kB
Buffers:          123836 kB
Cached:           358280 kB
SwapCached:        81876 kB
Active:          5703388 kB
Inactive:         341524 kB
Active(anon):    5487088 kB
Inactive(anon):   106008 kB
Active(file):     216300 kB
Inactive(file):   235516 kB
Unevictable:      109212 kB
Mlocked:          109212 kB
SwapTotal:      67108860 kB
SwapFree:       66917340 kB
Dirty:              2768 kB
Writeback:             0 kB
AnonPages:       5590804 kB
Mapped:            34872 kB
Shmem:             21392 kB
Slab:             145948 kB
SReclaimable:     115832 kB
SUnreclaim:        30116 kB
KernelStack:        3520 kB
PageTables:        16600 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    6046552 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    886784 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 55604 MiB
End job on node141 at 2019-09-13 00:19:38