Trace number 4391820

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
miniBTD 19.06.16? (TO) 2400.05 2400.11

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-spba/
Pb-BeauxArts-K80.xml
MD5SUM330870ed9e83d00984bc877f52c977b4
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark15.8012
Satisfiable
(Un)Satisfiability was proved
Number of variables4400
Number of constraints4562
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":4400}]
Minimum variable degree3
Maximum variable degree9
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":140},{"degree":5,"count":654},{"degree":6,"count":2350},{"degree":7,"count":707},{"degree":8,"count":392},{"degree":9,"count":156}]
Minimum constraint arity1
Maximum constraint arity80
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":790},{"arity":3,"count":2291},{"arity":4,"count":711},{"arity":5,"count":395},{"arity":6,"count":158},{"arity":55,"count":160},{"arity":80,"count":55}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":4562}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 19.06.16

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9111 MiB free)
  memory of node 1: 16384 MiB (15110 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391820-1568316497/watcher-4391820-1568316497 -o /tmp/evaluation-result-4391820-1568316497/solver-4391820-1568316497 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568306093-23618 --watchdog 2560 miniBTD 2400 HOME/instance-4391820-1568316497.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=25398, runsolver pid=25394

[startup+0.100898 s]*
/proc/loadavg: 2.00 2.01 2.05 4/197 25403
/proc/meminfo: memFree=24796220/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=31132 memory=6956 CPUtime=0.09 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 1955 0 0 0 9 0 0 0 20 0 1 0 407917340 31879168 1739 33554432000 4194304 5326806 140732509347184 140732509341272 4236464 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 7783 1739 597 277 0 1304 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 31132 KiB
Current children cumulated memory: 6956 KiB

[startup+0.209465 s]*
/proc/loadavg: 2.00 2.01 2.05 3/197 25403
/proc/meminfo: memFree=24795476/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=31396 memory=7220 CPUtime=0.2 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 2028 0 0 0 20 0 0 0 20 0 1 0 407917340 32149504 1805 33554432000 4194304 5326806 140732509347184 140732509341272 4236432 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 7849 1805 597 277 0 1370 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 31396 KiB
Current children cumulated memory: 7220 KiB

[startup+0.308865 s]*
/proc/loadavg: 2.00 2.01 2.05 3/197 25403
/proc/meminfo: memFree=24794856/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=31792 memory=7748 CPUtime=0.3 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 2137 0 0 0 30 0 0 0 20 0 1 0 407917340 32555008 1937 33554432000 4194304 5326806 140732509347184 140732509341272 140163249326001 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 7948 1937 597 277 0 1469 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 31792 KiB
Current children cumulated memory: 7748 KiB

[startup+0.700233 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25403
/proc/meminfo: memFree=24792228/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=34344 memory=10208 CPUtime=0.68 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 2759 0 0 0 68 0 0 0 20 0 1 0 407917340 35168256 2552 33554432000 4194304 5326806 140732509347184 140732509341272 140163248405477 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 8586 2552 601 277 0 2107 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 34344 KiB
Current children cumulated memory: 10208 KiB

[startup+1.50032 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25403
/proc/meminfo: memFree=24770528/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=60524 memory=36428 CPUtime=1.49 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 9276 0 0 0 147 2 0 0 20 0 1 0 407917340 61976576 9107 33554432000 4194304 5326806 140732509347184 140732509341272 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15131 9107 641 277 0 8652 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 60524 KiB
Current children cumulated memory: 36428 KiB

[startup+3.10941 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25410
/proc/meminfo: memFree=24742588/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61168 memory=37088 CPUtime=3.09 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 12047 0 0 0 307 2 0 0 20 0 1 0 407917340 62636032 9272 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15292 9272 655 277 0 8813 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 61168 KiB
Current children cumulated memory: 37088 KiB

[startup+6.30024 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25410
/proc/meminfo: memFree=24742008/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61300 memory=37168 CPUtime=6.28 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 14718 0 0 0 625 3 0 0 20 0 1 0 407917340 62771200 9292 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15325 9292 655 277 0 8846 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 61300 KiB
Current children cumulated memory: 37168 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25411
/proc/meminfo: memFree=24741876/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61592 memory=37272 CPUtime=12.68 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 17449 0 0 0 1263 5 0 0 20 0 1 0 407917340 63070208 9318 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15398 9318 655 277 0 8919 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 61592 KiB
Current children cumulated memory: 37272 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25413
/proc/meminfo: memFree=24741180/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61732 memory=37576 CPUtime=25.49 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 22826 0 0 0 2540 9 0 0 20 0 1 0 407917340 63213568 9394 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15433 9394 655 277 0 8954 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 61732 KiB
Current children cumulated memory: 37576 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25413
/proc/meminfo: memFree=24740008/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61732 memory=37604 CPUtime=51.09 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 25651 0 0 0 5094 15 0 0 20 0 1 0 407917340 63213568 9401 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15433 9401 655 277 0 8954 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 61732 KiB
Current children cumulated memory: 37604 KiB

[startup+102.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/197 25417
/proc/meminfo: memFree=24739856/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61864 memory=37868 CPUtime=102.27 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 26302 0 0 0 10198 29 0 0 20 0 1 0 407917340 63348736 9467 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15466 9467 655 277 0 8987 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 61864 KiB
Current children cumulated memory: 37868 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/197 25423
/proc/meminfo: memFree=24739232/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61996 memory=37952 CPUtime=162.28 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 26928 0 0 0 16180 48 0 0 20 0 1 0 407917340 63483904 9488 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15499 9488 655 277 0 9020 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 61996 KiB
Current children cumulated memory: 37952 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/197 25427
/proc/meminfo: memFree=24739096/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=61996 memory=38412 CPUtime=222.27 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 27558 0 0 0 22162 65 0 0 20 0 1 0 407917340 63483904 9603 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15499 9603 657 277 0 9020 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 61996 KiB
Current children cumulated memory: 38412 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/197 25431
/proc/meminfo: memFree=24739156/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62128 memory=38416 CPUtime=282.28 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 27998 0 0 0 28144 84 0 0 20 0 1 0 407917340 63619072 9604 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15532 9604 657 277 0 9053 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 62128 KiB
Current children cumulated memory: 38416 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/197 25437
/proc/meminfo: memFree=24738912/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62128 memory=38468 CPUtime=342.27 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 28416 0 0 0 34124 103 0 0 20 0 1 0 407917340 63619072 9617 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15532 9617 657 277 0 9053 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 62128 KiB
Current children cumulated memory: 38468 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/197 25441
/proc/meminfo: memFree=24738788/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62264 memory=38608 CPUtime=402.27 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 28893 0 0 0 40104 123 0 0 20 0 1 0 407917340 63758336 9652 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15566 9652 657 277 0 9087 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 62264 KiB
Current children cumulated memory: 38608 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25445
/proc/meminfo: memFree=24738696/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62264 memory=38624 CPUtime=462.27 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 29331 0 0 0 46091 136 0 0 20 0 1 0 407917340 63758336 9656 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15566 9656 657 277 0 9087 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 62264 KiB
Current children cumulated memory: 38624 KiB


################
# More data... #
################

/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1662.25 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25561
/proc/meminfo: memFree=24737600/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=1722.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 38735 0 0 0 171717 507 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25567
/proc/meminfo: memFree=24737492/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=1782.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 39202 0 0 0 177703 521 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25578
/proc/meminfo: memFree=24737260/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=1842.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 39665 0 0 0 183689 535 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25604
/proc/meminfo: memFree=24737128/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=1902.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 40128 0 0 0 189676 548 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163257852423 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25610
/proc/meminfo: memFree=24736828/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=1962.23 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 40596 0 0 0 195661 562 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25614
/proc/meminfo: memFree=24736648/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2022.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 41061 0 0 0 201645 579 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2022.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25618
/proc/meminfo: memFree=24736624/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2082.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 41526 0 0 0 207629 595 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25624
/proc/meminfo: memFree=24736492/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2142.23 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 41992 0 0 0 213615 608 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2142.23 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/197 25628
/proc/meminfo: memFree=24736904/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2202.24 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 42451 0 0 0 219603 621 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/197 25632
/proc/meminfo: memFree=24737612/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2262.23 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 42913 0 0 0 225588 635 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163257852400 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2262.23 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25638
/proc/meminfo: memFree=24737296/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38788 CPUtime=2322.23 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 43372 0 0 0 231573 650 0 0 20 0 1 0 407917340 63901696 9697 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9697 657 277 0 9122 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38788 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25642
/proc/meminfo: memFree=24737440/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38820 CPUtime=2382.23 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 43853 0 0 0 237554 669 0 0 20 0 1 0 407917340 63901696 9705 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9705 660 277 0 9122 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38820 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25642
/proc/meminfo: memFree=24737256/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38820 CPUtime=2400.03 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 44294 0 0 0 239327 676 0 0 20 0 1 0 407917340 63901696 9705 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9705 660 277 0 9122 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38820 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 25398 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2393.28 s, system=6.76985 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.00 2.01 2.05 3/197 25642
/proc/meminfo: memFree=24737256/32770624 swapFree=66901264/67108860
[pid=25398] ppid=25394 vsize=62404 memory=38820 CPUtime=2400.03 cores=1,3,5,7
/proc/25398/stat : 25398 (miniBTD) R 25394 25398 23586 0 -1 4202496 44294 0 0 0 239327 676 0 0 20 0 1 0 407917340 63901696 9705 33554432000 4194304 5326806 140732509347184 140732509346392 140163248669052 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7427920 7432256 19472384 140732509352992 140732509353072 140732509353072 140732509355981 0
/proc/25398/statm: 15601 9705 660 277 0 9122 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 62404 KiB
Current children cumulated memory: 38820 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.11
CPU time (s): 2400.05
CPU user time (s): 2393.28
CPU system time (s): 6.76985
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 62404
Max. memory (cumulated for all children) (KiB): 38820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2393.28
system time used= 6.76985
maximum resident set size= 38820
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 44294
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 645


# summary of solver processes directly reported to runsolver:
#   pid: 25398
#   total CPU time (s): 2400.05
#   total CPU user time (s): 2393.28
#   total CPU system time (s): 6.76985

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.56627 second user time and 16.637 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-12 21:29:59
IDJOB=4391820
IDBENCH=134823
IDSOLVER=2836
FILE ID=node139/4391820-1568316497
RUNJOBID= node139-1568306093-23618
PBS_JOBID= 21701118
Free space on /tmp= 55336 MiB

SOLVER NAME= miniBTD 19.06.16
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-spba/Pb-BeauxArts-K80.xml
COMMAND LINE= miniBTD TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391820-1568316497/watcher-4391820-1568316497 -o /tmp/evaluation-result-4391820-1568316497/solver-4391820-1568316497 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568306093-23618 --watchdog 2560  miniBTD 2400 HOME/instance-4391820-1568316497.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 330870ed9e83d00984bc877f52c977b4
RANDOM SEED=522983082

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24805264 kB
MemAvailable:   31757908 kB
Buffers:          113928 kB
Cached:          7001876 kB
SwapCached:       105664 kB
Active:           680080 kB
Inactive:        6544136 kB
Active(anon):       4140 kB
Inactive(anon):   145092 kB
Active(file):     675940 kB
Inactive(file):  6399044 kB
Unevictable:      108960 kB
Mlocked:          108960 kB
SwapTotal:      67108860 kB
SwapFree:       66901264 kB
Dirty:             16112 kB
Writeback:             0 kB
AnonPages:        120836 kB
Mapped:            42384 kB
Shmem:             32204 kB
Slab:             336312 kB
SReclaimable:     306120 kB
SUnreclaim:        30192 kB
KernelStack:        3520 kB
PageTables:         5208 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     492272 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     75776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 55320 MiB
End job on node139 at 2019-09-12 22:09:59