Trace number 4293741

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
BTD 2018.06.11_3? (TO) 2519.89 2520.01

General information on the benchmark

NamePseudoBoolean-dec/
Pb-robin16_c18.xml
MD5SUM5947b7d603c6960c1f689b2eabbe33a0
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables14400
Number of constraints1088
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":14400}]
Minimum variable degree10
Maximum variable degree10
Distribution of variable degrees[{"degree":10,"count":14400}]
Minimum constraint arity120
Maximum constraint arity225
Distribution of constraint arities[{"arity":120,"count":960},{"arity":225,"count":128}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":1088}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.06.11_3

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14902 MiB free)
  memory of node 1: 16384 MiB (11881 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293741-1532354697/watcher-4293741-1532354697 -o /tmp/evaluation-result-4293741-1532354697/solver-4293741-1532354697 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532329499-11625 --watchdog 2580 BTD 3 2520 HOME/instance-4293741-1532354697.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=15660, runsolver pid=15657

[startup+0.100153 s]*
/proc/loadavg: 2.07 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27411932/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=47116 memory=16584 CPUtime=0.1 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 4466 0 0 0 10 0 0 0 20 0 1 0 53032944 48246784 4146 33554432000 4194304 36388972 140736554579024 140736554579024 4212798 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 11779 4146 443 7861 0 3883 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 47116 KiB
Current children cumulated memory: 16584 KiB

[startup+0.209717 s]*
/proc/loadavg: 2.07 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27411240/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=47380 memory=17112 CPUtime=0.21 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 4555 0 0 0 21 0 0 0 20 0 1 0 53032944 48517120 4278 33554432000 4194304 36388972 140736554579024 140736554579024 4212729 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 11845 4278 443 7861 0 3949 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 47380 KiB
Current children cumulated memory: 17112 KiB

[startup+0.308861 s]*
/proc/loadavg: 2.07 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27410868/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=47644 memory=17376 CPUtime=0.3 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 4611 0 0 0 30 0 0 0 20 0 1 0 53032944 48787456 4344 33554432000 4194304 36388972 140736554579024 140736554579024 7752720 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 11911 4344 443 7861 0 4015 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 47644 KiB
Current children cumulated memory: 17376 KiB

[startup+0.700273 s]
/proc/loadavg: 2.07 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27410868/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=48304 memory=17904 CPUtime=0.69 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 4768 0 0 0 69 0 0 0 20 0 1 0 53032944 49463296 4476 33554432000 4194304 36388972 140736554579024 140736554579024 4212712 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 12076 4476 443 7861 0 4180 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 48304 KiB
Current children cumulated memory: 17904 KiB

[startup+1.50027 s]
/proc/loadavg: 2.07 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27410124/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=49096 memory=18696 CPUtime=1.49 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 4975 0 0 0 149 0 0 0 20 0 1 0 53032944 50274304 4674 33554432000 4194304 36388972 140736554579024 140736554579024 4212812 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 12274 4674 443 7861 0 4378 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 49096 KiB
Current children cumulated memory: 18696 KiB

[startup+3.1092 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 15661
/proc/meminfo: memFree=27407520/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=51604 memory=21160 CPUtime=3.09 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 8879 0 0 0 309 0 0 0 20 0 1 0 53032944 52842496 5290 33554432000 4194304 36388972 140736554579024 140736554573048 4212725 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 12901 5290 443 7861 0 5005 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 51604 KiB
Current children cumulated memory: 21160 KiB

[startup+6.30026 s]
/proc/loadavg: 2.06 2.03 2.05 3/187 15661
/proc/meminfo: memFree=27401352/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=57148 memory=26928 CPUtime=6.29 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 11550 0 0 0 628 1 0 0 20 0 1 0 53032944 58519552 6732 33554432000 4194304 36388972 140736554579024 140736554573048 4212725 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 14287 6732 443 7861 0 6391 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 57148 KiB
Current children cumulated memory: 26928 KiB

[startup+12.7002 s]
/proc/loadavg: 1.97 2.01 2.04 3/187 15722
/proc/meminfo: memFree=27399596/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=67840 memory=37580 CPUtime=12.69 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 16504 0 0 0 1267 2 0 0 20 0 1 0 53032944 69468160 9395 33554432000 4194304 36388972 140736554579024 140736554572456 4212798 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 16960 9395 446 7861 0 9064 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 67840 KiB
Current children cumulated memory: 37580 KiB

[startup+25.5004 s]
/proc/loadavg: 1.98 2.01 2.04 3/187 15722
/proc/meminfo: memFree=26980352/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=484612 memory=453872 CPUtime=25.48 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 125085 0 0 0 2532 16 0 0 20 0 1 0 53032944 496242688 113468 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 121153 113468 498 7861 0 113257 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 484612 KiB
Current children cumulated memory: 453872 KiB

[startup+51.1095 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 15783
/proc/meminfo: memFree=26925000/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=488052 memory=457276 CPUtime=51.09 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 126446 0 0 0 5089 20 0 0 20 0 1 0 53032944 499765248 114319 33554432000 4194304 36388972 140736554579024 140736554577864 4658325 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122013 114319 502 7861 0 114117 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 488052 KiB
Current children cumulated memory: 457276 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 15784
/proc/meminfo: memFree=26922128/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=488744 memory=458116 CPUtime=102.27 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 127967 0 0 0 10203 24 0 0 20 0 1 0 53032944 500473856 114529 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122186 114529 502 7861 0 114290 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 488744 KiB
Current children cumulated memory: 458116 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 15785
/proc/meminfo: memFree=26920964/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=489604 memory=458892 CPUtime=162.27 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 129620 0 0 0 16197 30 0 0 20 0 1 0 53032944 501354496 114723 33554432000 4194304 36388972 140736554579024 140736554577864 4658409 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122401 114723 502 7861 0 114505 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 489604 KiB
Current children cumulated memory: 458892 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 15786
/proc/meminfo: memFree=26919124/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=489972 memory=459376 CPUtime=222.27 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 131224 0 0 0 22190 37 0 0 20 0 1 0 53032944 501731328 114844 33554432000 4194304 36388972 140736554579024 140736554577864 4658343 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122493 114844 502 7861 0 114597 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 489972 KiB
Current children cumulated memory: 459376 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 15787
/proc/meminfo: memFree=26917936/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=490284 memory=460164 CPUtime=282.27 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 132716 0 0 0 28184 43 0 0 20 0 1 0 53032944 502050816 115041 33554432000 4194304 36388972 140736554579024 140736554577864 4658343 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122571 115041 502 7861 0 114675 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 490284 KiB
Current children cumulated memory: 460164 KiB

[startup+342.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 15795
/proc/meminfo: memFree=26914636/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=490624 memory=460660 CPUtime=342.26 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 133108 0 0 0 34178 48 0 0 20 0 1 0 53032944 502398976 115165 33554432000 4194304 36388972 140736554579024 140736554577864 4658343 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122656 115165 502 7861 0 114760 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 490624 KiB
Current children cumulated memory: 460660 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 15796
/proc/meminfo: memFree=26915384/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=491088 memory=461016 CPUtime=402.26 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 133570 0 0 0 40171 55 0 0 20 0 1 0 53032944 502874112 115254 33554432000 4194304 36388972 140736554579024 140736554577864 8047815 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 122772 115254 502 7861 0 114876 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 491088 KiB
Current children cumulated memory: 461016 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 15797
/proc/meminfo: memFree=26914900/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=492144 memory=461956 CPUtime=462.26 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 134204 0 0 0 46165 61 0 0 20 0 1 0 53032944 503955456 115489 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 123036 115489 502 7861 0 115140 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 492144 KiB
Current children cumulated memory: 461956 KiB


################
# More data... #
################

/proc/15660/statm: 125048 117517 502 7861 0 117152 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 500192 KiB
Current children cumulated memory: 470068 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 15837
/proc/meminfo: memFree=26905172/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=500192 memory=470160 CPUtime=1782.2 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 142915 0 0 0 178037 183 0 0 20 0 1 0 53032944 512196608 117540 33554432000 4194304 36388972 140736554579024 140736554577864 4427942 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125048 117540 502 7861 0 117152 0
Current children cumulated CPU time: 1782.2 s
Current children cumulated vsize: 500192 KiB
Current children cumulated memory: 470160 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15838
/proc/meminfo: memFree=26904076/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=501216 memory=471260 CPUtime=1842.2 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 143453 0 0 0 184032 188 0 0 20 0 1 0 53032944 513245184 117815 33554432000 4194304 36388972 140736554579024 140736554577864 4429276 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125304 117815 502 7861 0 117408 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 501216 KiB
Current children cumulated memory: 471260 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15839
/proc/meminfo: memFree=26903212/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=501784 memory=471788 CPUtime=1902.2 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 143863 0 0 0 190026 194 0 0 20 0 1 0 53032944 513826816 117947 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125446 117947 502 7861 0 117550 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 501784 KiB
Current children cumulated memory: 471788 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15840
/proc/meminfo: memFree=26902348/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=502368 memory=472300 CPUtime=1962.19 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 144278 0 0 0 196018 201 0 0 20 0 1 0 53032944 514424832 118075 33554432000 4194304 36388972 140736554579024 140736554577864 8047815 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125592 118075 502 7861 0 117696 0
Current children cumulated CPU time: 1962.19 s
Current children cumulated vsize: 502368 KiB
Current children cumulated memory: 472300 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 15841
/proc/meminfo: memFree=26902228/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=502368 memory=472300 CPUtime=2022.2 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 144425 0 0 0 202011 209 0 0 20 0 1 0 53032944 514424832 118075 33554432000 4194304 36388972 140736554579024 140736554577864 4427873 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125592 118075 502 7861 0 117696 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 502368 KiB
Current children cumulated memory: 472300 KiB

[startup+2082.3 s]
/proc/loadavg: 2.44 2.16 2.09 3/187 15842
/proc/meminfo: memFree=26902108/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=502524 memory=472560 CPUtime=2082.19 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 144782 0 0 0 208005 214 0 0 20 0 1 0 53032944 514584576 118140 33554432000 4194304 36388972 140736554579024 140736554577864 6663840 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125631 118140 502 7861 0 117735 0
Current children cumulated CPU time: 2082.19 s
Current children cumulated vsize: 502524 KiB
Current children cumulated memory: 472560 KiB

[startup+2142.3 s]
/proc/loadavg: 2.16 2.13 2.09 3/188 15851
/proc/meminfo: memFree=26900512/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=503284 memory=473288 CPUtime=2142.19 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 145187 0 0 0 213999 220 0 0 20 0 1 0 53032944 515362816 118322 33554432000 4194304 36388972 140736554579024 140736554577864 4658325 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125821 118322 502 7861 0 117925 0
Current children cumulated CPU time: 2142.19 s
Current children cumulated vsize: 503284 KiB
Current children cumulated memory: 473288 KiB

[startup+2202.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/188 15852
/proc/meminfo: memFree=26900384/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=503284 memory=473296 CPUtime=2202.18 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 145399 0 0 0 219993 225 0 0 20 0 1 0 53032944 515362816 118324 33554432000 4194304 36388972 140736554579024 140736554577864 8047815 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 125821 118324 502 7861 0 117925 0
Current children cumulated CPU time: 2202.18 s
Current children cumulated vsize: 503284 KiB
Current children cumulated memory: 473296 KiB

[startup+2262.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/188 15853
/proc/meminfo: memFree=26899396/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504148 memory=474080 CPUtime=2262.18 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 145835 0 0 0 225986 232 0 0 20 0 1 0 53032944 516247552 118520 33554432000 4194304 36388972 140736554579024 140736554577864 8047815 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126037 118520 502 7861 0 118141 0
Current children cumulated CPU time: 2262.18 s
Current children cumulated vsize: 504148 KiB
Current children cumulated memory: 474080 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/188 15854
/proc/meminfo: memFree=26899276/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504468 memory=474364 CPUtime=2322.18 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 146093 0 0 0 231979 239 0 0 20 0 1 0 53032944 516575232 118591 33554432000 4194304 36388972 140736554579024 140736554577864 4658372 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126117 118591 502 7861 0 118221 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 504468 KiB
Current children cumulated memory: 474364 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/188 15855
/proc/meminfo: memFree=26899476/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504468 memory=474400 CPUtime=2382.18 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 146236 0 0 0 237973 245 0 0 20 0 1 0 53032944 516575232 118600 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126117 118600 502 7861 0 118221 0
Current children cumulated CPU time: 2382.18 s
Current children cumulated vsize: 504468 KiB
Current children cumulated memory: 474400 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 15856
/proc/meminfo: memFree=26899372/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504604 memory=474536 CPUtime=2442.17 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 146473 0 0 0 243967 250 0 0 20 0 1 0 53032944 516714496 118634 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126151 118634 502 7861 0 118255 0
Current children cumulated CPU time: 2442.17 s
Current children cumulated vsize: 504604 KiB
Current children cumulated memory: 474536 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 15857
/proc/meminfo: memFree=26899004/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504604 memory=474536 CPUtime=2502.17 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 146633 0 0 0 249962 255 0 0 20 0 1 0 53032944 516714496 118634 33554432000 4194304 36388972 140736554579024 140736554577864 4424678 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126151 118634 502 7861 0 118255 0
Current children cumulated CPU time: 2502.17 s
Current children cumulated vsize: 504604 KiB
Current children cumulated memory: 474536 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.04 2.05 3/187 15857
/proc/meminfo: memFree=26899132/32770624 swapFree=67108860/67108860
[pid=15660] ppid=15657 vsize=504604 memory=474536 CPUtime=2519.88 cores=1,3,5,7
/proc/15660/stat : 15660 (BTD) R 15657 15660 11593 0 -1 4202496 146633 0 0 0 251731 257 0 0 20 0 1 0 53032944 516714496 118634 33554432000 4194304 36388972 140736554579024 140736554577864 4658323 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 42188800 140736554587325 140736554587403 140736554587403 140736554590161 0
/proc/15660/statm: 126151 118634 502 7861 0 118255 0
Current children cumulated CPU time: 2519.88 s
Current children cumulated vsize: 504604 KiB
Current children cumulated memory: 474536 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 15660 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.32 s, system=2.57489 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.89
CPU user time (s): 2517.32
CPU system time (s): 2.57489
CPU usage (%): 99.9953
Max. virtual memory (cumulated for all children) (KiB): 504604
Max. memory (cumulated for all children) (KiB): 474536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.32
system time used= 2.57489
maximum resident set size= 474536
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 146633
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 797


# summary of solver processes directly reported to runsolver:
#   pid: 15660
#   total CPU time (s): 2519.89
#   total CPU user time (s): 2517.32
#   total CPU system time (s): 2.57489

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.5774 second user time and 17.1159 second system time

The end

Launcher Data 

Begin job on node151 at 2018-07-23 16:04:57
IDJOB=4293741
IDBENCH=141231
IDSOLVER=2749
FILE ID=node151/4293741-1532354697
RUNJOBID= node151-1532329499-11625
PBS_JOBID= 21018998
Free space on /tmp= 55020 MiB

SOLVER NAME= BTD 2018.06.11_3
BENCH NAME= XCSP18/PseudoBoolean-dec/Pb-robin16_c18.xml
COMMAND LINE= BTD 3 TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293741-1532354697/watcher-4293741-1532354697 -o /tmp/evaluation-result-4293741-1532354697/solver-4293741-1532354697 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532329499-11625 --watchdog 2580  BTD 3 2520 HOME/instance-4293741-1532354697.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5947b7d603c6960c1f689b2eabbe33a0
RANDOM SEED=80228259

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27427060 kB
MemAvailable:   31921420 kB
Buffers:          134376 kB
Cached:          4601904 kB
SwapCached:            0 kB
Active:          1013020 kB
Inactive:        3813244 kB
Active(anon):      40528 kB
Inactive(anon):    69272 kB
Active(file):     972492 kB
Inactive(file):  3743972 kB
Unevictable:        7888 kB
Mlocked:            7888 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             53556 kB
Writeback:             0 kB
AnonPages:        114336 kB
Mapped:            39464 kB
Shmem:             17032 kB
Slab:             214756 kB
SReclaimable:     187460 kB
SUnreclaim:        27296 kB
KernelStack:        3376 kB
PageTables:         4912 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     379868 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     57344 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 54968 MiB
End job on node151 at 2018-07-23 16:46:58