Trace number 4407814

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.08 2400.42

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n150/
TravellingSalesman-150-50-00.xml
MD5SUM784274e168c99e425b71be44c62c6ab3
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark1424
Best CPU time to get the best result obtained on this benchmark2400.03
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints151
Number of domains2
Minimum domain size66
Maximum domain size150
Distribution of domain sizes[{"size":66,"count":150},{"size":150,"count":150}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":150},{"degree":3,"count":150}]
Minimum constraint arity3
Maximum constraint arity150
Distribution of constraint arities[{"arity":3,"count":150},{"arity":150,"count":1}]
Number of extensional constraints150
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":150},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

111.10/111.18	c xcsp_picat version 2.7b12 (9/12/2019)
255.68/255.77	o 3399

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15318 MiB free)
  memory of node 1: 16384 MiB (15754 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407814-1569512977/watcher-4407814-1569512977 -o /var/tmp/evaluation-result-4407814-1569512977/solver-4407814-1569512977 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node149-1569509603-12794 --watchdog 2560 xcsp_picat HOME/instance-4407814-1569512977.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=13641, runsolver pid=13638

[startup+0.100168 s]*
/proc/loadavg: 2.00 1.99 1.95 3/199 13642
/proc/meminfo: memFree=31801792/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=22648 CPUtime=0.1 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1245 0 0 0 10 0 0 0 20 0 1 0 527536293 2080477184 5662 33554432000 4194304 5870510 140728724366784 140728724363928 4491109 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 5662 837 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 22648 KiB

[startup+0.209614 s]*
/proc/loadavg: 2.00 1.99 1.95 3/199 13642
/proc/meminfo: memFree=31789504/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=32888 CPUtime=0.21 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1250 0 0 0 21 0 0 0 20 0 1 0 527536293 2080477184 8222 33554432000 4194304 5870510 140728724366784 140728724363928 4569615 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 8222 837 410 0 503402 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 32888 KiB

[startup+0.309529 s]*
/proc/loadavg: 2.00 1.99 1.95 3/199 13642
/proc/meminfo: memFree=31779264/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=43128 CPUtime=0.31 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1255 0 0 0 31 0 0 0 20 0 1 0 527536293 2080477184 10782 33554432000 4194304 5870510 140728724366784 140728724363928 4459735 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 10782 837 410 0 503402 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 43128 KiB

[startup+0.700378 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 13642
/proc/meminfo: memFree=31758784/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=82040 CPUtime=0.69 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1274 0 0 0 68 1 0 0 20 0 1 0 527536293 2080477184 20510 33554432000 4194304 5870510 140728724366784 140728724363928 4522991 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 20510 837 410 0 503402 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 82040 KiB

[startup+1.50037 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 13642
/proc/meminfo: memFree=31709708/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=164072 CPUtime=1.49 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1314 0 0 0 147 2 0 0 20 0 1 0 527536293 2080477184 41018 33554432000 4194304 5870510 140728724366784 140728724366088 4459637 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 41018 841 410 0 503402 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 164072 KiB

[startup+3.10929 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 13644
/proc/meminfo: memFree=31311108/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=534936 CPUtime=3.1 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 1590 0 0 0 303 7 0 0 20 0 1 0 527536293 2080477184 133734 33554432000 4194304 5870510 140728724366784 140728724366088 4466548 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 133734 880 410 0 503402 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 534936 KiB

[startup+6.30036 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 13644
/proc/meminfo: memFree=30568336/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=2031716 memory=1325464 CPUtime=6.29 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2038 0 0 0 611 18 0 0 20 0 1 0 527536293 2080477184 331366 33554432000 4194304 5870510 140728724366784 140728724366088 4461503 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 507929 331366 880 410 0 503402 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 1325464 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 13644
/proc/meminfo: memFree=29465744/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3537572 memory=2352540 CPUtime=12.69 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 39604 0 0 0 1232 37 0 0 20 0 1 0 527536293 3622473728 588135 33554432000 4194304 5870510 140728724366784 140728724365352 5337610 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 884393 588135 955 410 0 879866 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 3537572 KiB
Current children cumulated memory: 2352540 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 13644
/proc/meminfo: memFree=29465464/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3537572 memory=2352540 CPUtime=25.49 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 39605 0 0 0 2512 37 0 0 20 0 1 0 527536293 3622473728 588135 33554432000 4194304 5870510 140728724366784 140728724365960 5337600 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 884393 588135 955 410 0 879866 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 3537572 KiB
Current children cumulated memory: 2352540 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 13647
/proc/meminfo: memFree=29465288/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3537572 memory=2352548 CPUtime=51.1 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 50422 0 0 0 5073 37 0 0 20 0 1 0 527536293 3622473728 588137 33554432000 4194304 5870510 140728724366784 140728724365960 5337600 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 884393 588137 957 410 0 879866 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 3537572 KiB
Current children cumulated memory: 2352548 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 13659
/proc/meminfo: memFree=29476408/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3516808 memory=2324852 CPUtime=102.28 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 92641 0 0 0 10188 40 0 0 20 0 1 0 527536293 3601211392 581213 33554432000 4194304 5870510 140728724366784 140728724366040 5282568 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 879202 581213 971 410 0 874675 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 3516808 KiB
Current children cumulated memory: 2324852 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 13663
/proc/meminfo: memFree=29447448/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3537568 memory=2353052 CPUtime=162.29 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 169298 0 0 0 16153 76 0 0 20 0 1 0 527536293 3622469632 588263 33554432000 4194304 5870510 140728724366784 140728724365960 5337497 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 884392 588263 988 410 0 879865 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 3537568 KiB
Current children cumulated memory: 2353052 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 13667
/proc/meminfo: memFree=29447412/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3537568 memory=2353052 CPUtime=222.28 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 187056 0 0 0 22152 76 0 0 20 0 1 0 527536293 3622469632 588263 33554432000 4194304 5870510 140728724366784 140728724365960 5337497 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 884392 588263 988 410 0 879865 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 3537568 KiB
Current children cumulated memory: 2353052 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 13673
/proc/meminfo: memFree=29411604/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3618956 memory=2389816 CPUtime=282.29 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 250312 0 0 0 28132 97 0 0 20 0 1 0 527536293 3705810944 597454 33554432000 4194304 5870510 140728724366784 140728724365736 5276639 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 904739 597454 988 410 0 900212 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 3618956 KiB
Current children cumulated memory: 2389816 KiB

[startup+342.3 s]
/proc/loadavg: 2.45 2.12 2.00 3/201 13677
/proc/meminfo: memFree=29398992/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3749184 memory=2412808 CPUtime=342.28 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 394645 0 0 0 34090 138 0 0 20 0 1 0 527536293 3839164416 603202 33554432000 4194304 5870510 140728724366784 140728724365736 5305243 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 937296 603202 988 410 0 932769 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 3749184 KiB
Current children cumulated memory: 2412808 KiB

[startup+402.3 s]
/proc/loadavg: 2.61 2.22 2.05 3/199 13682
/proc/meminfo: memFree=29419376/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3628796 memory=2381796 CPUtime=402.27 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 555289 0 0 0 40045 182 0 0 20 0 1 0 527536293 3715887104 595449 33554432000 4194304 5870510 140728724366784 140728724365144 5282586 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 907199 595449 988 410 0 902672 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 3628796 KiB
Current children cumulated memory: 2381796 KiB

[startup+462.3 s]
/proc/loadavg: 2.22 2.18 2.05 3/199 13688
/proc/meminfo: memFree=29371360/32770624 swapFree=66951984/67108860
[pid=13641] ppid=13638 vsize=3774652 memory=2467552 CPUtime=462.26 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 669949 0 0 0 46002 224 0 0 20 0 1 0 527536293 3865243648 616888 33554432000 4194304 5870510 140728724366784 140728724365144 5305048 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 943663 616888 988 410 0 939136 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 3774652 KiB
Current children cumulated memory: 2467552 KiB


################
# More data... #
################

/proc/13641/statm: 971741 660568 988 410 0 967214 0
Current children cumulated CPU time: 1602.08 s
Current children cumulated vsize: 3886964 KiB
Current children cumulated memory: 2642272 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 14133
/proc/meminfo: memFree=27316800/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3888160 memory=2608580 CPUtime=1662.07 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2145944 0 0 0 165307 900 0 0 20 0 1 0 527536293 3981475840 652145 33554432000 4194304 5870510 140728724366784 140728724365800 5282721 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 972040 652145 988 410 0 967513 0
Current children cumulated CPU time: 1662.07 s
Current children cumulated vsize: 3888160 KiB
Current children cumulated memory: 2608580 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 14139
/proc/meminfo: memFree=27229824/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3890944 memory=2727540 CPUtime=1722.06 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2206763 0 0 0 171283 923 0 0 20 0 1 0 527536293 3984326656 681885 33554432000 4194304 5870510 140728724366784 140728724365144 5274526 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 972736 681885 988 410 0 968209 0
Current children cumulated CPU time: 1722.06 s
Current children cumulated vsize: 3890944 KiB
Current children cumulated memory: 2727540 KiB

[startup+1782.3 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 14143
/proc/meminfo: memFree=27284728/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3893040 memory=2658072 CPUtime=1782.06 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2240813 0 0 0 177262 944 0 0 20 0 1 0 527536293 3986472960 664518 33554432000 4194304 5870510 140728724366784 140728724365144 5282736 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 973260 664518 988 410 0 968733 0
Current children cumulated CPU time: 1782.06 s
Current children cumulated vsize: 3893040 KiB
Current children cumulated memory: 2658072 KiB

[startup+1842.3 s]
/proc/loadavg: 1.97 2.00 2.04 3/199 14147
/proc/meminfo: memFree=27313376/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3895064 memory=2620868 CPUtime=1842.05 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2381330 0 0 0 183237 968 0 0 20 0 1 0 527536293 3988545536 655217 33554432000 4194304 5870510 140728724366784 140728724365800 5282747 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 973766 655217 988 410 0 969239 0
Current children cumulated CPU time: 1842.05 s
Current children cumulated vsize: 3895064 KiB
Current children cumulated memory: 2620868 KiB

[startup+1902.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 14161
/proc/meminfo: memFree=27337744/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3764508 memory=2601992 CPUtime=1902.03 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2464341 0 0 0 189214 989 0 0 20 0 1 0 527536293 3854856192 650498 33554432000 4194304 5870510 140728724366784 140728724365800 5282759 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 941127 650498 988 410 0 936600 0
Current children cumulated CPU time: 1902.03 s
Current children cumulated vsize: 3764508 KiB
Current children cumulated memory: 2601992 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 14165
/proc/meminfo: memFree=27375392/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3764508 memory=2556156 CPUtime=1962.02 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2582864 0 0 0 195183 1019 0 0 20 0 1 0 527536293 3854856192 639039 33554432000 4194304 5870510 140728724366784 140728724365736 5262902 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 941127 639039 988 410 0 936600 0
Current children cumulated CPU time: 1962.02 s
Current children cumulated vsize: 3764508 KiB
Current children cumulated memory: 2556156 KiB

[startup+2022.3 s]
/proc/loadavg: 2.04 2.01 2.05 3/200 14169
/proc/meminfo: memFree=27362668/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3770720 memory=2579388 CPUtime=2022.01 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2681102 0 0 0 201143 1058 0 0 20 0 1 0 527536293 3861217280 644847 33554432000 4194304 5870510 140728724366784 140728724365144 5283133 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 942680 644847 988 410 0 938153 0
Current children cumulated CPU time: 2022.01 s
Current children cumulated vsize: 3770720 KiB
Current children cumulated memory: 2579388 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/200 14175
/proc/meminfo: memFree=27390224/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3692332 memory=2537972 CPUtime=2082 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2783647 0 0 0 207102 1098 0 0 20 0 1 0 527536293 3780947968 634493 33554432000 4194304 5870510 140728724366784 140728724365800 5262951 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 923083 634493 988 410 0 918556 0
Current children cumulated CPU time: 2082 s
Current children cumulated vsize: 3692332 KiB
Current children cumulated memory: 2537972 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/200 14179
/proc/meminfo: memFree=27407444/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3704760 memory=2542456 CPUtime=2142 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2879499 0 0 0 213071 1129 0 0 20 0 1 0 527536293 3793674240 635614 33554432000 4194304 5870510 140728724366784 140728724365736 5282505 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 926190 635614 988 410 0 921663 0
Current children cumulated CPU time: 2142 s
Current children cumulated vsize: 3704760 KiB
Current children cumulated memory: 2542456 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14184
/proc/meminfo: memFree=27348152/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3786148 memory=2590904 CPUtime=2201.99 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 2974545 0 0 0 219034 1165 0 0 20 0 1 0 527536293 3877015552 647726 33554432000 4194304 5870510 140728724366784 140728724365800 5283133 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 946537 647726 988 410 0 942010 0
Current children cumulated CPU time: 2201.99 s
Current children cumulated vsize: 3786148 KiB
Current children cumulated memory: 2590904 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14190
/proc/meminfo: memFree=27312840/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3786148 memory=2619928 CPUtime=2261.98 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 3106738 0 0 0 225003 1195 0 0 20 0 1 0 527536293 3877015552 654982 33554432000 4194304 5870510 140728724366784 140728724365736 5262639 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 946537 654982 988 410 0 942010 0
Current children cumulated CPU time: 2261.98 s
Current children cumulated vsize: 3786148 KiB
Current children cumulated memory: 2619928 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14194
/proc/meminfo: memFree=27347568/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3788400 memory=2579496 CPUtime=2321.96 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 3231383 0 0 0 230974 1222 0 0 20 0 1 0 527536293 3879321600 644874 33554432000 4194304 5870510 140728724366784 140728724365736 5281827 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 947100 644874 988 410 0 942573 0
Current children cumulated CPU time: 2321.96 s
Current children cumulated vsize: 3788400 KiB
Current children cumulated memory: 2579496 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14199
/proc/meminfo: memFree=27371680/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3792588 memory=2565140 CPUtime=2381.96 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 3337616 0 0 0 236932 1264 0 0 20 0 1 0 527536293 3883610112 641285 33554432000 4194304 5870510 140728724366784 140728724365800 5282251 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 948147 641285 988 410 0 943620 0
Current children cumulated CPU time: 2381.96 s
Current children cumulated vsize: 3792588 KiB
Current children cumulated memory: 2565140 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.4 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 14202
/proc/meminfo: memFree=27306676/32770624 swapFree=66951988/67108860
[pid=13641] ppid=13638 vsize=3795896 memory=2618092 CPUtime=2400.05 cores=1,3,5,7
/proc/13641/stat : 13641 (xcsp_picat) R 13638 13641 12762 0 -1 4202496 3342241 0 0 0 238733 1272 0 0 20 0 1 0 527536293 3886997504 654523 33554432000 4194304 5870510 140728724366784 140728724365144 5282505 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 44437504 140728724374535 140728724374617 140728724374617 140728724377542 0
/proc/13641/statm: 948974 654523 988 410 0 944447 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 3795896 KiB
Current children cumulated memory: 2618092 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.42 s]
# the end of solver process 13641 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2387.34 s, system=12.7434 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.42
CPU time (s): 2400.08
CPU user time (s): 2387.34
CPU system time (s): 12.7434
CPU usage (%): 99.9861
Max. virtual memory (cumulated for all children) (KiB): 4450488
Max. memory (cumulated for all children) (KiB): 2993580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2387.34
system time used= 12.7434
maximum resident set size= 2993580
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3342241
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 63
involuntary context switches= 3061


# summary of solver processes directly reported to runsolver:
#   pid: 13641
#   total CPU time (s): 2400.08
#   total CPU user time (s): 2387.34
#   total CPU system time (s): 12.7434

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.16802 second user time and 17.8126 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-26 17:48:58
IDJOB=4407814
IDBENCH=135796
IDSOLVER=2873
FILE ID=node149/4407814-1569512977
RUNJOBID= node149-1569509603-12794
PBS_JOBID= 21705778
Free space on /var/tmp= 13476 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n150/TravellingSalesman-150-50-00.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407814-1569512977/watcher-4407814-1569512977 -o /var/tmp/evaluation-result-4407814-1569512977/solver-4407814-1569512977 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node149-1569509603-12794 --watchdog 2560  xcsp_picat HOME/instance-4407814-1569512977.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 784274e168c99e425b71be44c62c6ab3
RANDOM SEED=2096772247

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31819372 kB
MemAvailable:   31796868 kB
Buffers:            9336 kB
Cached:           161852 kB
SwapCached:        10984 kB
Active:           173256 kB
Inactive:         123376 kB
Active(anon):     130348 kB
Inactive(anon):    23216 kB
Active(file):      42908 kB
Inactive(file):   100160 kB
Unevictable:      111304 kB
Mlocked:          111304 kB
SwapTotal:      67108860 kB
SwapFree:       66951984 kB
Dirty:              3180 kB
Writeback:             0 kB
AnonPages:        242064 kB
Mapped:            24456 kB
Shmem:             18984 kB
Slab:             247724 kB
SReclaimable:     218344 kB
SUnreclaim:        29380 kB
KernelStack:        3760 kB
PageTables:         5652 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2673800 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    192512 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /var/tmp at the end= 13460 MiB
End job on node149 at 2019-09-26 18:28:59