Trace number 4295472

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2520.05 2520.02

General information on the benchmark

NameTravelingTournament/
TravelingTournament-a3-galaxy12_c18.xml
MD5SUM294b097d449017f2d3f7014537fb5318
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark9651
Best CPU time to get the best result obtained on this benchmark2520.09
Satisfiable
(Un)Satisfiability was proved
Number of variables1068
Number of constraints3635
Number of domains3
Minimum domain size2
Maximum domain size45
Distribution of domain sizes[{"size":2,"count":528},{"size":12,"count":264},{"size":45,"count":276}]
Minimum variable degree2
Maximum variable degree38
Distribution of variable degrees[{"degree":2,"count":540},{"degree":35,"count":240},{"degree":36,"count":264},{"degree":37,"count":22},{"degree":38,"count":2}]
Minimum constraint arity2
Maximum constraint arity22
Distribution of constraint arities[{"arity":2,"count":265},{"arity":3,"count":24},{"arity":4,"count":2520},{"arity":5,"count":252},{"arity":12,"count":286},{"arity":14,"count":264},{"arity":22,"count":24}]
Number of extensional constraints276
Number of intensional constraints2785
Distribution of constraint types[{"type":"extension","count":276},{"type":"intension","count":2785},{"type":"regular","count":12},{"type":"allDifferent","count":22},{"type":"cardinality","count":12},{"type":"element","count":528}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (2865 MiB free)
  memory of node 1: 16384 MiB (9605 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295472-1532555543/watcher-4295472-1532555543 -o /tmp/evaluation-result-4295472-1532555543/solver-4295472-1532555543 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1532542928-25611 --watchdog 2580 xcsp_picat HOME/instance-4295472-1532555543.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=26891, runsolver pid=26888
Current StackSize limit: 8192 KiB


[startup+0.100163 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12742116/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=119504 memory=29468 CPUtime=0.1 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 1388 0 0 0 10 0 0 0 20 0 1 0 73117448 122372096 7367 33554432000 4194304 5849740 140723594977536 140723594977536 4593466 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 29876 7367 630 405 0 26820 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 29468 KiB

[startup+0.209544 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12723096/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=119504 memory=50704 CPUtime=0.2 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 1587 0 0 0 20 0 0 0 20 0 1 0 73117448 122372096 12676 33554432000 4194304 5849740 140723594977536 140723594976840 4454171 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 29876 12676 630 405 0 26820 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 50704 KiB

[startup+0.309764 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12687428/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=119504 memory=67588 CPUtime=0.31 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 1767 0 0 0 30 1 0 0 20 0 1 0 73117448 122372096 16897 33554432000 4194304 5849740 140723594977536 140723594976840 4979699 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 29876 16897 630 405 0 26820 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 67588 KiB

[startup+0.700395 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12616884/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=204472 memory=111924 CPUtime=0.69 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 2622 0 0 0 67 2 0 0 20 0 1 0 73117448 209379328 27981 33554432000 4194304 5849740 140723594977536 140723594976840 4481455 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 51118 27981 635 405 0 48062 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 204472 KiB
Current children cumulated memory: 111924 KiB

[startup+1.50038 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12518580/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=337288 memory=207952 CPUtime=1.49 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 3419 0 0 0 144 5 0 0 20 0 1 0 73117448 345382912 51988 33554432000 4194304 5849740 140723594977536 140723594976840 4505511 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 84322 51988 635 405 0 81266 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 337288 KiB
Current children cumulated memory: 207952 KiB

[startup+3.10963 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12431400/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=406852 memory=323076 CPUtime=3.1 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 7170 0 0 0 302 8 0 0 20 0 1 0 73117448 416616448 80769 33554432000 4194304 5849740 140723594977536 140723594976840 5249600 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 101713 80769 664 405 0 98657 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 406852 KiB
Current children cumulated memory: 323076 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12403580/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=449188 memory=367680 CPUtime=6.29 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 13956 0 0 0 574 55 0 0 20 0 1 0 73117448 459968512 91920 33554432000 4194304 5849740 140723594977536 140723594976696 5606240 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 112297 91920 727 405 0 109241 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 449188 KiB
Current children cumulated memory: 367680 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12310860/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=449188 memory=367680 CPUtime=12.69 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 15239 0 0 0 1210 59 0 0 20 0 1 0 73117448 459968512 91920 33554432000 4194304 5849740 140723594977536 140723594976632 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 112297 91920 727 405 0 109241 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 449188 KiB
Current children cumulated memory: 367680 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26892
/proc/meminfo: memFree=12308032/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=446620 memory=361584 CPUtime=25.49 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 36040 0 0 0 2442 107 0 0 20 0 1 0 73117448 457338880 90396 33554432000 4194304 5849740 140723594977536 140723594976568 5521452 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 111655 90396 769 405 0 108599 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 446620 KiB
Current children cumulated memory: 361584 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26905
/proc/meminfo: memFree=12276692/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=538864 memory=455992 CPUtime=51.1 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 41676 0 0 0 4992 118 0 0 20 0 1 0 73117448 551796736 113998 33554432000 4194304 5849740 140723594977536 140723594976696 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 134716 113998 769 405 0 131660 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 538864 KiB
Current children cumulated memory: 455992 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26906
/proc/meminfo: memFree=12203556/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=542644 memory=459892 CPUtime=102.29 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 68040 0 0 0 10092 137 0 0 20 0 1 0 73117448 555667456 114973 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 135661 114973 769 405 0 132605 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 542644 KiB
Current children cumulated memory: 459892 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26908
/proc/meminfo: memFree=12200088/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=545892 memory=461444 CPUtime=162.3 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 93811 0 0 0 16066 164 0 0 20 0 1 0 73117448 558993408 115361 33554432000 4194304 5849740 140723594977536 140723594976536 5392580 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 136473 115361 769 405 0 133417 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 545892 KiB
Current children cumulated memory: 461444 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26909
/proc/meminfo: memFree=12173088/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=570032 memory=488696 CPUtime=222.3 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 121392 0 0 0 22043 187 0 0 20 0 1 0 73117448 583712768 122174 33554432000 4194304 5849740 140723594977536 140723594976536 5437423 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 142508 122174 769 405 0 139452 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 570032 KiB
Current children cumulated memory: 488696 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26910
/proc/meminfo: memFree=12167084/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=579220 memory=488832 CPUtime=282.3 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 149946 0 0 0 28016 214 0 0 20 0 1 0 73117448 593121280 122208 33554432000 4194304 5849740 140723594977536 140723594976696 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 144805 122208 769 405 0 141749 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 579220 KiB
Current children cumulated memory: 488832 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26912
/proc/meminfo: memFree=12127604/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=609876 memory=527476 CPUtime=342.29 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 172367 0 0 0 33989 240 0 0 20 0 1 0 73117448 624513024 131869 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 152469 131869 769 405 0 149413 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 609876 KiB
Current children cumulated memory: 527476 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26913
/proc/meminfo: memFree=12116828/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=609876 memory=527476 CPUtime=402.29 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 180988 0 0 0 39960 269 0 0 20 0 1 0 73117448 624513024 131869 33554432000 4194304 5849740 140723594977536 140723594976536 5437611 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 152469 131869 769 405 0 149413 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 609876 KiB
Current children cumulated memory: 527476 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26921
/proc/meminfo: memFree=12156740/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=560360 memory=479024 CPUtime=462.29 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 183234 0 0 0 45932 297 0 0 20 0 1 0 73117448 573808640 119756 33554432000 4194304 5849740 140723594977536 140723594976024 4208011 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 140090 119756 769 405 0 137034 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 560360 KiB
Current children cumulated memory: 479024 KiB


################
# More data... #
################

/proc/26891/statm: 180983 162088 769 405 0 177927 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 723932 KiB
Current children cumulated memory: 648352 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.11 2.10 3/188 26987
/proc/meminfo: memFree=11850720/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=758708 memory=683128 CPUtime=1782.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 629748 0 0 0 177247 985 0 0 20 0 1 0 73117448 776916992 170782 33554432000 4194304 5849740 140723594977536 140723594976536 5307648 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 189677 170782 769 405 0 186621 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 758708 KiB
Current children cumulated memory: 683128 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.09 2.10 3/188 26988
/proc/meminfo: memFree=11850228/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=758708 memory=683128 CPUtime=1842.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 652103 0 0 0 183224 1009 0 0 20 0 1 0 73117448 776916992 170782 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 189677 170782 769 405 0 186621 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 758708 KiB
Current children cumulated memory: 683128 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.07 2.09 3/188 26989
/proc/meminfo: memFree=11852804/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=782996 memory=707416 CPUtime=1902.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 677235 0 0 0 189198 1034 0 0 20 0 1 0 73117448 801787904 176854 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 195749 176854 769 405 0 192693 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 782996 KiB
Current children cumulated memory: 707416 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.07 2.09 3/187 26991
/proc/meminfo: memFree=11835656/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=797848 memory=722268 CPUtime=1962.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 705201 0 0 0 195166 1067 0 0 20 0 1 0 73117448 816996352 180567 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 199462 180567 769 405 0 196406 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 797848 KiB
Current children cumulated memory: 722268 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.06 2.09 3/187 26992
/proc/meminfo: memFree=11836280/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=797848 memory=722268 CPUtime=2022.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 715758 0 0 0 201142 1090 0 0 20 0 1 0 73117448 816996352 180567 33554432000 4194304 5849740 140723594977536 140723594976408 5360437 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 199462 180567 769 405 0 196406 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 797848 KiB
Current children cumulated memory: 722268 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.05 2.08 3/187 26993
/proc/meminfo: memFree=11820220/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=797848 memory=722268 CPUtime=2082.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 716540 0 0 0 207118 1114 0 0 20 0 1 0 73117448 816996352 180567 33554432000 4194304 5849740 140723594977536 140723594976536 5312976 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 199462 180567 769 405 0 196406 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 797848 KiB
Current children cumulated memory: 722268 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.04 2.07 3/187 26995
/proc/meminfo: memFree=11531808/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=1183840 memory=1108148 CPUtime=2142.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 731974 0 0 0 213083 1149 0 0 20 0 1 0 73117448 1212252160 277037 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 295960 277037 769 405 0 292904 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 1183840 KiB
Current children cumulated memory: 1108148 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.04 2.07 3/187 26996
/proc/meminfo: memFree=11776036/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=839704 memory=764124 CPUtime=2202.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 745920 0 0 0 219055 1177 0 0 20 0 1 0 73117448 859856896 191031 33554432000 4194304 5849740 140723594977536 140723594976696 5435152 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 209926 191031 769 405 0 206870 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 839704 KiB
Current children cumulated memory: 764124 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.06 3/188 27005
/proc/meminfo: memFree=11697224/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=839704 memory=764124 CPUtime=2262.32 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 747795 0 0 0 225025 1207 0 0 20 0 1 0 73117448 859856896 191031 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 209926 191031 769 405 0 206870 0
Current children cumulated CPU time: 2262.32 s
Current children cumulated vsize: 839704 KiB
Current children cumulated memory: 764124 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.06 3/188 27006
/proc/meminfo: memFree=11632252/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=839704 memory=764124 CPUtime=2322.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 749105 0 0 0 230995 1238 0 0 20 0 1 0 73117448 859856896 191031 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 209926 191031 769 405 0 206870 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 839704 KiB
Current children cumulated memory: 764124 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 27007
/proc/meminfo: memFree=11579988/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=839704 memory=764124 CPUtime=2382.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 750809 0 0 0 236965 1268 0 0 20 0 1 0 73117448 859856896 191031 33554432000 4194304 5849740 140723594977536 140723594976536 5394786 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 209926 191031 769 405 0 206870 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 839704 KiB
Current children cumulated memory: 764124 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 27008
/proc/meminfo: memFree=11623004/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=839704 memory=764124 CPUtime=2442.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 752256 0 0 0 242940 1293 0 0 20 0 1 0 73117448 859856896 191031 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 209926 191031 769 405 0 206870 0
Current children cumulated CPU time: 2442.33 s
Current children cumulated vsize: 839704 KiB
Current children cumulated memory: 764124 KiB

[startup+2502.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 27009
/proc/meminfo: memFree=11703728/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=890244 memory=814448 CPUtime=2502.33 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 766410 0 0 0 248904 1329 0 0 20 0 1 0 73117448 911609856 203612 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 222561 203612 769 405 0 219505 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 890244 KiB
Current children cumulated memory: 814448 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.18 2.06 2.06 3/188 27070
/proc/meminfo: memFree=12207336/32770624 swapFree=67108852/67108860
[pid=26891] ppid=26888 vsize=899140 memory=823484 CPUtime=2520.04 cores=1,3,5,7
/proc/26891/stat : 26891 (xcsp_picat) R 26888 26891 25579 0 -1 4202496 767103 0 0 0 250668 1336 0 0 20 0 1 0 73117448 920719360 205871 33554432000 4194304 5849740 140723594977536 140723594976536 140472005607303 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 15339520 140723594982582 140723594982660 140723594982660 140723594985418 0
/proc/26891/statm: 224785 205871 769 405 0 221729 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 899140 KiB
Current children cumulated memory: 823484 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 26891 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.69 s, system=13.3693 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2520.05
CPU user time (s): 2506.69
CPU system time (s): 13.3693
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1183840
Max. memory (cumulated for all children) (KiB): 1108148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.69
system time used= 13.3693
maximum resident set size= 1108148
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 767104
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 41
involuntary context switches= 1120


# summary of solver processes directly reported to runsolver:
#   pid: 26891
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2506.69
#   total CPU system time (s): 13.3693

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.70992 second user time and 18.56 second system time

The end

Launcher Data 

Begin job on node148 at 2018-07-25 23:52:23
IDJOB=4295472
IDBENCH=141556
IDSOLVER=2754
FILE ID=node148/4295472-1532555543
RUNJOBID= node148-1532542928-25611
PBS_JOBID= 21021950
Free space on /tmp= 43260 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/TravelingTournament/TravelingTournament-a3-galaxy12_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295472-1532555543/watcher-4295472-1532555543 -o /tmp/evaluation-result-4295472-1532555543/solver-4295472-1532555543 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1532542928-25611 --watchdog 2580  xcsp_picat HOME/instance-4295472-1532555543.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 294b097d449017f2d3f7014537fb5318
RANDOM SEED=1065465723

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        12769788 kB
MemAvailable:   31583824 kB
Buffers:          213480 kB
Cached:         18537900 kB
SwapCached:            8 kB
Active:          2703584 kB
Inactive:       16449564 kB
Active(anon):     355408 kB
Inactive(anon):    74280 kB
Active(file):    2348176 kB
Inactive(file): 16375284 kB
Unevictable:        7080 kB
Mlocked:            7080 kB
SwapTotal:      67108860 kB
SwapFree:       67108852 kB
Dirty:              3120 kB
Writeback:             0 kB
AnonPages:        400432 kB
Mapped:            42736 kB
Shmem:             25216 kB
Slab:             546972 kB
SReclaimable:     519036 kB
SUnreclaim:        27936 kB
KernelStack:        3376 kB
PageTables:         5876 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     773420 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    325632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 43260 MiB
End job on node148 at 2018-07-26 00:34:23