Trace number 4303043

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2519.66 2520.02

General information on the benchmark

NameTravellingSalesman/
TravellingSalesman-35-30-00_c18.xml
MD5SUM558ee623558ef43f0bbab0563f00ef08
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark148
Best CPU time to get the best result obtained on this benchmark2520.11
Satisfiable
(Un)Satisfiability was proved
Number of variables70
Number of constraints36
Number of domains2
Minimum domain size33
Maximum domain size35
Distribution of domain sizes[{"size":33,"count":35},{"size":35,"count":35}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":35},{"degree":3,"count":35}]
Minimum constraint arity3
Maximum constraint arity35
Distribution of constraint arities[{"arity":3,"count":35},{"arity":35,"count":1}]
Number of extensional constraints35
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":35},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8412 MiB free)
  memory of node 1: 16384 MiB (11707 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303043-1534030339/watcher-4303043-1534030339 -o /tmp/evaluation-result-4303043-1534030339/solver-4303043-1534030339 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node106-1534025075-19010 --watchdog 2580 xcsp_picat HOME/instance-4303043-1534030339.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19667, runsolver pid=19664
Current StackSize limit: 8192 KiB


[startup+0.100111 s]*
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20587004/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2026068 memory=18628 CPUtime=0.1 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1790 0 0 0 10 0 0 0 20 0 1 0 220596783 2074693632 4657 33554432000 4194304 5849708 140721254479488 140721254479488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 506517 4657 703 405 0 503462 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2026068 KiB
Current children cumulated memory: 18628 KiB

[startup+0.209483 s]*
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20586260/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2026716 memory=19228 CPUtime=0.21 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1984 0 0 0 21 0 0 0 20 0 1 0 220596783 2075357184 4807 33554432000 4194304 5849708 140721254479488 140721254479488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 506679 4807 705 405 0 503624 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2026716 KiB
Current children cumulated memory: 19228 KiB

[startup+0.308831 s]*
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20585720/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2026972 memory=19484 CPUtime=0.31 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 2048 0 0 0 30 1 0 0 20 0 1 0 220596783 2075619328 4871 33554432000 4194304 5849708 140721254479488 140721254478424 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 506743 4871 705 405 0 503688 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2026972 KiB
Current children cumulated memory: 19484 KiB

[startup+0.700239 s]
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20585348/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2029020 memory=21552 CPUtime=0.69 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 2560 0 0 0 67 2 0 0 20 0 1 0 220596783 2077716480 5388 33554432000 4194304 5849708 140721254479488 140721254478424 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 507255 5388 705 405 0 504200 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2029020 KiB
Current children cumulated memory: 21552 KiB

[startup+1.50023 s]
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20583860/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2032224 memory=24756 CPUtime=1.49 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 3361 0 0 0 144 5 0 0 20 0 1 0 220596783 2080997376 6189 33554432000 4194304 5849708 140721254479488 140721254478600 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 508056 6189 705 405 0 505001 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2032224 KiB
Current children cumulated memory: 24756 KiB

[startup+3.10959 s]
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20508156/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2039060 memory=31612 CPUtime=3.1 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 6849 0 0 0 303 7 0 0 20 0 1 0 220596783 2087997440 7903 33554432000 4194304 5849708 140721254479488 140721254478040 5360453 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 509765 7903 723 405 0 506710 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2039060 KiB
Current children cumulated memory: 31612 KiB

[startup+6.30032 s]
/proc/loadavg: 2.05 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20513620/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2041960 memory=34772 CPUtime=6.29 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 11930 0 0 0 614 15 0 0 20 0 1 0 220596783 2090967040 8693 33554432000 4194304 5849708 140721254479488 140721254478584 5376002 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 510490 8693 746 405 0 507435 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2041960 KiB
Current children cumulated memory: 34772 KiB

[startup+12.7003 s]
/proc/loadavg: 2.04 2.05 2.05 3/188 19668
/proc/meminfo: memFree=20459592/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2054320 memory=47132 CPUtime=12.68 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 14339 0 0 0 1245 23 0 0 20 0 1 0 220596783 2103623680 11783 33554432000 4194304 5849708 140721254479488 140721254478488 5339722 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 513580 11783 746 405 0 510525 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 2054320 KiB
Current children cumulated memory: 47132 KiB

[startup+25.5004 s]
/proc/loadavg: 2.03 2.04 2.05 3/188 19668
/proc/meminfo: memFree=20422172/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2054320 memory=47132 CPUtime=25.49 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 18797 0 0 0 2509 40 0 0 20 0 1 0 220596783 2103623680 11783 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 513580 11783 746 405 0 510525 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2054320 KiB
Current children cumulated memory: 47132 KiB

[startup+51.1096 s]
/proc/loadavg: 2.02 2.04 2.05 3/188 19668
/proc/meminfo: memFree=20408852/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2068224 memory=60888 CPUtime=51.08 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 30192 0 0 0 5041 67 0 0 20 0 1 0 220596783 2117861376 15222 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 517056 15222 746 405 0 514001 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 2068224 KiB
Current children cumulated memory: 60888 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/188 19669
/proc/meminfo: memFree=20419276/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2077200 memory=70140 CPUtime=102.26 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 50832 0 0 0 10112 114 0 0 20 0 1 0 220596783 2127052800 17535 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 519300 17535 746 405 0 516245 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 2077200 KiB
Current children cumulated memory: 70140 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 19670
/proc/meminfo: memFree=20407336/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2093156 memory=85920 CPUtime=162.24 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 71176 0 0 0 16068 156 0 0 20 0 1 0 220596783 2143391744 21480 33554432000 4194304 5849708 140721254479488 140721254478360 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 523289 21480 746 405 0 520234 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 2093156 KiB
Current children cumulated memory: 85920 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 19671
/proc/meminfo: memFree=20382244/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2109196 memory=101972 CPUtime=222.22 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 91733 0 0 0 22031 191 0 0 20 0 1 0 220596783 2159816704 25493 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 527299 25493 746 405 0 524244 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 2109196 KiB
Current children cumulated memory: 101972 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 19672
/proc/meminfo: memFree=20320920/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2037852 memory=30792 CPUtime=282.2 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 118700 0 0 0 27990 230 0 0 20 0 1 0 220596783 2086760448 7698 33554432000 4194304 5849708 140721254479488 140721254478728 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 509463 7698 746 405 0 506408 0
Current children cumulated CPU time: 282.2 s
Current children cumulated vsize: 2037852 KiB
Current children cumulated memory: 30792 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19673
/proc/meminfo: memFree=20294000/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2066772 memory=59564 CPUtime=342.19 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 124915 0 0 0 33931 288 0 0 20 0 1 0 220596783 2116374528 14891 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 516693 14891 746 405 0 513638 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 2066772 KiB
Current children cumulated memory: 59564 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19674
/proc/meminfo: memFree=20277684/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2088232 memory=80816 CPUtime=402.17 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 125691 0 0 0 39889 328 0 0 20 0 1 0 220596783 2138349568 20204 33554432000 4194304 5849708 140721254479488 140721254478648 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 522058 20204 746 405 0 519003 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 2088232 KiB
Current children cumulated memory: 80816 KiB

[startup+462.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/187 19675
/proc/meminfo: memFree=20246692/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2109088 memory=101752 CPUtime=462.15 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 132997 0 0 0 45851 364 0 0 20 0 1 0 220596783 2159706112 25438 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 527272 25438 746 405 0 524217 0
Current children cumulated CPU time: 462.15 s
Current children cumulated vsize: 2109088 KiB
Current children cumulated memory: 101752 KiB


################
# More data... #
################

/proc/19667/statm: 640688 139869 746 405 0 637633 0
Current children cumulated CPU time: 1722 s
Current children cumulated vsize: 2562752 KiB
Current children cumulated memory: 559476 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 19749
/proc/meminfo: memFree=19750772/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2562752 memory=559476 CPUtime=1782 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 537317 0 0 0 177494 706 0 0 20 0 1 0 220596783 2624258048 139869 33554432000 4194304 5849708 140721254479488 140721254478488 5437714 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 640688 139869 746 405 0 637633 0
Current children cumulated CPU time: 1782 s
Current children cumulated vsize: 2562752 KiB
Current children cumulated memory: 559476 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 19750
/proc/meminfo: memFree=19651180/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2662188 memory=658856 CPUtime=1841.99 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 575832 0 0 0 183480 719 0 0 20 0 1 0 220596783 2726080512 164714 33554432000 4194304 5849708 140721254479488 140721254478488 5312794 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 665547 164714 746 405 0 662492 0
Current children cumulated CPU time: 1841.99 s
Current children cumulated vsize: 2662188 KiB
Current children cumulated memory: 658856 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 19751
/proc/meminfo: memFree=19651428/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2662188 memory=658912 CPUtime=1901.99 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 610947 0 0 0 189472 727 0 0 20 0 1 0 220596783 2726080512 164728 33554432000 4194304 5849708 140721254479488 140721254478488 5437855 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 665547 164728 746 405 0 662492 0
Current children cumulated CPU time: 1901.99 s
Current children cumulated vsize: 2662188 KiB
Current children cumulated memory: 658912 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 19752
/proc/meminfo: memFree=19651288/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2662188 memory=658912 CPUtime=1961.98 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 632531 0 0 0 195461 737 0 0 20 0 1 0 220596783 2726080512 164728 33554432000 4194304 5849708 140721254479488 140721254478488 5311433 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 665547 164728 746 405 0 662492 0
Current children cumulated CPU time: 1961.98 s
Current children cumulated vsize: 2662188 KiB
Current children cumulated memory: 658912 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19753
/proc/meminfo: memFree=19651632/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2662188 memory=658912 CPUtime=2021.97 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 692617 0 0 0 201451 746 0 0 20 0 1 0 220596783 2726080512 164728 33554432000 4194304 5849708 140721254479488 140721254478488 5438242 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 665547 164728 746 405 0 662492 0
Current children cumulated CPU time: 2021.97 s
Current children cumulated vsize: 2662188 KiB
Current children cumulated memory: 658912 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19754
/proc/meminfo: memFree=19579292/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2734460 memory=731184 CPUtime=2081.97 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 780838 0 0 0 207433 764 0 0 20 0 1 0 220596783 2800087040 182796 33554432000 4194304 5849708 140721254479488 140721254478488 5335584 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 683615 182796 746 405 0 680560 0
Current children cumulated CPU time: 2081.97 s
Current children cumulated vsize: 2734460 KiB
Current children cumulated memory: 731184 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19755
/proc/meminfo: memFree=19510100/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2799996 memory=796720 CPUtime=2141.97 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 834947 0 0 0 213419 778 0 0 20 0 1 0 220596783 2867195904 199180 33554432000 4194304 5849708 140721254479488 140721254478488 5375981 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 699999 199180 746 405 0 696944 0
Current children cumulated CPU time: 2141.97 s
Current children cumulated vsize: 2799996 KiB
Current children cumulated memory: 796720 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19756
/proc/meminfo: memFree=19535972/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2773800 memory=770524 CPUtime=2201.96 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 897183 0 0 0 219402 794 0 0 20 0 1 0 220596783 2840371200 192631 33554432000 4194304 5849708 140721254479488 140721254478488 5437714 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 693450 192631 746 405 0 690395 0
Current children cumulated CPU time: 2201.96 s
Current children cumulated vsize: 2773800 KiB
Current children cumulated memory: 770524 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19764
/proc/meminfo: memFree=19534748/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2773800 memory=770524 CPUtime=2261.96 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 940379 0 0 0 225388 808 0 0 20 0 1 0 220596783 2840371200 192631 33554432000 4194304 5849708 140721254479488 140721254478488 5335520 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 693450 192631 746 405 0 690395 0
Current children cumulated CPU time: 2261.96 s
Current children cumulated vsize: 2773800 KiB
Current children cumulated memory: 770524 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19765
/proc/meminfo: memFree=19488268/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2839336 memory=835992 CPUtime=2321.96 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1020220 0 0 0 231371 825 0 0 20 0 1 0 220596783 2907480064 208998 33554432000 4194304 5849708 140721254479488 140721254478488 5437714 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 709834 208998 746 405 0 706779 0
Current children cumulated CPU time: 2321.96 s
Current children cumulated vsize: 2839336 KiB
Current children cumulated memory: 835992 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19766
/proc/meminfo: memFree=19472248/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2790028 memory=786752 CPUtime=2381.95 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1096448 0 0 0 237352 843 0 0 20 0 1 0 220596783 2856988672 196688 33554432000 4194304 5849708 140721254479488 140721254478488 5335622 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 697507 196688 746 405 0 694452 0
Current children cumulated CPU time: 2381.95 s
Current children cumulated vsize: 2790028 KiB
Current children cumulated memory: 786752 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19827
/proc/meminfo: memFree=19775000/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2790028 memory=786752 CPUtime=2441.94 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1184561 0 0 0 243335 859 0 0 20 0 1 0 220596783 2856988672 196688 33554432000 4194304 5849708 140721254479488 140721254478488 5437714 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 697507 196688 746 405 0 694452 0
Current children cumulated CPU time: 2441.94 s
Current children cumulated vsize: 2790028 KiB
Current children cumulated memory: 786752 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19828
/proc/meminfo: memFree=19721748/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2837012 memory=833736 CPUtime=2501.93 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1261037 0 0 0 249311 882 0 0 20 0 1 0 220596783 2905100288 208434 33554432000 4194304 5849708 140721254479488 140721254478648 5437580 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 709253 208434 746 405 0 706198 0
Current children cumulated CPU time: 2501.93 s
Current children cumulated vsize: 2837012 KiB
Current children cumulated memory: 833736 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 19829
/proc/meminfo: memFree=20159580/32770624 swapFree=67108688/67108860
[pid=19667] ppid=19664 vsize=2400780 memory=397504 CPUtime=2519.64 cores=1,3,5,7
/proc/19667/stat : 19667 (xcsp_picat) R 19664 19667 18978 0 -1 4202496 1313060 0 0 0 251072 892 0 0 20 0 1 0 220596783 2458398720 99376 33554432000 4194304 5849708 140721254479488 140721254478488 140003764187015 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24616960 140721254483126 140721254483204 140721254483204 140721254485962 0
/proc/19667/statm: 600195 99376 746 405 0 597140 0
Current children cumulated CPU time: 2519.64 s
Current children cumulated vsize: 2400780 KiB
Current children cumulated memory: 397504 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 19667 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2510.73 s, system=8.93784 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2519.66
CPU user time (s): 2510.73
CPU system time (s): 8.93784
CPU usage (%): 99.9858
Max. virtual memory (cumulated for all children) (KiB): 2902548
Max. memory (cumulated for all children) (KiB): 899272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2510.73
system time used= 8.93784
maximum resident set size= 899272
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1313061
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 1468


# summary of solver processes directly reported to runsolver:
#   pid: 19667
#   total CPU time (s): 2519.66
#   total CPU user time (s): 2510.73
#   total CPU system time (s): 8.93784

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.63023 second user time and 19.0845 second system time

The end

Launcher Data 

Begin job on node106 at 2018-08-12 01:32:19
IDJOB=4303043
IDBENCH=141624
IDSOLVER=2778
FILE ID=node106/4303043-1534030339
RUNJOBID= node106-1534025075-19010
PBS_JOBID= 21036957
Free space on /tmp= 39660 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/TravellingSalesman/TravellingSalesman-35-30-00_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303043-1534030339/watcher-4303043-1534030339 -o /tmp/evaluation-result-4303043-1534030339/solver-4303043-1534030339 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node106-1534025075-19010 --watchdog 2580  xcsp_picat HOME/instance-4303043-1534030339.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 558ee623558ef43f0bbab0563f00ef08
RANDOM SEED=768787135

node106.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20603428 kB
MemAvailable:   31681620 kB
Buffers:           86564 kB
Cached:         11140388 kB
SwapCached:            0 kB
Active:          5701828 kB
Inactive:        5803224 kB
Active(anon):     225060 kB
Inactive(anon):   105632 kB
Active(file):    5476768 kB
Inactive(file):  5697592 kB
Unevictable:        6996 kB
Mlocked:            6996 kB
SwapTotal:      67108860 kB
SwapFree:       67108688 kB
Dirty:              3112 kB
Writeback:             4 kB
AnonPages:        291088 kB
Mapped:            53076 kB
Shmem:             49632 kB
Slab:             359676 kB
SReclaimable:     332292 kB
SUnreclaim:        27384 kB
KernelStack:        3376 kB
PageTables:         5940 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2526260 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    188416 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      109952 kB
DirectMap2M:    33435648 kB

Free space on /tmp at the end= 39656 MiB
End job on node106 at 2018-08-12 02:14:19