Trace number 4309386

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2519.96 2520.02

General information on the benchmark

NameTravellingSalesman/
TravellingSalesman-50-30-00_c18.xml
MD5SUM80c5a80d7c962cf143a1b6c53ca701c2
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark190
Best CPU time to get the best result obtained on this benchmark2519.91
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints51
Number of domains2
Minimum domain size33
Maximum domain size50
Distribution of domain sizes[{"size":33,"count":50},{"size":50,"count":50}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":50},{"degree":3,"count":50}]
Minimum constraint arity3
Maximum constraint arity50
Distribution of constraint arities[{"arity":3,"count":50},{"arity":50,"count":1}]
Number of extensional constraints50
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":50},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13567 MiB free)
  memory of node 1: 16384 MiB (10424 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309386-1534317608/watcher-4309386-1534317608 -o /tmp/evaluation-result-4309386-1534317608/solver-4309386-1534317608 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534293639-21936 --watchdog 2580 xcsp_picat HOME/instance-4309386-1534317608.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=24924, runsolver pid=24921

[startup+0.10011 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24546904/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2025744 memory=23928 CPUtime=0.1 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 2078 0 0 0 10 0 0 0 20 0 1 0 249323962 2074361856 5982 33554432000 4194304 5849940 140721020931456 140721020930760 5472891 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 506436 5982 690 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 23928 KiB

[startup+0.209647 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24544484/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2026140 memory=26396 CPUtime=0.2 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 2183 0 0 0 20 0 0 0 20 0 1 0 249323962 2074767360 6599 33554432000 4194304 5849940 140721020931456 140721020930760 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 506535 6599 703 405 0 503479 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2026140 KiB
Current children cumulated memory: 26396 KiB

[startup+0.309003 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24543740/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2027036 memory=27176 CPUtime=0.31 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 2409 0 0 0 30 1 0 0 20 0 1 0 249323962 2075684864 6794 33554432000 4194304 5849940 140721020931456 140721020930760 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 506759 6794 705 405 0 503703 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2027036 KiB
Current children cumulated memory: 27176 KiB

[startup+0.700226 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24542732/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2029084 memory=29244 CPUtime=0.69 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 2921 0 0 0 67 2 0 0 20 0 1 0 249323962 2077782016 7311 33554432000 4194304 5849940 140721020931456 140721020930552 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 507271 7311 705 405 0 504215 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2029084 KiB
Current children cumulated memory: 29244 KiB

[startup+1.50024 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24541244/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2031264 memory=31588 CPUtime=1.49 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 3466 0 0 0 144 5 0 0 20 0 1 0 249323962 2080014336 7897 33554432000 4194304 5849940 140721020931456 140721020930552 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 507816 7897 705 405 0 504760 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031264 KiB
Current children cumulated memory: 31588 KiB

[startup+3.10932 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24533492/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2038432 memory=38620 CPUtime=3.1 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 5214 0 0 0 298 12 0 0 20 0 1 0 249323962 2087354368 9655 33554432000 4194304 5849940 140721020931456 140721020930552 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 509608 9655 705 405 0 506552 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2038432 KiB
Current children cumulated memory: 38620 KiB

[startup+6.30024 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24522968/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2051240 memory=51428 CPUtime=6.29 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 6663 0 0 0 603 26 0 0 20 0 1 0 249323962 2100469760 12857 33554432000 4194304 5849940 140721020931456 140721020930568 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 512810 12857 705 405 0 509754 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2051240 KiB
Current children cumulated memory: 51428 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24534524/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2041944 memory=42224 CPUtime=12.69 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 15615 0 0 0 1226 43 0 0 20 0 1 0 249323962 2090950656 10556 33554432000 4194304 5849940 140721020931456 140721020930152 5472032 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 510486 10556 746 405 0 507430 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2041944 KiB
Current children cumulated memory: 42224 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24476208/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2086668 memory=87112 CPUtime=25.48 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 20682 0 0 0 2484 64 0 0 20 0 1 0 249323962 2136748032 21778 33554432000 4194304 5849940 140721020931456 140721020930456 4217753 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 521667 21778 746 405 0 518611 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2086668 KiB
Current children cumulated memory: 87112 KiB

[startup+51.1095 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24925
/proc/meminfo: memFree=24505168/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2086516 memory=86960 CPUtime=51.09 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 34367 0 0 0 5021 88 0 0 20 0 1 0 249323962 2136592384 21740 33554432000 4194304 5849940 140721020931456 140721020930616 139673890955143 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 521629 21740 746 405 0 518573 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2086516 KiB
Current children cumulated memory: 86960 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24926
/proc/meminfo: memFree=24507796/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2091816 memory=92260 CPUtime=102.28 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 43330 0 0 0 10108 120 0 0 20 0 1 0 249323962 2142019584 23065 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 522954 23065 746 405 0 519898 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2091816 KiB
Current children cumulated memory: 92260 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24927
/proc/meminfo: memFree=24501696/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2095224 memory=95560 CPUtime=162.29 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 51263 0 0 0 16073 156 0 0 20 0 1 0 249323962 2145509376 23890 33554432000 4194304 5849940 140721020931456 140721020930328 5416683 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 523806 23890 746 405 0 520750 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2095224 KiB
Current children cumulated memory: 95560 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24928
/proc/meminfo: memFree=24477156/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2115940 memory=116384 CPUtime=222.28 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 61931 0 0 0 22028 200 0 0 20 0 1 0 249323962 2166722560 29096 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 528985 29096 746 405 0 525929 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2115940 KiB
Current children cumulated memory: 116384 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24929
/proc/meminfo: memFree=24456684/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2135744 memory=136188 CPUtime=282.28 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 73321 0 0 0 27987 241 0 0 20 0 1 0 249323962 2187001856 34047 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 533936 34047 746 405 0 530880 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2135744 KiB
Current children cumulated memory: 136188 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24931
/proc/meminfo: memFree=24423116/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2135660 memory=136104 CPUtime=342.28 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 73567 0 0 0 33949 279 0 0 20 0 1 0 249323962 2186915840 34026 33554432000 4194304 5849940 140721020931456 140721020930456 5335760 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 533915 34026 746 405 0 530859 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 2135660 KiB
Current children cumulated memory: 136104 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 24932
/proc/meminfo: memFree=24406560/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2155492 memory=155844 CPUtime=402.28 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 95294 0 0 0 39907 321 0 0 20 0 1 0 249323962 2207223808 38961 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 538873 38961 746 405 0 535817 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 2155492 KiB
Current children cumulated memory: 155844 KiB

[startup+462.3 s]
/proc/loadavg: 2.49 2.15 2.09 3/187 24933
/proc/meminfo: memFree=24454880/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2139056 memory=139340 CPUtime=462.29 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 104077 0 0 0 45871 358 0 0 20 0 1 0 249323962 2190393344 34835 33554432000 4194304 5849940 140721020931456 140721020930456 5437839 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 534764 34835 746 405 0 531708 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2139056 KiB
Current children cumulated memory: 139340 KiB


################
# More data... #
################

/proc/24924/statm: 571049 71809 746 405 0 567993 0
Current children cumulated CPU time: 1722.26 s
Current children cumulated vsize: 2284196 KiB
Current children cumulated memory: 287236 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25033
/proc/meminfo: memFree=23998896/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2389408 memory=392280 CPUtime=1782.25 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 352147 0 0 0 177132 1093 0 0 20 0 1 0 249323962 2446753792 98070 33554432000 4194304 5849940 140721020931456 140721020930328 5335712 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 597352 98070 746 405 0 594296 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 2389408 KiB
Current children cumulated memory: 392280 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25041
/proc/meminfo: memFree=24078076/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2309668 memory=312708 CPUtime=1842.26 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 382220 0 0 0 183105 1121 0 0 20 0 1 0 249323962 2365100032 78177 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 577417 78177 746 405 0 574361 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 2309668 KiB
Current children cumulated memory: 312708 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25042
/proc/meminfo: memFree=24046500/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2289032 memory=292072 CPUtime=1902.26 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 402277 0 0 0 189086 1140 0 0 20 0 1 0 249323962 2343968768 73018 33554432000 4194304 5849940 140721020931456 140721020930456 5351072 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 572258 73018 746 405 0 569202 0
Current children cumulated CPU time: 1902.26 s
Current children cumulated vsize: 2289032 KiB
Current children cumulated memory: 292072 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25043
/proc/meminfo: memFree=24024404/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2305840 memory=308616 CPUtime=1962.25 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 414378 0 0 0 195057 1168 0 0 20 0 1 0 249323962 2361180160 77154 33554432000 4194304 5849940 140721020931456 140721020930456 5335737 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 576460 77154 746 405 0 573404 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 2305840 KiB
Current children cumulated memory: 308616 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25044
/proc/meminfo: memFree=23986196/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2360580 memory=363620 CPUtime=2022.25 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 439900 0 0 0 201041 1184 0 0 20 0 1 0 249323962 2417233920 90905 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 590145 90905 746 405 0 587089 0
Current children cumulated CPU time: 2022.25 s
Current children cumulated vsize: 2360580 KiB
Current children cumulated memory: 363620 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25045
/proc/meminfo: memFree=24033052/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2313780 memory=316776 CPUtime=2082.25 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 446935 0 0 0 207019 1206 0 0 20 0 1 0 249323962 2369310720 79194 33554432000 4194304 5849940 140721020931456 140721020930456 5437824 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 578445 79194 746 405 0 575389 0
Current children cumulated CPU time: 2082.25 s
Current children cumulated vsize: 2313780 KiB
Current children cumulated memory: 316776 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25047
/proc/meminfo: memFree=24023664/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2389088 memory=392128 CPUtime=2142.24 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 468578 0 0 0 212998 1226 0 0 20 0 1 0 249323962 2446426112 98032 33554432000 4194304 5849940 140721020931456 140721020930456 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 597272 98032 746 405 0 594216 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 2389088 KiB
Current children cumulated memory: 392128 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25048
/proc/meminfo: memFree=24121756/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2253192 memory=256232 CPUtime=2202.24 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 480455 0 0 0 218973 1251 0 0 20 0 1 0 249323962 2307268608 64058 33554432000 4194304 5849940 140721020931456 140721020930456 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 563298 64058 746 405 0 560242 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 2253192 KiB
Current children cumulated memory: 256232 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25049
/proc/meminfo: memFree=24043388/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2347688 memory=350580 CPUtime=2262.24 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 508474 0 0 0 224956 1268 0 0 20 0 1 0 249323962 2404032512 87645 33554432000 4194304 5849940 140721020931456 140721020930456 5335774 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 586922 87645 746 405 0 583866 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 2347688 KiB
Current children cumulated memory: 350580 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25051
/proc/meminfo: memFree=24043180/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2347688 memory=350728 CPUtime=2322.24 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 535694 0 0 0 230942 1282 0 0 20 0 1 0 249323962 2404032512 87682 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 586922 87682 746 405 0 583866 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 2347688 KiB
Current children cumulated memory: 350728 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25052
/proc/meminfo: memFree=23984984/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2399928 memory=402968 CPUtime=2382.23 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 564365 0 0 0 236926 1297 0 0 20 0 1 0 249323962 2457526272 100742 33554432000 4194304 5849940 140721020931456 140721020930456 5335776 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 599982 100742 746 405 0 596926 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 2399928 KiB
Current children cumulated memory: 402968 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 25060
/proc/meminfo: memFree=23927776/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2456040 memory=459080 CPUtime=2442.23 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 600780 0 0 0 242906 1317 0 0 20 0 1 0 249323962 2514984960 114770 33554432000 4194304 5849940 140721020931456 140721020930456 139673890955143 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 614010 114770 746 405 0 610954 0
Current children cumulated CPU time: 2442.23 s
Current children cumulated vsize: 2456040 KiB
Current children cumulated memory: 459080 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 25085
/proc/meminfo: memFree=24082016/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2295880 memory=298920 CPUtime=2502.23 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 628728 0 0 0 248886 1337 0 0 20 0 1 0 249323962 2350981120 74730 33554432000 4194304 5849940 140721020931456 140721020930456 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 573970 74730 746 405 0 570914 0
Current children cumulated CPU time: 2502.23 s
Current children cumulated vsize: 2295880 KiB
Current children cumulated memory: 298920 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/189 25085
/proc/meminfo: memFree=24017256/32770624 swapFree=67108172/67108860
[pid=24924] ppid=24921 vsize=2360856 memory=363804 CPUtime=2519.93 cores=0,2,4,6
/proc/24924/stat : 24924 (xcsp_picat) R 24921 24924 21905 0 -1 4202496 633134 0 0 0 250651 1342 0 0 20 0 1 0 249323962 2417516544 90951 33554432000 4194304 5849940 140721020931456 140721020930616 5335776 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30359552 140721020933302 140721020933380 140721020933380 140721020936138 0
/proc/24924/statm: 590214 90951 746 405 0 587158 0
Current children cumulated CPU time: 2519.93 s
Current children cumulated vsize: 2360856 KiB
Current children cumulated memory: 363804 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 24924 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.52 s, system=13.4397 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2519.96
CPU user time (s): 2506.52
CPU system time (s): 13.4397
CPU usage (%): 99.9976
Max. virtual memory (cumulated for all children) (KiB): 2456040
Max. memory (cumulated for all children) (KiB): 459080

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.52
system time used= 13.4398
maximum resident set size= 459080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 633134
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 2812


# summary of solver processes directly reported to runsolver:
#   pid: 24924
#   total CPU time (s): 2519.96
#   total CPU user time (s): 2506.52
#   total CPU system time (s): 13.4397

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.54297 second user time and 18.9461 second system time

The end

Launcher Data 

Begin job on node136 at 2018-08-15 09:20:08
IDJOB=4309386
IDBENCH=141630
IDSOLVER=2794
FILE ID=node136/4309386-1534317608
RUNJOBID= node136-1534293639-21936
PBS_JOBID= 21038144
Free space on /tmp= 39024 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/TravellingSalesman/TravellingSalesman-50-30-00_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309386-1534317608/watcher-4309386-1534317608 -o /tmp/evaluation-result-4309386-1534317608/solver-4309386-1534317608 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534293639-21936 --watchdog 2580  xcsp_picat HOME/instance-4309386-1534317608.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 80c5a80d7c962cf143a1b6c53ca701c2
RANDOM SEED=1742681854

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24568588 kB
MemAvailable:   31790168 kB
Buffers:          125504 kB
Cached:          7324584 kB
SwapCached:           16 kB
Active:          3880516 kB
Inactive:        3730232 kB
Active(anon):     111928 kB
Inactive(anon):   109076 kB
Active(file):    3768588 kB
Inactive(file):  3621156 kB
Unevictable:        7380 kB
Mlocked:            7380 kB
SwapTotal:      67108860 kB
SwapFree:       67108172 kB
Dirty:              3176 kB
Writeback:             0 kB
AnonPages:        167412 kB
Mapped:            57712 kB
Shmem:             57768 kB
Slab:             288748 kB
SReclaimable:     260296 kB
SUnreclaim:        28452 kB
KernelStack:        3328 kB
PageTables:         5552 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2491236 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    104448 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 39020 MiB
End job on node136 at 2018-08-15 10:02:08