Trace number 4395711

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2019-09-12? (TO) 2400.05 2399.9

General information on the benchmark

NameVrp/Vrp-zinc-s1/
Vrp-A-n38-k5.xml
MD5SUM681710e79c8377b968f88ec392af942b
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark770
Best CPU time to get the best result obtained on this benchmark2400.11
Satisfiable
(Un)Satisfiability was proved
Number of variables1482
Number of constraints1443
Number of domains3
Minimum domain size1
Maximum domain size101
Distribution of domain sizes[{"size":1,"count":38},{"size":2,"count":1406},{"size":101,"count":37}]
Minimum variable degree0
Maximum variable degree73
Distribution of variable degrees[{"degree":0,"count":1},{"degree":1,"count":38},{"degree":2,"count":74},{"degree":4,"count":1332},{"degree":73,"count":37}]
Minimum constraint arity1
Maximum constraint arity37
Distribution of constraint arities[{"arity":1,"count":37},{"arity":3,"count":1332},{"arity":37,"count":74}]
Number of extensional constraints0
Number of intensional constraints37
Distribution of constraint types[{"type":"intension","count":37},{"type":"sum","count":1332},{"type":"count","count":74}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

37.49/37.50	c xcsp_picat version 2.7b12 (9/12/2019)
37.49/37.50	o 2662

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13763 MiB free)
  memory of node 1: 16384 MiB (15118 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4395711-1568333846/watcher-4395711-1568333846 -o /tmp/evaluation-result-4395711-1568333846/solver-4395711-1568333846 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568323423-22106 --watchdog 2560 xcsp_picat HOME/instance-4395711-1568333846.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=24907, runsolver pid=24904

[startup+0.10012 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29550120/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2041924 memory=32668 CPUtime=0.1 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 3255 0 0 0 10 0 0 0 20 0 1 0 409633237 2090930176 8167 33554432000 4194304 5870510 140724237945888 140724237943032 5476915 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510481 8167 951 410 0 505954 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2041924 KiB
Current children cumulated memory: 32668 KiB

[startup+0.209672 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29546896/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2042040 memory=32752 CPUtime=0.21 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 3310 0 0 0 21 0 0 0 20 0 1 0 409633237 2091048960 8188 33554432000 4194304 5870510 140724237945888 140724237943032 5476984 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510510 8188 968 410 0 505983 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2042040 KiB
Current children cumulated memory: 32752 KiB

[startup+0.309184 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29546632/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2042168 memory=32752 CPUtime=0.31 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 3327 0 0 0 31 0 0 0 20 0 1 0 409633237 2091180032 8188 33554432000 4194304 5870510 140724237945888 140724237943032 5478381 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510542 8188 968 410 0 506015 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2042168 KiB
Current children cumulated memory: 32752 KiB

[startup+0.700227 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29546108/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2042168 memory=33060 CPUtime=0.69 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 3363 0 0 0 69 0 0 0 20 0 1 0 409633237 2091180032 8265 33554432000 4194304 5870510 140724237945888 140724237944984 5562048 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510542 8265 970 410 0 506015 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2042168 KiB
Current children cumulated memory: 33060 KiB

[startup+1.50024 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29544060/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2042520 memory=33456 CPUtime=1.49 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 3504 0 0 0 149 0 0 0 20 0 1 0 409633237 2091540480 8364 33554432000 4194304 5870510 140724237945888 140724237944984 5477031 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510630 8364 971 410 0 506103 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2042520 KiB
Current children cumulated memory: 33456 KiB

[startup+3.10904 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29540780/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2043400 memory=36528 CPUtime=3.1 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 4151 0 0 0 309 1 0 0 20 0 1 0 409633237 2092441600 9132 33554432000 4194304 5870510 140724237945888 140724237944888 5562064 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 510850 9132 971 410 0 506323 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2043400 KiB
Current children cumulated memory: 36528 KiB

[startup+6.30031 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29491044/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2085676 memory=76036 CPUtime=6.29 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 21240 0 0 0 623 6 0 0 20 0 1 0 409633237 2135732224 19009 33554432000 4194304 5870510 140724237945888 140724237945048 5282578 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 521419 19009 992 410 0 516892 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2085676 KiB
Current children cumulated memory: 76036 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29501352/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2079468 memory=74376 CPUtime=12.69 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 27679 0 0 0 1259 10 0 0 20 0 1 0 409633237 2129375232 18594 33554432000 4194304 5870510 140724237945888 140724237945064 5349954 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 519867 18594 1007 410 0 515340 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2079468 KiB
Current children cumulated memory: 74376 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24908
/proc/meminfo: memFree=29430772/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2183764 memory=145760 CPUtime=25.49 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 34966 0 0 0 2537 12 0 0 20 0 1 0 409633237 2236174336 36440 33554432000 4194304 5870510 140724237945888 140724237944840 5263058 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 545941 36440 1008 410 0 541414 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2183764 KiB
Current children cumulated memory: 145760 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24910
/proc/meminfo: memFree=29444776/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2122480 memory=117944 CPUtime=51.1 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 56068 0 0 0 5094 16 0 0 20 0 1 0 409633237 2173419520 29486 33554432000 4194304 5870510 140724237945888 140724237944456 5262811 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 530620 29486 1008 410 0 526093 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2122480 KiB
Current children cumulated memory: 117944 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24914
/proc/meminfo: memFree=29359692/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2183852 memory=173528 CPUtime=102.29 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 73295 0 0 0 10205 24 0 0 20 0 1 0 409633237 2236264448 43382 33554432000 4194304 5870510 140724237945888 140724237944328 5282759 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 545963 43382 1008 410 0 541436 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 2183852 KiB
Current children cumulated memory: 173528 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 24918
/proc/meminfo: memFree=29396808/32770624 swapFree=67001536/67108860
[pid=24907] ppid=24904 vsize=2183852 memory=161260 CPUtime=162.3 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 83097 0 0 0 16198 32 0 0 20 0 1 0 409633237 2236264448 40315 33554432000 4194304 5870510 140724237945888 140724237944904 5262639 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 545963 40315 1008 410 0 541436 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 2183852 KiB
Current children cumulated memory: 161260 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24932
/proc/meminfo: memFree=29286172/32770624 swapFree=67001552/67108860
[pid=24907] ppid=24904 vsize=2164884 memory=159148 CPUtime=222.3 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 86127 0 0 0 22193 37 0 0 20 0 1 0 409633237 2216841216 39787 33554432000 4194304 5870510 140724237945888 140724237944456 5282295 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 541221 39787 1008 410 0 536694 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 2164884 KiB
Current children cumulated memory: 159148 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24936
/proc/meminfo: memFree=29308720/32770624 swapFree=67001552/67108860
[pid=24907] ppid=24904 vsize=2183852 memory=165340 CPUtime=282.31 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 90280 0 0 0 28185 46 0 0 20 0 1 0 409633237 2236264448 41335 33554432000 4194304 5870510 140724237945888 140724237944328 5282590 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 545963 41335 1008 410 0 541436 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 2183852 KiB
Current children cumulated memory: 165340 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24940
/proc/meminfo: memFree=29345376/32770624 swapFree=67001552/67108860
[pid=24907] ppid=24904 vsize=2134532 memory=130000 CPUtime=342.31 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 100140 0 0 0 34179 52 0 0 20 0 1 0 409633237 2185760768 32500 33554432000 4194304 5870510 140724237945888 140724237944328 5282505 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 533633 32500 1008 410 0 529106 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 2134532 KiB
Current children cumulated memory: 130000 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24946
/proc/meminfo: memFree=29301932/32770624 swapFree=67001552/67108860
[pid=24907] ppid=24904 vsize=2183852 memory=167388 CPUtime=402.31 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 102533 0 0 0 40171 60 0 0 20 0 1 0 409633237 2236264448 41847 33554432000 4194304 5870510 140724237945888 140724237944328 5282747 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 545963 41847 1008 410 0 541436 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 2183852 KiB
Current children cumulated memory: 167388 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 24950
/proc/meminfo: memFree=29257892/32770624 swapFree=67001552/67108860
[pid=24907] ppid=24904 vsize=2215088 memory=210480 CPUtime=462.32 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 106732 0 0 0 46164 68 0 0 20 0 1 0 409633237 2268250112 52620 33554432000 4194304 5870510 140724237945888 140724237944456 5258710 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553772 52620 1008 410 0 549245 0
Current children cumulated CPU time: 462.32 s
Current children cumulated vsize: 2215088 KiB
Current children cumulated memory: 210480 KiB


################
# More data... #
################

/proc/24907/statm: 541443 40310 1008 410 0 536916 0
Current children cumulated CPU time: 1662.4 s
Current children cumulated vsize: 2165772 KiB
Current children cumulated memory: 161240 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/199 25066
/proc/meminfo: memFree=29262952/32770624 swapFree=67001564/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=192484 CPUtime=1722.4 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 198693 0 0 0 172008 232 0 0 20 0 1 0 409633237 2268254208 48121 33554432000 4194304 5870510 140724237945888 140724237944328 5262742 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 48121 1008 410 0 549246 0
Current children cumulated CPU time: 1722.4 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 192484 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 25070
/proc/meminfo: memFree=29242260/32770624 swapFree=67001564/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=201920 CPUtime=1782.4 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 201655 0 0 0 178000 240 0 0 20 0 1 0 409633237 2268254208 50480 33554432000 4194304 5870510 140724237945888 140724237944328 5283064 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 50480 1008 410 0 549246 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 201920 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 25076
/proc/meminfo: memFree=29269184/32770624 swapFree=67001564/67108860
[pid=24907] ppid=24904 vsize=2165772 memory=165240 CPUtime=1842.41 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 203842 0 0 0 183992 249 0 0 20 0 1 0 409633237 2217750528 41310 33554432000 4194304 5870510 140724237945888 140724237944328 5282759 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 541443 41310 1008 410 0 536916 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 2165772 KiB
Current children cumulated memory: 165240 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 25141
/proc/meminfo: memFree=30064368/32770624 swapFree=67001564/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=198532 CPUtime=1902.41 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 207008 0 0 0 189983 258 0 0 20 0 1 0 409633237 2268254208 49633 33554432000 4194304 5870510 140724237945888 140724237944328 5282170 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 49633 1008 410 0 549246 0
Current children cumulated CPU time: 1902.41 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 198532 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 25145
/proc/meminfo: memFree=30069476/32770624 swapFree=67001564/67108860
[pid=24907] ppid=24904 vsize=2165772 memory=165240 CPUtime=1962.41 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 209839 0 0 0 195974 267 0 0 20 0 1 0 409633237 2217750528 41310 33554432000 4194304 5870510 140724237945888 140724237944328 5276240 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 541443 41310 1008 410 0 536916 0
Current children cumulated CPU time: 1962.41 s
Current children cumulated vsize: 2165772 KiB
Current children cumulated memory: 165240 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 25159
/proc/meminfo: memFree=30015456/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=210892 CPUtime=2022.42 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 220557 0 0 0 201957 285 0 0 20 0 1 0 409633237 2268254208 52723 33554432000 4194304 5870510 140724237945888 140724237944904 5283083 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 52723 1008 410 0 549246 0
Current children cumulated CPU time: 2022.42 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 210892 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 25163
/proc/meminfo: memFree=30000412/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=198532 CPUtime=2082.43 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 223317 0 0 0 207948 295 0 0 20 0 1 0 409633237 2268254208 49633 33554432000 4194304 5870510 140724237945888 140724237944328 5308370 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 49633 1008 410 0 549246 0
Current children cumulated CPU time: 2082.43 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 198532 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 25167
/proc/meminfo: memFree=29994756/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2215092 memory=204916 CPUtime=2142.43 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 225884 0 0 0 213940 303 0 0 20 0 1 0 409633237 2268254208 51229 33554432000 4194304 5870510 140724237945888 140724237944904 5288720 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553773 51229 1008 410 0 549246 0
Current children cumulated CPU time: 2142.43 s
Current children cumulated vsize: 2215092 KiB
Current children cumulated memory: 204916 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 25173
/proc/meminfo: memFree=29997268/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2215832 memory=199276 CPUtime=2202.43 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 229070 0 0 0 219932 311 0 0 20 0 1 0 409633237 2269011968 49819 33554432000 4194304 5870510 140724237945888 140724237944904 5304464 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 553958 49819 1008 410 0 549431 0
Current children cumulated CPU time: 2202.43 s
Current children cumulated vsize: 2215832 KiB
Current children cumulated memory: 199276 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 25177
/proc/meminfo: memFree=29964664/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2246524 memory=232012 CPUtime=2262.43 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 233125 0 0 0 225922 321 0 0 20 0 1 0 409633237 2300440576 58003 33554432000 4194304 5870510 140724237945888 140724237944328 5283135 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 561631 58003 1008 410 0 557104 0
Current children cumulated CPU time: 2262.43 s
Current children cumulated vsize: 2246524 KiB
Current children cumulated memory: 232012 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 25182
/proc/meminfo: memFree=29973500/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2246524 memory=234060 CPUtime=2322.44 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 235961 0 0 0 231912 332 0 0 20 0 1 0 409633237 2300440576 58515 33554432000 4194304 5870510 140724237945888 140724237944328 5262557 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 561631 58515 1008 410 0 557104 0
Current children cumulated CPU time: 2322.44 s
Current children cumulated vsize: 2246524 KiB
Current children cumulated memory: 234060 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 25188
/proc/meminfo: memFree=29971012/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2246524 memory=229964 CPUtime=2382.44 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 238978 0 0 0 237902 342 0 0 20 0 1 0 409633237 2300440576 57491 33554432000 4194304 5870510 140724237945888 140724237944328 5283102 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 561631 57491 1008 410 0 557104 0
Current children cumulated CPU time: 2382.44 s
Current children cumulated vsize: 2246524 KiB
Current children cumulated memory: 229964 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 25188
/proc/meminfo: memFree=29966792/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2246524 memory=234060 CPUtime=2400.04 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 239717 0 0 0 239660 344 0 0 20 0 1 0 409633237 2300440576 58515 33554432000 4194304 5870510 140724237945888 140724237944328 5258727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 561631 58515 1008 410 0 557104 0
Current children cumulated CPU time: 2400.04 s
Current children cumulated vsize: 2246524 KiB
Current children cumulated memory: 234060 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.9 s]
# the end of solver process 24907 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2396.6 s, system=3.45024 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 25188
/proc/meminfo: memFree=29966792/32770624 swapFree=67001568/67108860
[pid=24907] ppid=24904 vsize=2246524 memory=234060 CPUtime=2400.04 cores=0,2,4,6
/proc/24907/stat : 24907 (xcsp_picat) R 24904 24907 22075 0 -1 4202496 239717 0 0 0 239660 344 0 0 20 0 1 0 409633237 2300440576 58515 33554432000 4194304 5870510 140724237945888 140724237944328 5258727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7970040 9572284 24035328 140724237952031 140724237952109 140724237952109 140724237955018 0
/proc/24907/statm: 561631 58515 1008 410 0 557104 0
Current children cumulated CPU time: 2400.04 s
Current children cumulated vsize: 2246524 KiB
Current children cumulated memory: 234060 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2399.9
CPU time (s): 2400.05
CPU user time (s): 2396.6
CPU system time (s): 3.45024
CPU usage (%): 100.006
Max. virtual memory (cumulated for all children) (KiB): 2295232
Max. memory (cumulated for all children) (KiB): 248620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2396.6
system time used= 3.45024
maximum resident set size= 271600
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 239717
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20
involuntary context switches= 2680


# summary of solver processes directly reported to runsolver:
#   pid: 24907
#   total CPU time (s): 2400.05
#   total CPU user time (s): 2396.6
#   total CPU system time (s): 3.45024

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.53164 second user time and 17.7717 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-13 02:16:42
IDJOB=4395711
IDBENCH=124450
IDSOLVER=2845
FILE ID=node136/4395711-1568333846
RUNJOBID= node136-1568323423-22106
PBS_JOBID= 21701143
Free space on /tmp= 56788 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/Vrp/Vrp-zinc-s1/Vrp-A-n38-k5.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4395711-1568333846/watcher-4395711-1568333846 -o /tmp/evaluation-result-4395711-1568333846/solver-4395711-1568333846 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568323423-22106 --watchdog 2560  xcsp_picat HOME/instance-4395711-1568333846.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 681710e79c8377b968f88ec392af942b
RANDOM SEED=1220525696

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29575776 kB
MemAvailable:   31114120 kB
Buffers:           67600 kB
Cached:          1752140 kB
SwapCached:         3788 kB
Active:          1665504 kB
Inactive:         946956 kB
Active(anon):     791212 kB
Inactive(anon):    41884 kB
Active(file):     874292 kB
Inactive(file):   905072 kB
Unevictable:      107452 kB
Mlocked:          107452 kB
SwapTotal:      67108860 kB
SwapFree:       67001536 kB
Dirty:              3252 kB
Writeback:             0 kB
AnonPages:        898076 kB
Mapped:            44548 kB
Shmem:             31436 kB
Slab:             177976 kB
SReclaimable:     149632 kB
SUnreclaim:        28344 kB
KernelStack:        3472 kB
PageTables:         7524 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3202904 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    649216 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 56784 MiB
End job on node136 at 2019-09-13 02:56:42