Trace number 4303047

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.02 2520.01

General information on the benchmark

NameTravellingSalesman/
TravellingSalesman-75-50-00_c18.xml
MD5SUM7fcf74bccc1d4f399a3457b4fd80f100
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark357
Best CPU time to get the best result obtained on this benchmark2519.91
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of constraints76
Number of domains2
Minimum domain size59
Maximum domain size75
Distribution of domain sizes[{"size":59,"count":75},{"size":75,"count":75}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":75},{"degree":3,"count":75}]
Minimum constraint arity3
Maximum constraint arity75
Distribution of constraint arities[{"arity":3,"count":75},{"arity":75,"count":1}]
Number of extensional constraints75
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":75},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14487 MiB free)
  memory of node 1: 16384 MiB (13821 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303047-1534030441/watcher-4303047-1534030441 -o /tmp/evaluation-result-4303047-1534030441/solver-4303047-1534030441 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1534025399-15093 --watchdog 2580 xcsp_picat HOME/instance-4303047-1534030441.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=15685, runsolver pid=15682
Current StackSize limit: 8192 KiB


[startup+0.100167 s]*
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28966932/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2025744 memory=24944 CPUtime=0.1 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 1840 0 0 0 10 0 0 0 20 0 1 0 220607297 2074361856 6236 33554432000 4194304 5849708 140731215076368 140731215076368 4494186 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 506436 6236 600 405 0 503381 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 24944 KiB

[startup+0.209884 s]*
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28949680/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2025744 memory=40552 CPUtime=0.21 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 2107 0 0 0 21 0 0 0 20 0 1 0 220607297 2074361856 10138 33554432000 4194304 5849708 140731215076368 140731215076368 4543927 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 506436 10138 641 405 0 503381 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 40552 KiB

[startup+0.309768 s]*
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28940744/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2026488 memory=49776 CPUtime=0.31 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 2436 0 0 0 30 1 0 0 20 0 1 0 220607297 2075123712 12444 33554432000 4194304 5849708 140731215076368 140731215076368 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 506622 12444 704 405 0 503567 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2026488 KiB
Current children cumulated memory: 49776 KiB

[startup+0.700311 s]
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28940744/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2028284 memory=51592 CPUtime=0.69 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 2886 0 0 0 67 2 0 0 20 0 1 0 220607297 2076962816 12898 33554432000 4194304 5849708 140731215076368 140731215076368 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 507071 12898 706 405 0 504016 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2028284 KiB
Current children cumulated memory: 51592 KiB

[startup+1.50029 s]
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28937924/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2032508 memory=55808 CPUtime=1.49 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 3942 0 0 0 143 6 0 0 20 0 1 0 220607297 2081288192 13952 33554432000 4194304 5849708 140731215076368 140731215075480 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 508127 13952 706 405 0 505072 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2032508 KiB
Current children cumulated memory: 55808 KiB

[startup+3.10959 s]
/proc/loadavg: 2.49 2.20 2.09 3/188 15686
/proc/meminfo: memFree=28928188/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2038780 memory=62208 CPUtime=3.1 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 5575 0 0 0 299 11 0 0 20 0 1 0 220607297 2087710720 15552 33554432000 4194304 5849708 140731215076368 140731215075480 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 509695 15552 706 405 0 506640 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2038780 KiB
Current children cumulated memory: 62208 KiB

[startup+6.30027 s]
/proc/loadavg: 2.37 2.18 2.08 3/188 15686
/proc/meminfo: memFree=28915564/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2051068 memory=74496 CPUtime=6.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 7455 0 0 0 608 21 0 0 20 0 1 0 220607297 2100293632 18624 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 512767 18624 706 405 0 509712 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2051068 KiB
Current children cumulated memory: 74496 KiB

[startup+12.7003 s]
/proc/loadavg: 2.34 2.18 2.08 3/188 15686
/proc/meminfo: memFree=28890496/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2109152 memory=132580 CPUtime=12.69 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 10514 0 0 0 1225 44 0 0 20 0 1 0 220607297 2159771648 33145 33554432000 4194304 5849708 140731215076368 140731215075608 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 527288 33145 706 405 0 524233 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2109152 KiB
Current children cumulated memory: 132580 KiB

[startup+25.5003 s]
/proc/loadavg: 2.27 2.17 2.08 3/188 15686
/proc/meminfo: memFree=28752360/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2214320 memory=237664 CPUtime=25.49 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 28842 0 0 0 2479 70 0 0 20 0 1 0 220607297 2267463680 59416 33554432000 4194304 5849708 140731215076368 140731215074856 5319730 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 553580 59416 733 405 0 550525 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2214320 KiB
Current children cumulated memory: 237664 KiB

[startup+51.1097 s]
/proc/loadavg: 2.18 2.15 2.08 3/188 15686
/proc/meminfo: memFree=28669592/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2198528 memory=221856 CPUtime=51.09 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 56636 0 0 0 5035 74 0 0 20 0 1 0 220607297 2251292672 55464 33554432000 4194304 5849708 140731215076368 140731215075528 5362122 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 549632 55464 740 405 0 546577 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2198528 KiB
Current children cumulated memory: 221856 KiB

[startup+102.3 s]
/proc/loadavg: 2.08 2.13 2.07 3/187 15687
/proc/meminfo: memFree=28639088/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2265800 memory=289120 CPUtime=102.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 103848 0 0 0 10076 152 0 0 20 0 1 0 220607297 2320179200 72280 33554432000 4194304 5849708 140731215076368 140731215074776 5319749 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 566450 72280 749 405 0 563395 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2265800 KiB
Current children cumulated memory: 289120 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.11 2.07 3/187 15688
/proc/meminfo: memFree=28661604/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2211548 memory=235024 CPUtime=162.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 129745 0 0 0 16051 177 0 0 20 0 1 0 220607297 2264625152 58756 33554432000 4194304 5849708 140731215076368 140731215074856 4235047 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 552887 58756 749 405 0 549832 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2211548 KiB
Current children cumulated memory: 235024 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.09 2.06 3/187 15750
/proc/meminfo: memFree=29037036/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2161156 memory=184428 CPUtime=222.27 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 164401 0 0 0 22021 206 0 0 20 0 1 0 220607297 2213023744 46107 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 540289 46107 749 405 0 537234 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2161156 KiB
Current children cumulated memory: 184428 KiB

[startup+282.3 s]
/proc/loadavg: 2.06 2.09 2.06 3/187 15751
/proc/meminfo: memFree=28941316/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2230396 memory=251616 CPUtime=282.25 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 169102 0 0 0 27989 236 0 0 20 0 1 0 220607297 2283925504 62904 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 557599 62904 749 405 0 554544 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 2230396 KiB
Current children cumulated memory: 251616 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.07 2.06 3/187 15752
/proc/meminfo: memFree=28975152/32770624 swapFree=67030636/67108860
[pid=15685] ppid=15682 vsize=2164664 memory=188492 CPUtime=342.24 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 175676 0 0 0 33957 267 0 0 20 0 1 0 220607297 2216615936 47123 33554432000 4194304 5849708 140731215076368 140731215075368 5312898 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 541166 47123 749 405 0 538111 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 2164664 KiB
Current children cumulated memory: 188492 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.06 2.05 4/188 15760
/proc/meminfo: memFree=28870508/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2245820 memory=268044 CPUtime=402.24 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 179437 0 0 0 39923 301 0 0 20 0 1 0 220607297 2299719680 67011 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 561455 67011 749 405 0 558400 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 2245820 KiB
Current children cumulated memory: 268044 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 15760
/proc/meminfo: memFree=28853132/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2245668 memory=267892 CPUtime=462.25 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 184473 0 0 0 45898 327 0 0 20 0 1 0 220607297 2299564032 66973 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 561417 66973 749 405 0 558362 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 2245668 KiB
Current children cumulated memory: 267892 KiB


################
# More data... #
################

/proc/15685/statm: 565939 72414 749 405 0 562884 0
Current children cumulated CPU time: 1722.28 s
Current children cumulated vsize: 2263756 KiB
Current children cumulated memory: 289656 KiB

[startup+1782.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/189 15826
/proc/meminfo: memFree=28545368/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2263756 memory=289776 CPUtime=1782.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 323148 0 0 0 177226 1002 0 0 20 0 1 0 220607297 2318086144 72444 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 565939 72444 749 405 0 562884 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 2263756 KiB
Current children cumulated memory: 289776 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/189 15827
/proc/meminfo: memFree=28545564/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2263536 memory=289556 CPUtime=1842.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 331537 0 0 0 183200 1028 0 0 20 0 1 0 220607297 2317860864 72389 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 565884 72389 749 405 0 562829 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 2263536 KiB
Current children cumulated memory: 289556 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 15828
/proc/meminfo: memFree=28524364/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2285008 memory=310908 CPUtime=1902.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 341401 0 0 0 189168 1060 0 0 20 0 1 0 220607297 2339848192 77727 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 571252 77727 749 405 0 568197 0
Current children cumulated CPU time: 1902.28 s
Current children cumulated vsize: 2285008 KiB
Current children cumulated memory: 310908 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15829
/proc/meminfo: memFree=28570212/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2238832 memory=264852 CPUtime=1962.28 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 358349 0 0 0 195133 1095 0 0 20 0 1 0 220607297 2292563968 66213 33554432000 4194304 5849708 140731215076368 140731215075528 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 559708 66213 749 405 0 556653 0
Current children cumulated CPU time: 1962.28 s
Current children cumulated vsize: 2238832 KiB
Current children cumulated memory: 264852 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15830
/proc/meminfo: memFree=28413956/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304256 memory=330276 CPUtime=2022.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 366804 0 0 0 201106 1123 0 0 20 0 1 0 220607297 2359558144 82569 33554432000 4194304 5849708 140731215076368 140731215075528 5437714 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576064 82569 749 405 0 573009 0
Current children cumulated CPU time: 2022.29 s
Current children cumulated vsize: 2304256 KiB
Current children cumulated memory: 330276 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15831
/proc/meminfo: memFree=28414140/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304256 memory=330276 CPUtime=2082.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 375833 0 0 0 207073 1156 0 0 20 0 1 0 220607297 2359558144 82569 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576064 82569 749 405 0 573009 0
Current children cumulated CPU time: 2082.29 s
Current children cumulated vsize: 2304256 KiB
Current children cumulated memory: 330276 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15832
/proc/meminfo: memFree=28320256/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2238720 memory=264740 CPUtime=2142.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 384910 0 0 0 213045 1184 0 0 20 0 1 0 220607297 2292449280 66185 33554432000 4194304 5849708 140731215076368 140731215075240 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 559680 66185 749 405 0 556625 0
Current children cumulated CPU time: 2142.29 s
Current children cumulated vsize: 2238720 KiB
Current children cumulated memory: 264740 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 15841
/proc/meminfo: memFree=28319540/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304124 memory=330144 CPUtime=2202.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 395539 0 0 0 219010 1219 0 0 20 0 1 0 220607297 2359422976 82536 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576031 82536 749 405 0 572976 0
Current children cumulated CPU time: 2202.29 s
Current children cumulated vsize: 2304124 KiB
Current children cumulated memory: 330144 KiB

[startup+2262.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 15842
/proc/meminfo: memFree=28622888/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304124 memory=330144 CPUtime=2262.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 399913 0 0 0 224979 1250 0 0 20 0 1 0 220607297 2359422976 82536 33554432000 4194304 5849708 140731215076368 140731215075528 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576031 82536 749 405 0 572976 0
Current children cumulated CPU time: 2262.29 s
Current children cumulated vsize: 2304124 KiB
Current children cumulated memory: 330144 KiB

[startup+2322.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/188 15843
/proc/meminfo: memFree=28617564/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304124 memory=330144 CPUtime=2322.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 406614 0 0 0 230949 1280 0 0 20 0 1 0 220607297 2359422976 82536 33554432000 4194304 5849708 140731215076368 140731215075528 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576031 82536 749 405 0 572976 0
Current children cumulated CPU time: 2322.29 s
Current children cumulated vsize: 2304124 KiB
Current children cumulated memory: 330144 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 15844
/proc/meminfo: memFree=28599572/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2304124 memory=330144 CPUtime=2382.3 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 416875 0 0 0 236921 1309 0 0 20 0 1 0 220607297 2359422976 82536 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 576031 82536 749 405 0 572976 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 2304124 KiB
Current children cumulated memory: 330144 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 15845
/proc/meminfo: memFree=28569484/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2303928 memory=329948 CPUtime=2442.29 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 424369 0 0 0 242895 1334 0 0 20 0 1 0 220607297 2359222272 82487 33554432000 4194304 5849708 140731215076368 140731215075368 5437650 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 575982 82487 749 405 0 572927 0
Current children cumulated CPU time: 2442.29 s
Current children cumulated vsize: 2303928 KiB
Current children cumulated memory: 329948 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 15846
/proc/meminfo: memFree=28578816/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2238392 memory=264412 CPUtime=2502.3 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 433543 0 0 0 248868 1362 0 0 20 0 1 0 220607297 2292113408 66103 33554432000 4194304 5849708 140731215076368 140731215075368 5312890 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 559598 66103 749 405 0 556543 0
Current children cumulated CPU time: 2502.3 s
Current children cumulated vsize: 2238392 KiB
Current children cumulated memory: 264412 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 15847
/proc/meminfo: memFree=28578376/32770624 swapFree=67030640/67108860
[pid=15685] ppid=15682 vsize=2238392 memory=264412 CPUtime=2520 cores=1,3,5,7
/proc/15685/stat : 15685 (xcsp_picat) R 15682 15685 15061 0 -1 4202496 438781 0 0 0 250630 1370 0 0 20 0 1 0 220607297 2292113408 66103 33554432000 4194304 5849708 140731215076368 140731215075368 140590199578503 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 39096320 140731215082678 140731215082756 140731215082756 140731215085514 0
/proc/15685/statm: 559598 66103 749 405 0 556543 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 2238392 KiB
Current children cumulated memory: 264412 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 15685 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.31 s, system=13.7111 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520.02
CPU user time (s): 2506.31
CPU system time (s): 13.7111
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 2469688
Max. memory (cumulated for all children) (KiB): 495656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.31
system time used= 13.7111
maximum resident set size= 495656
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 438781
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27
involuntary context switches= 1031


# summary of solver processes directly reported to runsolver:
#   pid: 15685
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2506.31
#   total CPU system time (s): 13.7111

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.8613 second user time and 17.3672 second system time

The end

Launcher Data 

Begin job on node102 at 2018-08-12 01:34:01
IDJOB=4303047
IDBENCH=141625
IDSOLVER=2778
FILE ID=node102/4303047-1534030441
RUNJOBID= node102-1534025399-15093
PBS_JOBID= 21036959
Free space on /tmp= 38204 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/TravellingSalesman/TravellingSalesman-75-50-00_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303047-1534030441/watcher-4303047-1534030441 -o /tmp/evaluation-result-4303047-1534030441/solver-4303047-1534030441 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1534025399-15093 --watchdog 2580  xcsp_picat HOME/instance-4303047-1534030441.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7fcf74bccc1d4f399a3457b4fd80f100
RANDOM SEED=1067198880

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28988568 kB
MemAvailable:   31643912 kB
Buffers:           40356 kB
Cached:          2878376 kB
SwapCached:        51268 kB
Active:          1681328 kB
Inactive:        1562660 kB
Active(anon):     249944 kB
Inactive(anon):   126968 kB
Active(file):    1431384 kB
Inactive(file):  1435692 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67030636 kB
Dirty:              3180 kB
Writeback:             0 kB
AnonPages:        294144 kB
Mapped:            51640 kB
Shmem:             48960 kB
Slab:             235860 kB
SReclaimable:     208204 kB
SUnreclaim:        27656 kB
KernelStack:        3584 kB
PageTables:         5372 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2598224 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    249856 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 38204 MiB
End job on node102 at 2018-08-12 02:16:01