Trace number 4303165

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.11 2519.96

General information on the benchmark

NameTal/
Tal-09_c18.xml
MD5SUMcfe58506c86657aa9dbb13ad01f0e006
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark86
Best CPU time to get the best result obtained on this benchmark2520.04
Satisfiable
(Un)Satisfiability was proved
Number of variables988
Number of constraints647
Number of domains13
Minimum domain size1
Maximum domain size42
Distribution of domain sizes[{"size":1,"count":165},{"size":2,"count":4},{"size":3,"count":5},{"size":4,"count":6},{"size":5,"count":7},{"size":6,"count":85},{"size":7,"count":9},{"size":8,"count":10},{"size":9,"count":11},{"size":10,"count":78},{"size":11,"count":13},{"size":42,"count":142}]
Minimum variable degree0
Maximum variable degree16
Distribution of variable degrees[{"degree":0,"count":453},{"degree":1,"count":165},{"degree":2,"count":97},{"degree":3,"count":12},{"degree":4,"count":13},{"degree":5,"count":59},{"degree":6,"count":25},{"degree":7,"count":16},{"degree":8,"count":16},{"degree":9,"count":25},{"degree":10,"count":24},{"degree":11,"count":30},{"degree":12,"count":21},{"degree":13,"count":17},{"degree":14,"count":8},{"degree":15,"count":4},{"degree":16,"count":3}]
Minimum constraint arity1
Maximum constraint arity13
Distribution of constraint arities[{"arity":1,"count":179},{"arity":2,"count":208},{"arity":3,"count":68},{"arity":4,"count":14},{"arity":5,"count":24},{"arity":6,"count":23},{"arity":7,"count":22},{"arity":8,"count":21},{"arity":9,"count":22},{"arity":10,"count":21},{"arity":11,"count":15},{"arity":12,"count":20},{"arity":13,"count":10}]
Number of extensional constraints121
Number of intensional constraints506
Distribution of constraint types[{"type":"extension","count":121},{"type":"intension","count":506},{"type":"count","count":20}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (146 MiB free)
  memory of node 1: 16384 MiB (4241 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303165-1533995371/watcher-4303165-1533995371 -o /tmp/evaluation-result-4303165-1533995371/solver-4303165-1533995371 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32497 --watchdog 2580 xcsp_picat HOME/instance-4303165-1533995371.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=921, runsolver pid=918
Current StackSize limit: 8192 KiB


[startup+0.100205 s]*
/proc/loadavg: 2.12 2.15 2.04 3/187 922
/proc/meminfo: memFree=4464956/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=31596 CPUtime=0.09 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 1913 0 0 0 9 0 0 0 20 0 1 0 217100260 2074361856 7899 33554432000 4194304 5849708 140726676524080 140726676524080 4454262 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 7899 622 405 0 503381 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 31596 KiB

[startup+0.209664 s]*
/proc/loadavg: 2.12 2.15 2.04 3/187 922
/proc/meminfo: memFree=4446524/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=50028 CPUtime=0.21 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 1922 0 0 0 20 1 0 0 20 0 1 0 217100260 2074361856 12507 33554432000 4194304 5849708 140726676524080 140726676524080 4516917 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 12507 622 405 0 503381 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 50028 KiB

[startup+0.309545 s]*
/proc/loadavg: 2.12 2.15 2.04 3/187 922
/proc/meminfo: memFree=4432188/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=66412 CPUtime=0.31 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 1930 0 0 0 30 1 0 0 20 0 1 0 217100260 2074361856 16603 33554432000 4194304 5849708 140726676524080 140726676524080 4819848 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 16603 622 405 0 503381 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 66412 KiB

[startup+0.70041 s]
/proc/loadavg: 2.12 2.15 2.04 3/187 922
/proc/meminfo: memFree=4397372/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=131948 CPUtime=0.69 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 1962 0 0 0 67 2 0 0 20 0 1 0 217100260 2074361856 32987 33554432000 4194304 5849708 140726676524080 140726676524080 4484955 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 32987 622 405 0 503381 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 131948 KiB

[startup+1.50032 s]
/proc/loadavg: 2.12 2.15 2.04 3/187 922
/proc/meminfo: memFree=4311356/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=273280 CPUtime=1.49 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 2036 0 0 0 144 5 0 0 20 0 1 0 217100260 2074361856 68320 33554432000 4194304 5849708 140726676524080 140726676523384 4566921 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 68320 626 405 0 503381 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 273280 KiB

[startup+3.10957 s]
/proc/loadavg: 2.03 2.13 2.03 3/187 922
/proc/meminfo: memFree=3959400/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2025744 memory=555904 CPUtime=3.1 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 2317 0 0 0 299 11 0 0 20 0 1 0 217100260 2074361856 138976 33554432000 4194304 5849708 140726676524080 140726676523384 4483306 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 506436 138976 626 405 0 503381 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 555904 KiB

[startup+6.30025 s]
/proc/loadavg: 2.03 2.13 2.03 3/187 922
/proc/meminfo: memFree=3540124/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2056996 memory=1084888 CPUtime=6.29 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 2945 0 0 0 590 39 0 0 20 0 1 0 217100260 2106363904 271222 33554432000 4194304 5849708 140726676524080 140726676523384 4523498 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 514249 271222 626 405 0 511194 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2056996 KiB
Current children cumulated memory: 1084888 KiB

[startup+12.7004 s]
/proc/loadavg: 2.02 2.12 2.03 3/187 922
/proc/meminfo: memFree=2792884/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=2528848 memory=2053496 CPUtime=12.7 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 29643 0 0 0 1169 101 0 0 20 0 1 0 217100260 2589540352 513374 33554432000 4194304 5849708 140726676524080 140726676523400 4488837 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 632212 513374 656 405 0 629157 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 2528848 KiB
Current children cumulated memory: 2053496 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.10 2.03 3/187 922
/proc/meminfo: memFree=240824/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=7576016 memory=5544928 CPUtime=25.48 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 491982 0 0 0 2250 298 0 0 20 0 1 0 217100260 7757840384 1386232 33554432000 4194304 5849708 140726676524080 140726676523080 5267260 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 1894004 1386232 657 405 0 1890949 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 7576016 KiB
Current children cumulated memory: 5544928 KiB

[startup+51.1097 s]
/proc/loadavg: 1.96 2.10 2.03 3/188 931
/proc/meminfo: memFree=251220/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=12192976 memory=12037404 CPUtime=51.09 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 3515640 0 0 0 4200 909 0 0 20 0 1 0 217100260 12485607424 3009351 33554432000 4194304 5849708 140726676524080 140726676523080 5260290 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3048244 3009351 658 405 0 3045189 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 12192976 KiB
Current children cumulated memory: 12037404 KiB

[startup+102.3 s]
/proc/loadavg: 1.92 2.06 2.02 3/189 1000
/proc/meminfo: memFree=4282556/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=12241800 memory=9813964 CPUtime=102.28 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 7621273 0 0 0 8450 1778 0 0 20 0 1 0 217100260 12535603200 2453491 33554432000 4194304 5849708 140726676524080 140726676523080 5269201 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3060450 2453491 658 405 0 3057395 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 12241800 KiB
Current children cumulated memory: 9813964 KiB

[startup+162.3 s]
/proc/loadavg: 1.97 2.05 2.02 3/189 1066
/proc/meminfo: memFree=1730876/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=8354104 memory=7762964 CPUtime=162.29 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 8224252 0 0 0 13993 2236 0 0 20 0 1 0 217100260 8554602496 1940741 33554432000 4194304 5849708 140726676524080 140726676523080 5257119 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2088526 1940741 658 405 0 2085471 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 8354104 KiB
Current children cumulated memory: 7762964 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 2.04 2.02 3/189 1067
/proc/meminfo: memFree=1648612/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=12363872 memory=12211160 CPUtime=222.3 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 8587905 0 0 0 19537 2693 0 0 20 0 1 0 217100260 12660604928 3052790 33554432000 4194304 5849708 140726676524080 140726676523080 5260403 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3090968 3052790 658 405 0 3087913 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 12363872 KiB
Current children cumulated memory: 12211160 KiB

[startup+282.3 s]
/proc/loadavg: 2.04 2.05 2.03 3/189 1068
/proc/meminfo: memFree=8252812/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=8444924 memory=5676840 CPUtime=282.3 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 8973453 0 0 0 25209 3021 0 0 20 0 1 0 217100260 8647602176 1419210 33554432000 4194304 5849708 140726676524080 140726676523048 5249616 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2111231 1419210 658 405 0 2108176 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 8444924 KiB
Current children cumulated memory: 5676840 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.04 2.03 3/188 1070
/proc/meminfo: memFree=1463688/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=12485944 memory=12333056 CPUtime=342.3 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 9266178 0 0 0 30790 3440 0 0 20 0 1 0 217100260 12785606656 3083264 33554432000 4194304 5849708 140726676524080 140726676523080 5260504 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3121486 3083264 658 405 0 3118431 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 12485944 KiB
Current children cumulated memory: 12333056 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.03 2.03 3/187 1071
/proc/meminfo: memFree=8041032/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=8527936 memory=5894184 CPUtime=402.31 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 9555401 0 0 0 36456 3775 0 0 20 0 1 0 217100260 8732606464 1473546 33554432000 4194304 5849708 140726676524080 140726676523048 5249616 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2131984 1473546 658 405 0 2128929 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 8527936 KiB
Current children cumulated memory: 5894184 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/187 1072
/proc/meminfo: memFree=1321780/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=12608012 memory=12456480 CPUtime=462.31 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 9928764 0 0 0 42041 4190 0 0 20 0 1 0 217100260 12910604288 3114120 33554432000 4194304 5849708 140726676524080 140726676523080 5260504 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3152003 3114120 658 405 0 3148948 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 12608012 KiB
Current children cumulated memory: 12456480 KiB


################
# More data... #
################

/proc/921/statm: 3463283 3425215 658 405 0 3460228 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 13853132 KiB
Current children cumulated memory: 13700860 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.02 2.04 3/188 1152
/proc/meminfo: memFree=249544/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=13901960 memory=13749156 CPUtime=1842.41 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 25507389 0 0 0 170060 14181 0 0 20 0 1 0 217100260 14235607040 3437289 33554432000 4194304 5849708 140726676524080 140726676523080 5269624 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3475490 3437289 658 405 0 3472435 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 13901960 KiB
Current children cumulated memory: 13749156 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.02 2.04 3/188 1153
/proc/meminfo: memFree=6819724/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9490824 memory=7307140 CPUtime=1902.42 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 26168980 0 0 0 175614 14628 0 0 20 0 1 0 217100260 9718603776 1826785 33554432000 4194304 5849708 140726676524080 140726676523048 5251189 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2372706 1826785 658 405 0 2369651 0
Current children cumulated CPU time: 1902.42 s
Current children cumulated vsize: 9490824 KiB
Current children cumulated memory: 7307140 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 1155
/proc/meminfo: memFree=5392740/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9524024 memory=8796232 CPUtime=1962.42 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 27000137 0 0 0 181124 15118 0 0 20 0 1 0 217100260 9752600576 2199058 33554432000 4194304 5849708 140726676524080 140726676523048 5249616 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2381006 2199058 658 405 0 2377951 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 9524024 KiB
Current children cumulated memory: 8796232 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 1156
/proc/meminfo: memFree=3247316/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=14072856 memory=11718748 CPUtime=2022.4 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 27445315 0 0 0 186597 15643 0 0 20 0 1 0 217100260 14410604544 2929687 33554432000 4194304 5849708 140726676524080 140726676523080 5269201 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3518214 2929687 658 405 0 3515159 0
Current children cumulated CPU time: 2022.4 s
Current children cumulated vsize: 14072856 KiB
Current children cumulated memory: 11718748 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 1157
/proc/meminfo: memFree=257792/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=14121688 memory=13969336 CPUtime=2082.41 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 28324589 0 0 0 192039 16202 0 0 20 0 1 0 217100260 14460608512 3492334 33554432000 4194304 5849708 140726676524080 140726676523080 5260504 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3530422 3492334 658 405 0 3527367 0
Current children cumulated CPU time: 2082.41 s
Current children cumulated vsize: 14121688 KiB
Current children cumulated memory: 13969336 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 1159
/proc/meminfo: memFree=227104/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=14170512 memory=14017972 CPUtime=2142.41 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 28798351 0 0 0 197636 16605 0 0 20 0 1 0 217100260 14510604288 3504493 33554432000 4194304 5849708 140726676524080 140726676523080 5260297 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3542628 3504493 658 405 0 3539573 0
Current children cumulated CPU time: 2142.41 s
Current children cumulated vsize: 14170512 KiB
Current children cumulated memory: 14017972 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 1160
/proc/meminfo: memFree=209604/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=14219340 memory=14066568 CPUtime=2202.42 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 29266144 0 0 0 203250 16992 0 0 20 0 1 0 217100260 14560604160 3516642 33554432000 4194304 5849708 140726676524080 140726676523080 5260333 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3554835 3516642 658 405 0 3551780 0
Current children cumulated CPU time: 2202.42 s
Current children cumulated vsize: 14219340 KiB
Current children cumulated memory: 14066568 KiB

[startup+2262.3 s]
/proc/loadavg: 2.34 2.09 2.07 3/187 1161
/proc/meminfo: memFree=7990680/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9706648 memory=6464968 CPUtime=2262.42 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 29736132 0 0 0 208867 17375 0 0 20 0 1 0 217100260 9939607552 1616242 33554432000 4194304 5849708 140726676524080 140726676523048 5249616 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2426662 1616242 658 405 0 2423607 0
Current children cumulated CPU time: 2262.42 s
Current children cumulated vsize: 9706648 KiB
Current children cumulated memory: 6464968 KiB

[startup+2322.3 s]
/proc/loadavg: 2.32 2.15 2.09 3/187 1163
/proc/meminfo: memFree=7180328/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9739848 memory=7345816 CPUtime=2322.42 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 30210127 0 0 0 214320 17922 0 0 20 0 1 0 217100260 9973604352 1836454 33554432000 4194304 5849708 140726676524080 140726676523048 5249616 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2434962 1836454 658 405 0 2431907 0
Current children cumulated CPU time: 2322.42 s
Current children cumulated vsize: 9739848 KiB
Current children cumulated memory: 7345816 KiB

[startup+2382.3 s]
/proc/loadavg: 2.12 2.12 2.08 3/187 1164
/proc/meminfo: memFree=5963308/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9773048 memory=8570716 CPUtime=2382.43 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 30811748 0 0 0 219866 18377 0 0 20 0 1 0 217100260 10007601152 2142679 33554432000 4194304 5849708 140726676524080 140726676523048 5251189 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2443262 2142679 658 405 0 2440207 0
Current children cumulated CPU time: 2382.43 s
Current children cumulated vsize: 9773048 KiB
Current children cumulated memory: 8570716 KiB

[startup+2442.3 s]
/proc/loadavg: 2.05 2.10 2.08 3/188 1173
/proc/meminfo: memFree=4964112/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9806252 memory=9611312 CPUtime=2442.44 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 31459434 0 0 0 225443 18801 0 0 20 0 1 0 217100260 10041602048 2402828 33554432000 4194304 5849708 140726676524080 140726676523048 5250895 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2451563 2402828 658 405 0 2448508 0
Current children cumulated CPU time: 2442.44 s
Current children cumulated vsize: 9806252 KiB
Current children cumulated memory: 9611312 KiB

[startup+2502.3 s]
/proc/loadavg: 2.32 2.15 2.10 3/188 1174
/proc/meminfo: memFree=2626052/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=14487896 memory=12686804 CPUtime=2502.44 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 32575308 0 0 0 230902 19342 0 0 20 0 1 0 217100260 14835605504 3171701 33554432000 4194304 5849708 140726676524080 140726676523080 5269201 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 3621974 3171701 658 405 0 3618919 0
Current children cumulated CPU time: 2502.44 s
Current children cumulated vsize: 14487896 KiB
Current children cumulated memory: 12686804 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.60 2.22 2.12 3/188 1175
/proc/meminfo: memFree=7997888/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9856060 memory=6840412 CPUtime=2520.04 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 32871517 0 0 0 232576 19428 0 0 20 0 1 0 217100260 10092605440 1710103 33554432000 4194304 5849708 140726676524080 140726676523048 5251189 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2464015 1710103 658 405 0 2460960 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 9856060 KiB
Current children cumulated memory: 6840412 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.96 s]
# the end of solver process 921 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2325.77 s, system=194.345 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.60 2.22 2.12 3/188 1175
/proc/meminfo: memFree=7997888/32770624 swapFree=67108504/67108860
[pid=921] ppid=918 vsize=9856060 memory=6840412 CPUtime=2520.04 cores=0,2,4,6
/proc/921/stat : 921 (xcsp_picat) R 918 921 32466 0 -1 4202496 32871517 0 0 0 232576 19428 0 0 20 0 1 0 217100260 10092605440 1710103 33554432000 4194304 5849708 140726676524080 140726676523048 5251189 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 38850560 140726676526262 140726676526340 140726676526340 140726676529098 0
/proc/921/statm: 2464015 1710103 658 405 0 2460960 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 9856060 KiB
Current children cumulated memory: 6840412 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.96
CPU time (s): 2520.11
CPU user time (s): 2325.77
CPU system time (s): 194.345
CPU usage (%): 100.006
Max. virtual memory (cumulated for all children) (KiB): 14487896
Max. memory (cumulated for all children) (KiB): 14334180

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2325.77
system time used= 194.345
maximum resident set size= 14334180
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32871518
page faults= 0
swaps= 0
block input operations= 0
block output operations= 16
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 44
involuntary context switches= 3896


# summary of solver processes directly reported to runsolver:
#   pid: 921
#   total CPU time (s): 2520.11
#   total CPU user time (s): 2325.77
#   total CPU system time (s): 194.345

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.8254 second user time and 18.7205 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-11 15:49:31
IDJOB=4303165
IDBENCH=141107
IDSOLVER=2778
FILE ID=node104/4303165-1533995371
RUNJOBID= node104-1533991815-32497
PBS_JOBID= 21036946
Free space on /tmp= 37256 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/Tal/Tal-09_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303165-1533995371/watcher-4303165-1533995371 -o /tmp/evaluation-result-4303165-1533995371/solver-4303165-1533995371 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32497 --watchdog 2580  xcsp_picat HOME/instance-4303165-1533995371.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cfe58506c86657aa9dbb13ad01f0e006
RANDOM SEED=1348737561

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:         4494444 kB
MemAvailable:   30343548 kB
Buffers:          189412 kB
Cached:         25551784 kB
SwapCached:            8 kB
Active:         10203840 kB
Inactive:       17149800 kB
Active(anon):    1564000 kB
Inactive(anon):   100928 kB
Active(file):    8639840 kB
Inactive(file): 17048872 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:              3500 kB
Writeback:             0 kB
AnonPages:       1626040 kB
Mapped:            53076 kB
Shmem:             49636 kB
Slab:             617616 kB
SReclaimable:     588852 kB
SUnreclaim:        28764 kB
KernelStack:        3328 kB
PageTables:         8524 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3237624 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1544192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 37252 MiB
End job on node104 at 2018-08-11 16:31:31