Trace number 4303205

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.08 2520.05

General information on the benchmark

NameMario/
Mario-t-hard-5_c18.xml
MD5SUM4de37f7087aa8e77bde3fd457ed5d54a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4482
Best CPU time to get the best result obtained on this benchmark3.6868
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints201
Number of domains166
Minimum domain size1
Maximum domain size100
Distribution of domain sizes[{"size":1,"count":5},{"size":2,"count":95},{"size":83,"count":1},{"size":85,"count":1},{"size":86,"count":3},{"size":87,"count":3},{"size":88,"count":8},{"size":89,"count":19},{"size":90,"count":19},{"size":91,"count":8},{"size":92,"count":17},{"size":93,"count":12},{"size":94,"count":3},{"size":95,"count":3},{"size":96,"count":1},{"size":97,"count":2},{"size":100,"count":100}]
Minimum variable degree1
Maximum variable degree3
Distribution of variable degrees[{"degree":1,"count":2},{"degree":2,"count":199},{"degree":3,"count":99}]
Minimum constraint arity1
Maximum constraint arity100
Distribution of constraint arities[{"arity":1,"count":1},{"arity":2,"count":198},{"arity":100,"count":2}]
Number of extensional constraints100
Number of intensional constraints99
Distribution of constraint types[{"type":"extension","count":100},{"type":"intension","count":99},{"type":"sum","count":1},{"type":"circuit","count":1}]
Optimization problemYES
Type of objectivemax SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6254 MiB free)
  memory of node 1: 16384 MiB (5487 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303205-1534021117/watcher-4303205-1534021117 -o /tmp/evaluation-result-4303205-1534021117/solver-4303205-1534021117 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1533993477-10116 --watchdog 2580 xcsp_picat HOME/instance-4303205-1534021117.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=13376, runsolver pid=13373
Current StackSize limit: 8192 KiB


[startup+0.100165 s]*
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11995904/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2025744 memory=32076 CPUtime=0.1 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 1536 0 0 0 10 0 0 0 20 0 1 0 219674869 2074361856 8019 33554432000 4194304 5849708 140721297565840 140721297565144 4877911 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 506436 8019 607 405 0 503381 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 32076 KiB

[startup+0.209721 s]*
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11977472/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2025744 memory=50508 CPUtime=0.21 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 1545 0 0 0 21 0 0 0 20 0 1 0 219674869 2074361856 12627 33554432000 4194304 5849708 140721297565840 140721297565144 4488834 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 506436 12627 607 405 0 503381 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 50508 KiB

[startup+0.309549 s]*
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11958916/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2025744 memory=68940 CPUtime=0.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 1554 0 0 0 30 1 0 0 20 0 1 0 219674869 2074361856 17235 33554432000 4194304 5849708 140721297565840 140721297565144 4484070 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 506436 17235 607 405 0 503381 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 68940 KiB

[startup+0.700384 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11921872/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2105408 memory=116724 CPUtime=0.69 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3772 0 0 0 68 1 0 0 20 0 1 0 219674869 2155937792 29181 33554432000 4194304 5849708 140721297565840 140721297565144 5251189 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 526352 29181 624 405 0 523297 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2105408 KiB
Current children cumulated memory: 116724 KiB

[startup+1.50038 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11891276/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2147840 memory=193872 CPUtime=1.49 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 5430 0 0 0 145 4 0 0 20 0 1 0 219674869 2199388160 48468 33554432000 4194304 5849708 140721297565840 140721297564808 5249616 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 536960 48468 624 405 0 533905 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2147840 KiB
Current children cumulated memory: 193872 KiB

[startup+3.10962 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11750280/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2198792 memory=299096 CPUtime=3.1 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 9056 0 0 0 299 11 0 0 20 0 1 0 219674869 2251563008 74774 33554432000 4194304 5849708 140721297565840 140721297564808 4509462 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 549698 74774 624 405 0 546643 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2198792 KiB
Current children cumulated memory: 299096 KiB

[startup+6.30034 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11356084/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2232064 memory=733704 CPUtime=6.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 11088 0 0 0 607 22 0 0 20 0 1 0 219674869 2285633536 183426 33554432000 4194304 5849708 140721297565840 140721297565144 4464004 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 558016 183426 652 405 0 554961 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2232064 KiB
Current children cumulated memory: 733704 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 13377
/proc/meminfo: memFree=11036196/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2391488 memory=987996 CPUtime=12.69 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 14916 0 0 0 1231 38 0 0 20 0 1 0 219674869 2448883712 246999 33554432000 4194304 5849708 140721297565840 140721297564328 5319352 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 597872 246999 746 405 0 594817 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2391488 KiB
Current children cumulated memory: 987996 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 13377
/proc/meminfo: memFree=11015908/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2411632 memory=1008160 CPUtime=25.5 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 28413 0 0 0 2507 43 0 0 20 0 1 0 219674869 2469511168 252040 33554432000 4194304 5849708 140721297565840 140721297564712 5399744 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 602908 252040 755 405 0 599853 0
Current children cumulated CPU time: 25.5 s
Current children cumulated vsize: 2411632 KiB
Current children cumulated memory: 1008160 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 13377
/proc/meminfo: memFree=10991356/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2436248 memory=1032776 CPUtime=51.1 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 63409 0 0 0 5055 55 0 0 20 0 1 0 219674869 2494717952 258194 33554432000 4194304 5849708 140721297565840 140721297564568 5361361 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 609062 258194 755 405 0 606007 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2436248 KiB
Current children cumulated memory: 1032776 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 13386
/proc/meminfo: memFree=10950436/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2476704 memory=1073088 CPUtime=102.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 89314 0 0 0 10150 79 0 0 20 0 1 0 219674869 2536144896 268272 33554432000 4194304 5849708 140721297565840 140721297564712 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 619176 268272 755 405 0 616121 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 2476704 KiB
Current children cumulated memory: 1073088 KiB

[startup+162.3 s]
/proc/loadavg: 1.95 2.01 2.04 3/188 13470
/proc/meminfo: memFree=11204596/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2478860 memory=1075384 CPUtime=162.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 148072 0 0 0 16115 114 0 0 20 0 1 0 219674869 2538352640 268846 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 619715 268846 755 405 0 616660 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2478860 KiB
Current children cumulated memory: 1075384 KiB

[startup+222.3 s]
/proc/loadavg: 1.98 2.01 2.04 3/188 13471
/proc/meminfo: memFree=11148468/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2529668 memory=1126084 CPUtime=222.28 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 183659 0 0 0 22075 153 0 0 20 0 1 0 219674869 2590380032 281521 33554432000 4194304 5849708 140721297565840 140721297564840 5307573 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 632417 281521 755 405 0 629362 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2529668 KiB
Current children cumulated memory: 1126084 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/188 13472
/proc/meminfo: memFree=11118696/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2548428 memory=1144740 CPUtime=282.28 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 217410 0 0 0 28038 190 0 0 20 0 1 0 219674869 2609590272 286185 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 637107 286185 755 405 0 634052 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2548428 KiB
Current children cumulated memory: 1144740 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 13473
/proc/meminfo: memFree=11146300/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2541392 memory=1137732 CPUtime=342.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 245464 0 0 0 34004 225 0 0 20 0 1 0 219674869 2602385408 284433 33554432000 4194304 5849708 140721297565840 140721297564840 5307613 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 635348 284433 755 405 0 632293 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2541392 KiB
Current children cumulated memory: 1137732 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 13474
/proc/meminfo: memFree=11014468/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2643668 memory=1241732 CPUtime=402.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 279315 0 0 0 39972 257 0 0 20 0 1 0 219674869 2707116032 310433 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 660917 310433 755 405 0 657862 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2643668 KiB
Current children cumulated memory: 1241732 KiB

[startup+462.3 s]
/proc/loadavg: 1.96 1.99 2.03 3/187 13599
/proc/meminfo: memFree=11052496/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2633548 memory=1233656 CPUtime=462.29 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 321953 0 0 0 45936 293 0 0 20 0 1 0 219674869 2696753152 308414 33554432000 4194304 5849708 140721297565840 140721297564840 5399567 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 658387 308414 755 405 0 655332 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2633548 KiB
Current children cumulated memory: 1233656 KiB


################
# More data... #
################

/proc/13376/statm: 802315 452342 755 405 0 799260 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 3209260 KiB
Current children cumulated memory: 1809368 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 13640
/proc/meminfo: memFree=10366384/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3209260 memory=1809368 CPUtime=1782.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 2481866 0 0 0 177214 1017 0 0 20 0 1 0 219674869 3286282240 452342 33554432000 4194304 5849708 140721297565840 140721297564712 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 802315 452342 755 405 0 799260 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 3209260 KiB
Current children cumulated memory: 1809368 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 13641
/proc/meminfo: memFree=10138248/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3440524 memory=2040632 CPUtime=1842.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 2572362 0 0 0 183193 1038 0 0 20 0 1 0 219674869 3523096576 510158 33554432000 4194304 5849708 140721297565840 140721297564712 5395639 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 860131 510158 755 405 0 857076 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 3440524 KiB
Current children cumulated memory: 2040632 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13650
/proc/meminfo: memFree=9889600/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3654616 memory=2254724 CPUtime=1902.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 2690279 0 0 0 189156 1075 0 0 20 0 1 0 219674869 3742326784 563681 33554432000 4194304 5849708 140721297565840 140721297564840 5312614 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 913654 563681 755 405 0 910599 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 3654616 KiB
Current children cumulated memory: 2254724 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13651
/proc/meminfo: memFree=9890504/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3654616 memory=2254724 CPUtime=1962.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 2813547 0 0 0 195140 1092 0 0 20 0 1 0 219674869 3742326784 563681 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 913654 563681 755 405 0 910599 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 3654616 KiB
Current children cumulated memory: 2254724 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13652
/proc/meminfo: memFree=9824544/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3720144 memory=2320252 CPUtime=2022.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 2948873 0 0 0 201116 1115 0 0 20 0 1 0 219674869 3809427456 580063 33554432000 4194304 5849708 140721297565840 140721297564712 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 930036 580063 755 405 0 926981 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 3720144 KiB
Current children cumulated memory: 2320252 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13653
/proc/meminfo: memFree=10573436/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=2972292 memory=1572400 CPUtime=2082.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3073493 0 0 0 207092 1139 0 0 20 0 1 0 219674869 3043627008 393100 33554432000 4194304 5849708 140721297565840 140721297564712 5303184 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 743073 393100 755 405 0 740018 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 2972292 KiB
Current children cumulated memory: 1572400 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 13654
/proc/meminfo: memFree=10219184/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3268488 memory=1868596 CPUtime=2142.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3244376 0 0 0 213062 1170 0 0 20 0 1 0 219674869 3346931712 467149 33554432000 4194304 5849708 140721297565840 140721297564712 5397395 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 817122 467149 755 405 0 814067 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 3268488 KiB
Current children cumulated memory: 1868596 KiB

[startup+2202.3 s]
/proc/loadavg: 2.66 2.18 2.10 3/187 13655
/proc/meminfo: memFree=9899344/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3587208 memory=2187312 CPUtime=2202.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3377219 0 0 0 219039 1192 0 0 20 0 1 0 219674869 3673300992 546828 33554432000 4194304 5849708 140721297565840 140721297564840 5312612 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 896802 546828 755 405 0 893747 0
Current children cumulated CPU time: 2202.31 s
Current children cumulated vsize: 3587208 KiB
Current children cumulated memory: 2187312 KiB

[startup+2262.3 s]
/proc/loadavg: 2.24 2.14 2.09 3/187 13656
/proc/meminfo: memFree=9959572/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3587208 memory=2187312 CPUtime=2262.31 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3546561 0 0 0 225017 1214 0 0 20 0 1 0 219674869 3673300992 546828 33554432000 4194304 5849708 140721297565840 140721297564840 5307573 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 896802 546828 755 405 0 893747 0
Current children cumulated CPU time: 2262.31 s
Current children cumulated vsize: 3587208 KiB
Current children cumulated memory: 2187312 KiB

[startup+2322.3 s]
/proc/loadavg: 2.15 2.13 2.09 3/187 13657
/proc/meminfo: memFree=9959324/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3587208 memory=2187312 CPUtime=2322.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3657264 0 0 0 230994 1238 0 0 20 0 1 0 219674869 3673300992 546828 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 896802 546828 755 405 0 893747 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 3587208 KiB
Current children cumulated memory: 2187312 KiB

[startup+2382.3 s]
/proc/loadavg: 2.05 2.11 2.08 3/187 13658
/proc/meminfo: memFree=9392652/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=4152764 memory=2752872 CPUtime=2382.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3842547 0 0 0 236953 1279 0 0 20 0 1 0 219674869 4252430336 688218 33554432000 4194304 5849708 140721297565840 140721297564840 5437714 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 1038191 688218 755 405 0 1035136 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 4152764 KiB
Current children cumulated memory: 2752872 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/187 13659
/proc/meminfo: memFree=9393024/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=4152764 memory=2752872 CPUtime=2442.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 3972294 0 0 0 242930 1302 0 0 20 0 1 0 219674869 4252430336 688218 33554432000 4194304 5849708 140721297565840 140721297564712 5397376 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 1038191 688218 755 405 0 1035136 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 4152764 KiB
Current children cumulated memory: 2752872 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/188 13668
/proc/meminfo: memFree=8970512/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=4525120 memory=3125228 CPUtime=2502.32 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 4142720 0 0 0 248891 1341 0 0 20 0 1 0 219674869 4633722880 781307 33554432000 4194304 5849708 140721297565840 140721297564840 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 1131280 781307 755 405 0 1128225 0
Current children cumulated CPU time: 2502.32 s
Current children cumulated vsize: 4525120 KiB
Current children cumulated memory: 3125228 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.07 2.07 3/188 13669
/proc/meminfo: memFree=9864612/32770624 swapFree=67108496/67108860
[pid=13376] ppid=13373 vsize=3634040 memory=2234148 CPUtime=2520.03 cores=1,3,5,7
/proc/13376/stat : 13376 (xcsp_picat) R 13373 13376 10084 0 -1 4202496 4294934 0 0 0 250637 1366 0 0 20 0 1 0 219674869 3721256960 558537 33554432000 4194304 5849708 140721297565840 140721297564712 140518565740423 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 22921216 140721297573046 140721297573124 140721297573124 140721297575882 0
/proc/13376/statm: 908510 558537 755 405 0 905455 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 3634040 KiB
Current children cumulated memory: 2234148 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.05 s]
# the end of solver process 13376 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.38 s, system=13.7012 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.05
CPU time (s): 2520.08
CPU user time (s): 2506.38
CPU system time (s): 13.7012
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 4656192
Max. memory (cumulated for all children) (KiB): 3256300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.38
system time used= 13.7012
maximum resident set size= 3256300
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4294934
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23
involuntary context switches= 1003


# summary of solver processes directly reported to runsolver:
#   pid: 13376
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2506.38
#   total CPU system time (s): 13.7012

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.52343 second user time and 18.2997 second system time

The end

Launcher Data 

Begin job on node149 at 2018-08-11 22:58:37
IDJOB=4303205
IDBENCH=141524
IDSOLVER=2778
FILE ID=node149/4303205-1534021117
RUNJOBID= node149-1533993477-10116
PBS_JOBID= 21036951
Free space on /tmp= 38800 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/Mario/Mario-t-hard-5_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303205-1534021117/watcher-4303205-1534021117 -o /tmp/evaluation-result-4303205-1534021117/solver-4303205-1534021117 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1533993477-10116 --watchdog 2580  xcsp_picat HOME/instance-4303205-1534021117.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4de37f7087aa8e77bde3fd457ed5d54a
RANDOM SEED=768283002

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        12023872 kB
MemAvailable:   31588220 kB
Buffers:          153212 kB
Cached:         19424984 kB
SwapCached:           28 kB
Active:          8080784 kB
Inactive:       11869372 kB
Active(anon):     318864 kB
Inactive(anon):   104724 kB
Active(file):    7761920 kB
Inactive(file): 11764648 kB
Unevictable:        7604 kB
Mlocked:            7604 kB
SwapTotal:      67108860 kB
SwapFree:       67108496 kB
Dirty:              3132 kB
Writeback:             0 kB
AnonPages:        403180 kB
Mapped:            55844 kB
Shmem:             49616 kB
Slab:             494484 kB
SReclaimable:     466240 kB
SUnreclaim:        28244 kB
KernelStack:        3360 kB
PageTables:         5944 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2680220 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    288768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 38800 MiB
End job on node149 at 2018-08-11 23:40:37