Trace number 4309728

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.07 2520.02

General information on the benchmark

NameFrb/
frb-50-23-3-mgd_c18.xml
MD5SUM9221c7b89083fde7801d6d9537c28698
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of constraints456
Number of domains1
Minimum domain size23
Maximum domain size23
Distribution of domain sizes[{"size":23,"count":50}]
Minimum variable degree11
Maximum variable degree24
Distribution of variable degrees[{"degree":11,"count":1},{"degree":14,"count":1},{"degree":15,"count":4},{"degree":16,"count":9},{"degree":17,"count":9},{"degree":18,"count":4},{"degree":19,"count":5},{"degree":20,"count":7},{"degree":21,"count":3},{"degree":22,"count":3},{"degree":23,"count":2},{"degree":24,"count":2}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":456}]
Number of extensional constraints456
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":456}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10686 MiB free)
  memory of node 1: 16384 MiB (12318 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309728-1534314991/watcher-4309728-1534314991 -o /tmp/evaluation-result-4309728-1534314991/solver-4309728-1534314991 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534293202-13750 --watchdog 2580 xcsp_picat HOME/instance-4309728-1534314991.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=16448, runsolver pid=16445

[startup+0.100305 s]*
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23531212/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2025744 memory=32836 CPUtime=0.09 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 1731 0 0 0 9 0 0 0 20 0 1 0 249062330 2074361856 8209 33554432000 4194304 5849940 140726008796064 140726008795432 4839790 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 506436 8209 614 405 0 503380 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 32836 KiB

[startup+0.20966 s]*
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23516616/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2026152 memory=44056 CPUtime=0.21 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 1996 0 0 0 20 1 0 0 20 0 1 0 249062330 2074779648 11014 33554432000 4194304 5849940 140726008796064 140726008795432 140342503448455 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 506538 11014 678 405 0 503482 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2026152 KiB
Current children cumulated memory: 44056 KiB

[startup+0.309422 s]*
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23516368/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2026556 memory=44332 CPUtime=0.31 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 2125 0 0 0 30 1 0 0 20 0 1 0 249062330 2075193344 11083 33554432000 4194304 5849940 140726008796064 140726008795432 140342503448455 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 506639 11083 678 405 0 503583 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2026556 KiB
Current children cumulated memory: 44332 KiB

[startup+0.700225 s]
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23515208/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2027836 memory=45616 CPUtime=0.69 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 2445 0 0 0 68 1 0 0 20 0 1 0 249062330 2076504064 11404 33554432000 4194304 5849940 140726008796064 140726008795304 140342503448455 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 506959 11404 678 405 0 503903 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2027836 KiB
Current children cumulated memory: 45616 KiB

[startup+1.50025 s]
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23513340/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2031384 memory=49348 CPUtime=1.48 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 3543 0 0 0 147 1 0 0 20 0 1 0 249062330 2080137216 12337 33554432000 4194304 5849940 140726008796064 140726008794552 4211654 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 507846 12337 697 405 0 504790 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 2031384 KiB
Current children cumulated memory: 49348 KiB

[startup+3.10892 s]
/proc/loadavg: 2.13 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23510860/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2031384 memory=49428 CPUtime=3.1 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 4363 0 0 0 308 2 0 0 20 0 1 0 249062330 2080137216 12357 33554432000 4194304 5849940 140726008796064 140726008793912 4212035 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 507846 12357 705 405 0 504790 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2031384 KiB
Current children cumulated memory: 49428 KiB

[startup+6.30023 s]
/proc/loadavg: 2.12 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23510488/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2031544 memory=49620 CPUtime=6.29 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 5109 0 0 0 627 2 0 0 20 0 1 0 249062330 2080301056 12405 33554432000 4194304 5849940 140726008796064 140726008793912 4212055 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 507886 12405 705 405 0 504830 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2031544 KiB
Current children cumulated memory: 49620 KiB

[startup+12.7002 s]
/proc/loadavg: 2.11 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23510488/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2031544 memory=49620 CPUtime=12.69 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 6114 0 0 0 1267 2 0 0 20 0 1 0 249062330 2080301056 12405 33554432000 4194304 5849940 140726008796064 140726008793912 4211581 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 507886 12405 705 405 0 504830 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2031544 KiB
Current children cumulated memory: 49620 KiB

[startup+25.5002 s]
/proc/loadavg: 2.09 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23509372/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2032900 memory=50972 CPUtime=25.48 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 8167 0 0 0 2546 2 0 0 20 0 1 0 249062330 2081689600 12743 33554432000 4194304 5849940 140726008796064 140726008794472 4211681 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 508225 12743 705 405 0 505169 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2032900 KiB
Current children cumulated memory: 50972 KiB

[startup+51.109 s]
/proc/loadavg: 2.06 2.04 2.05 3/187 16449
/proc/meminfo: memFree=23509000/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2033368 memory=51416 CPUtime=51.08 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 12167 0 0 0 5103 5 0 0 20 0 1 0 249062330 2082168832 12854 33554432000 4194304 5849940 140726008796064 140726008794472 4212035 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 508342 12854 712 405 0 505286 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 2033368 KiB
Current children cumulated memory: 51416 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/187 16450
/proc/meminfo: memFree=23503164/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2040268 memory=58240 CPUtime=102.27 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 49302 0 0 0 10164 63 0 0 20 0 1 0 249062330 2089234432 14560 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 510067 14560 712 405 0 507011 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 2040268 KiB
Current children cumulated memory: 58240 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 2.01 2.04 3/187 16511
/proc/meminfo: memFree=24097628/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2054468 memory=75552 CPUtime=162.27 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 103103 0 0 0 16063 164 0 0 20 0 1 0 249062330 2103775232 18888 33554432000 4194304 5849940 140726008796064 140726008795224 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 513617 18888 712 405 0 510561 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2054468 KiB
Current children cumulated memory: 75552 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/188 16520
/proc/meminfo: memFree=24081624/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2056152 memory=77268 CPUtime=222.28 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 138708 0 0 0 21989 239 0 0 20 0 1 0 249062330 2105499648 19317 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 514038 19317 712 405 0 510982 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2056152 KiB
Current children cumulated memory: 77268 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 16521
/proc/meminfo: memFree=24037856/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2059876 memory=80884 CPUtime=282.28 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 172738 0 0 0 27922 306 0 0 20 0 1 0 249062330 2109313024 20221 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 514969 20221 712 405 0 511913 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2059876 KiB
Current children cumulated memory: 80884 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 16522
/proc/meminfo: memFree=24039188/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2061724 memory=82848 CPUtime=342.28 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 203134 0 0 0 33858 370 0 0 20 0 1 0 249062330 2111205376 20712 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 515431 20712 712 405 0 512375 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 2061724 KiB
Current children cumulated memory: 82848 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 16523
/proc/meminfo: memFree=23992060/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2067220 memory=88304 CPUtime=402.28 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 227301 0 0 0 39798 430 0 0 20 0 1 0 249062330 2116833280 22076 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 516805 22076 712 405 0 513749 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 2067220 KiB
Current children cumulated memory: 88304 KiB

[startup+462.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/188 16524
/proc/meminfo: memFree=23996600/32770624 swapFree=67059128/67108860
[pid=16448] ppid=16445 vsize=2065876 memory=87048 CPUtime=462.28 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 249357 0 0 0 45744 484 0 0 20 0 1 0 249062330 2115457024 21762 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 516469 21762 712 405 0 513413 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 2065876 KiB
Current children cumulated memory: 87048 KiB


################
# More data... #
################

/proc/16448/statm: 576209 81480 712 405 0 573153 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 2304836 KiB
Current children cumulated memory: 325920 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 16587
/proc/meminfo: memFree=23552772/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2304836 memory=325920 CPUtime=1782.32 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 573180 0 0 0 177224 1008 0 0 20 0 1 0 249062330 2360152064 81480 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 576209 81480 712 405 0 573153 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 2304836 KiB
Current children cumulated memory: 325920 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 16588
/proc/meminfo: memFree=23552648/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2304836 memory=325920 CPUtime=1842.32 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 596281 0 0 0 183212 1020 0 0 20 0 1 0 249062330 2360152064 81480 33554432000 4194304 5849940 140726008796064 140726008795064 5335818 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 576209 81480 712 405 0 573153 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 2304836 KiB
Current children cumulated memory: 325920 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 16589
/proc/meminfo: memFree=23552500/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2304836 memory=325920 CPUtime=1902.32 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 619605 0 0 0 189202 1030 0 0 20 0 1 0 249062330 2360152064 81480 33554432000 4194304 5849940 140726008796064 140726008795064 5335712 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 576209 81480 712 405 0 573153 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 2304836 KiB
Current children cumulated memory: 325920 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 16590
/proc/meminfo: memFree=23553820/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2238588 memory=259672 CPUtime=1962.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 627300 0 0 0 195188 1045 0 0 20 0 1 0 249062330 2292314112 64918 33554432000 4194304 5849940 140726008796064 140726008795064 5438033 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 559647 64918 712 405 0 556591 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 2238588 KiB
Current children cumulated memory: 259672 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 16599
/proc/meminfo: memFree=23550400/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2240156 memory=261240 CPUtime=2022.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 650845 0 0 0 201171 1062 0 0 20 0 1 0 249062330 2293919744 65310 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 560039 65310 712 405 0 556983 0
Current children cumulated CPU time: 2022.33 s
Current children cumulated vsize: 2240156 KiB
Current children cumulated memory: 261240 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 16600
/proc/meminfo: memFree=23547588/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2243288 memory=264372 CPUtime=2082.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 652121 0 0 0 207157 1076 0 0 20 0 1 0 249062330 2297126912 66093 33554432000 4194304 5849940 140726008796064 140726008795064 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 560822 66093 712 405 0 557766 0
Current children cumulated CPU time: 2082.33 s
Current children cumulated vsize: 2243288 KiB
Current children cumulated memory: 264372 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16601
/proc/meminfo: memFree=23505512/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2285084 memory=306168 CPUtime=2142.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 675169 0 0 0 213141 1092 0 0 20 0 1 0 249062330 2339926016 76542 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 571271 76542 712 405 0 568215 0
Current children cumulated CPU time: 2142.33 s
Current children cumulated vsize: 2285084 KiB
Current children cumulated memory: 306168 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16602
/proc/meminfo: memFree=23505512/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2285084 memory=306168 CPUtime=2202.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 675543 0 0 0 219125 1108 0 0 20 0 1 0 249062330 2339926016 76542 33554432000 4194304 5849940 140726008796064 140726008795224 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 571271 76542 712 405 0 568215 0
Current children cumulated CPU time: 2202.33 s
Current children cumulated vsize: 2285084 KiB
Current children cumulated memory: 306168 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 16603
/proc/meminfo: memFree=23505512/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2285084 memory=306168 CPUtime=2262.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 696426 0 0 0 225110 1123 0 0 20 0 1 0 249062330 2339926016 76542 33554432000 4194304 5849940 140726008796064 140726008795064 5437799 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 571271 76542 712 405 0 568215 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 2285084 KiB
Current children cumulated memory: 306168 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16604
/proc/meminfo: memFree=23505960/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2285084 memory=306168 CPUtime=2322.33 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 721933 0 0 0 231098 1135 0 0 20 0 1 0 249062330 2339926016 76542 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 571271 76542 712 405 0 568215 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 2285084 KiB
Current children cumulated memory: 306168 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16605
/proc/meminfo: memFree=23500000/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2291348 memory=312432 CPUtime=2382.34 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 745813 0 0 0 237087 1147 0 0 20 0 1 0 249062330 2346340352 78108 33554432000 4194304 5849940 140726008796064 140726008795064 5438047 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 572837 78108 712 405 0 569781 0
Current children cumulated CPU time: 2382.34 s
Current children cumulated vsize: 2291348 KiB
Current children cumulated memory: 312432 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16606
/proc/meminfo: memFree=23551364/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2291348 memory=312432 CPUtime=2442.34 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 769269 0 0 0 243075 1159 0 0 20 0 1 0 249062330 2346340352 78108 33554432000 4194304 5849940 140726008796064 140726008795064 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 572837 78108 712 405 0 569781 0
Current children cumulated CPU time: 2442.34 s
Current children cumulated vsize: 2291348 KiB
Current children cumulated memory: 312432 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 16607
/proc/meminfo: memFree=23551232/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2291348 memory=312432 CPUtime=2502.34 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 792734 0 0 0 249062 1172 0 0 20 0 1 0 249062330 2346340352 78108 33554432000 4194304 5849940 140726008796064 140726008795064 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 572837 78108 712 405 0 569781 0
Current children cumulated CPU time: 2502.34 s
Current children cumulated vsize: 2291348 KiB
Current children cumulated memory: 312432 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 16608
/proc/meminfo: memFree=23551240/32770624 swapFree=67059132/67108860
[pid=16448] ppid=16445 vsize=2291348 memory=312432 CPUtime=2520.05 cores=0,2,4,6
/proc/16448/stat : 16448 (xcsp_picat) R 16445 16448 13719 0 -1 4202496 813409 0 0 0 250828 1177 0 0 20 0 1 0 249062330 2346340352 78108 33554432000 4194304 5849940 140726008796064 140726008795064 140342503448455 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 28549120 140726008804534 140726008804612 140726008804612 140726008807370 0
/proc/16448/statm: 572837 78108 712 405 0 569781 0
Current children cumulated CPU time: 2520.05 s
Current children cumulated vsize: 2291348 KiB
Current children cumulated memory: 312432 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 16448 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2508.28 s, system=11.7833 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2520.07
CPU user time (s): 2508.28
CPU system time (s): 11.7833
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2304836
Max. memory (cumulated for all children) (KiB): 325920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2508.28
system time used= 11.7833
maximum resident set size= 325920
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 813410
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 774


# summary of solver processes directly reported to runsolver:
#   pid: 16448
#   total CPU time (s): 2520.07
#   total CPU user time (s): 2508.28
#   total CPU system time (s): 11.7833

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.58969 second user time and 18.9254 second system time

The end

Launcher Data 

Begin job on node103 at 2018-08-15 08:36:31
IDJOB=4309728
IDBENCH=141584
IDSOLVER=2794
FILE ID=node103/4309728-1534314991
RUNJOBID= node103-1534293202-13750
PBS_JOBID= 21038140
Free space on /tmp= 37336 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/Frb/frb-50-23-3-mgd_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309728-1534314991/watcher-4309728-1534314991 -o /tmp/evaluation-result-4309728-1534314991/solver-4309728-1534314991 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534293202-13750 --watchdog 2580  xcsp_picat HOME/instance-4309728-1534314991.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9221c7b89083fde7801d6d9537c28698
RANDOM SEED=1858917625

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23557400 kB
MemAvailable:   31277376 kB
Buffers:          186536 kB
Cached:          7734836 kB
SwapCached:         5148 kB
Active:          4833332 kB
Inactive:        3760224 kB
Active(anon):     664140 kB
Inactive(anon):    67484 kB
Active(file):    4169192 kB
Inactive(file):  3692740 kB
Unevictable:        7772 kB
Mlocked:            7772 kB
SwapTotal:      67108860 kB
SwapFree:       67059128 kB
Dirty:              3516 kB
Writeback:             0 kB
AnonPages:        684556 kB
Mapped:            56008 kB
Shmem:             56916 kB
Slab:             315600 kB
SReclaimable:     286504 kB
SUnreclaim:        29096 kB
KernelStack:        3568 kB
PageTables:         7036 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2987760 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    495616 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 37332 MiB
End job on node103 at 2018-08-15 09:18:32