Trace number 4293000

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2520.08 2519.9

General information on the benchmark

NameNurseRostering/
NurseRostering-13_c18.xml
MD5SUMbfb8f77ba8ae689b0ec737170bc63bca
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark62102
Best CPU time to get the best result obtained on this benchmark2520.11
Satisfiable
(Un)Satisfiability was proved
Number of variables8025
Number of constraints17841
Number of domains21
Minimum domain size1
Maximum domain size121
Distribution of domain sizes[{"size":1,"count":652},{"size":2,"count":1350},{"size":3,"count":156},{"size":4,"count":72},{"size":5,"count":33},{"size":6,"count":8},{"size":7,"count":121},{"size":8,"count":124},{"size":11,"count":96},{"size":12,"count":117},{"size":19,"count":3360},{"size":29,"count":900},{"size":120,"count":504},{"size":121,"count":532}]
Minimum variable degree2
Maximum variable degree55
Distribution of variable degrees[{"degree":2,"count":4185},{"degree":3,"count":480},{"degree":42,"count":5},{"degree":43,"count":95},{"degree":44,"count":120},{"degree":45,"count":25},{"degree":46,"count":79},{"degree":47,"count":137},{"degree":48,"count":190},{"degree":49,"count":200},{"degree":50,"count":288},{"degree":51,"count":991},{"degree":52,"count":861},{"degree":53,"count":271},{"degree":54,"count":78},{"degree":55,"count":20}]
Minimum constraint arity2
Maximum constraint arity240
Distribution of constraint arities[{"arity":2,"count":5938},{"arity":3,"count":5850},{"arity":4,"count":370},{"arity":6,"count":2530},{"arity":7,"count":220},{"arity":19,"count":120},{"arity":29,"count":2280},{"arity":121,"count":532},{"arity":240,"count":1}]
Number of extensional constraints3772
Number of intensional constraints2031
Distribution of constraint types[{"type":"extension","count":3772},{"type":"intension","count":2031},{"type":"regular","count":6235},{"type":"sum","count":240},{"type":"count","count":5562},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (7633 MiB free)
  memory of node 1: 16384 MiB (8942 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293000-1532301203/watcher-4293000-1532301203 -o /tmp/evaluation-result-4293000-1532301203/solver-4293000-1532301203 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1532296142-8379 --watchdog 2580 xcsp_picat HOME/instance-4293000-1532301203.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=9019, runsolver pid=9016
Current StackSize limit: 8192 KiB


[startup+0.10011 s]*
/proc/loadavg: 2.31 2.16 2.05 3/192 9020
/proc/meminfo: memFree=16936476/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=111688 memory=41276 CPUtime=0.09 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 1778 0 0 0 9 0 0 0 20 0 1 0 47683490 114368512 10319 33554432000 4194304 5849740 140731617474544 140731617473848 4840191 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 27922 10319 620 405 0 24866 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 41276 KiB

[startup+0.209983 s]*
/proc/loadavg: 2.31 2.16 2.05 3/192 9020
/proc/meminfo: memFree=16907804/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=111688 memory=67900 CPUtime=0.21 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 1791 0 0 0 20 1 0 0 20 0 1 0 47683490 114368512 16975 33554432000 4194304 5849740 140731617474544 140731617473848 4841204 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 27922 16975 620 405 0 24866 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 67900 KiB

[startup+0.309754 s]*
/proc/loadavg: 2.31 2.16 2.05 3/192 9020
/proc/meminfo: memFree=16846056/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=259292 memory=135892 CPUtime=0.31 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 2472 0 0 0 29 2 0 0 20 0 1 0 47683490 265515008 33973 33554432000 4194304 5849740 140731617474544 140731617473848 5257198 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 64823 33973 625 405 0 61767 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 259292 KiB
Current children cumulated memory: 135892 KiB

[startup+0.700355 s]
/proc/loadavg: 2.28 2.15 2.05 3/192 9020
/proc/meminfo: memFree=16858220/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=196788 memory=132920 CPUtime=0.69 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 2519 0 0 0 66 3 0 0 20 0 1 0 47683490 201510912 33230 33554432000 4194304 5849740 140731617474544 140731617473848 4490675 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 49197 33230 626 405 0 46141 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 196788 KiB
Current children cumulated memory: 132920 KiB

[startup+1.50037 s]
/proc/loadavg: 2.28 2.15 2.05 3/192 9020
/proc/meminfo: memFree=16763888/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=322416 memory=217048 CPUtime=1.49 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 3316 0 0 0 145 4 0 0 20 0 1 0 47683490 330153984 54262 33554432000 4194304 5849740 140731617474544 140731617473848 4494150 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 80604 54262 641 405 0 77548 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 322416 KiB
Current children cumulated memory: 217048 KiB

[startup+3.10993 s]
/proc/loadavg: 2.28 2.15 2.05 3/192 9020
/proc/meminfo: memFree=16674584/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=447416 memory=299796 CPUtime=3.1 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 4192 0 0 0 303 7 0 0 20 0 1 0 47683490 458153984 74949 33554432000 4194304 5849740 140731617474544 140731617473832 4467859 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 111854 74949 658 405 0 108798 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 447416 KiB
Current children cumulated memory: 299796 KiB

[startup+6.30027 s]
/proc/loadavg: 2.26 2.15 2.05 3/192 9020
/proc/meminfo: memFree=16523720/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=736428 memory=453404 CPUtime=6.29 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 8940 0 0 0 609 20 0 0 20 0 1 0 47683490 754102272 113351 33554432000 4194304 5849740 140731617474544 140731617473544 5473389 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 184107 113351 741 405 0 181051 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 736428 KiB
Current children cumulated memory: 453404 KiB

[startup+12.7003 s]
/proc/loadavg: 2.24 2.15 2.05 3/192 9020
/proc/meminfo: memFree=16431384/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=826540 memory=543516 CPUtime=12.68 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 15496 0 0 0 1227 41 0 0 20 0 1 0 47683490 846376960 135879 33554432000 4194304 5849740 140731617474544 140731617473656 5535761 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 206635 135879 741 405 0 203579 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 826540 KiB
Current children cumulated memory: 543516 KiB

[startup+25.5003 s]
/proc/loadavg: 2.20 2.14 2.05 3/192 9020
/proc/meminfo: memFree=16431072/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=826540 memory=543516 CPUtime=25.48 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 16254 0 0 0 2504 44 0 0 20 0 1 0 47683490 846376960 135879 33554432000 4194304 5849740 140731617474544 140731617473784 139916112486279 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 206635 135879 741 405 0 203579 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 826540 KiB
Current children cumulated memory: 543516 KiB

[startup+51.1092 s]
/proc/loadavg: 2.07 2.12 2.04 3/192 9021
/proc/meminfo: memFree=16393720/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=859312 memory=576288 CPUtime=51.1 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 18219 0 0 0 5058 52 0 0 20 0 1 0 47683490 879935488 144072 33554432000 4194304 5849740 140731617474544 140731617473784 5611445 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 214828 144072 741 405 0 211772 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 859312 KiB
Current children cumulated memory: 576288 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.10 2.04 3/191 9022
/proc/meminfo: memFree=16351652/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=892084 memory=609060 CPUtime=102.29 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 20322 0 0 0 10166 63 0 0 20 0 1 0 47683490 913494016 152265 33554432000 4194304 5849740 140731617474544 140731617473656 139916112486279 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 223021 152265 741 405 0 219965 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 892084 KiB
Current children cumulated memory: 609060 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.08 2.04 3/191 9023
/proc/meminfo: memFree=16190444/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1023308 memory=740416 CPUtime=162.3 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 52557 0 0 0 16162 68 0 0 20 0 1 0 47683490 1047867392 185104 33554432000 4194304 5849740 140731617474544 140731617473544 5351899 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 255827 185104 773 405 0 252771 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 1023308 KiB
Current children cumulated memory: 740416 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.07 2.04 3/191 9024
/proc/meminfo: memFree=16225400/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=983488 memory=701048 CPUtime=222.3 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 85001 0 0 0 22154 76 0 0 20 0 1 0 47683490 1007091712 175262 33554432000 4194304 5849740 140731617474544 140731617473256 5315772 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 245872 175262 773 405 0 242816 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 983488 KiB
Current children cumulated memory: 701048 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.05 2.04 3/192 9026
/proc/meminfo: memFree=16212872/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=992984 memory=700988 CPUtime=282.31 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 118136 0 0 0 28145 86 0 0 20 0 1 0 47683490 1016815616 175247 33554432000 4194304 5849740 140731617474544 140731617473544 5307557 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 248246 175247 773 405 0 245190 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 992984 KiB
Current children cumulated memory: 700988 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/192 9027
/proc/meminfo: memFree=16196272/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1010420 memory=718424 CPUtime=342.31 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 150389 0 0 0 34137 94 0 0 20 0 1 0 47683490 1034670080 179606 33554432000 4194304 5849740 140731617474544 140731617473416 5307541 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252605 179606 773 405 0 249549 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 1010420 KiB
Current children cumulated memory: 718424 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/192 9035
/proc/meminfo: memFree=16193592/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=992660 memory=710136 CPUtime=402.31 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 169029 0 0 0 40128 103 0 0 20 0 1 0 47683490 1016483840 177534 33554432000 4194304 5849740 140731617474544 140731617473544 5307553 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 248165 177534 773 405 0 245109 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 992660 KiB
Current children cumulated memory: 710136 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/192 9036
/proc/meminfo: memFree=16176060/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1009772 memory=727248 CPUtime=462.32 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 197440 0 0 0 46124 108 0 0 20 0 1 0 47683490 1034006528 181812 33554432000 4194304 5849740 140731617474544 140731617473544 5307648 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252443 181812 773 405 0 249387 0
Current children cumulated CPU time: 462.32 s
Current children cumulated vsize: 1009772 KiB
Current children cumulated memory: 727248 KiB


################
# More data... #
################

/proc/9019/statm: 255768 185973 773 405 0 252712 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 1023072 KiB
Current children cumulated memory: 743892 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 9079
/proc/meminfo: memFree=16084600/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1023072 memory=743892 CPUtime=1842.41 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 259376 0 0 0 183926 315 0 0 20 0 1 0 47683490 1047625728 185973 33554432000 4194304 5849740 140731617474544 140731617473416 139916112486279 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 255768 185973 773 405 0 252712 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 1023072 KiB
Current children cumulated memory: 743892 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9081
/proc/meminfo: memFree=16079348/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1023072 memory=743892 CPUtime=1902.42 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 260261 0 0 0 189919 323 0 0 20 0 1 0 47683490 1047625728 185973 33554432000 4194304 5849740 140731617474544 140731617473704 5339443 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 255768 185973 773 405 0 252712 0
Current children cumulated CPU time: 1902.42 s
Current children cumulated vsize: 1023072 KiB
Current children cumulated memory: 743892 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9082
/proc/meminfo: memFree=16106928/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008528 memory=729348 CPUtime=1962.42 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 261002 0 0 0 195909 333 0 0 20 0 1 0 47683490 1032732672 182337 33554432000 4194304 5849740 140731617474544 140731617473544 5437564 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252132 182337 773 405 0 249076 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 1008528 KiB
Current children cumulated memory: 729348 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9083
/proc/meminfo: memFree=16108208/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008528 memory=729348 CPUtime=2022.42 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 261898 0 0 0 201901 341 0 0 20 0 1 0 47683490 1032732672 182337 33554432000 4194304 5849740 140731617474544 140731617473544 5307733 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252132 182337 773 405 0 249076 0
Current children cumulated CPU time: 2022.42 s
Current children cumulated vsize: 1008528 KiB
Current children cumulated memory: 729348 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9084
/proc/meminfo: memFree=16087772/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1022468 memory=743288 CPUtime=2082.43 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 263071 0 0 0 207896 347 0 0 20 0 1 0 47683490 1047007232 185822 33554432000 4194304 5849740 140731617474544 140731617473544 5339022 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 255617 185822 773 405 0 252561 0
Current children cumulated CPU time: 2082.43 s
Current children cumulated vsize: 1022468 KiB
Current children cumulated memory: 743288 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9085
/proc/meminfo: memFree=16073832/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1022468 memory=743288 CPUtime=2142.44 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 263897 0 0 0 213880 364 0 0 20 0 1 0 47683490 1047007232 185822 33554432000 4194304 5849740 140731617474544 140731617473544 5339042 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 255617 185822 773 405 0 252561 0
Current children cumulated CPU time: 2142.44 s
Current children cumulated vsize: 1022468 KiB
Current children cumulated memory: 743288 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 9093
/proc/meminfo: memFree=16108684/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2202.44 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 264570 0 0 0 219865 379 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473416 5307533 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2202.44 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9095
/proc/meminfo: memFree=16095764/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2262.45 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 265338 0 0 0 225855 390 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473704 139916112486279 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2262.45 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9096
/proc/meminfo: memFree=16104520/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2322.45 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 265982 0 0 0 231852 393 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473704 5438080 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2322.45 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/192 9097
/proc/meminfo: memFree=16061244/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2382.45 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 266649 0 0 0 237845 400 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473544 5307594 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2382.45 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

[startup+2442.3 s]
/proc/loadavg: 2.11 2.05 2.06 3/192 9098
/proc/meminfo: memFree=16102328/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2442.46 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 267246 0 0 0 243841 405 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473544 5437808 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2442.46 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

[startup+2502.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/192 9161
/proc/meminfo: memFree=16235976/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2502.46 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 268000 0 0 0 249829 417 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473704 139916112486279 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2502.46 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.03 2.04 2.05 3/192 9161
/proc/meminfo: memFree=14291864/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2520.06 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 268002 0 0 0 251587 419 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473544 5307316 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 9019 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2515.88 s, system=4.20232 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.03 2.04 2.05 3/192 9161
/proc/meminfo: memFree=14291864/32770624 swapFree=67108860/67108860
[pid=9019] ppid=9016 vsize=1008272 memory=729092 CPUtime=2520.06 cores=1,3,5,7
/proc/9019/stat : 9019 (xcsp_picat) R 9016 9019 8347 0 -1 4202496 268002 0 0 0 251587 419 0 0 20 0 1 0 47683490 1032470528 182273 33554432000 4194304 5849740 140731617474544 140731617473544 5307316 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 35561472 140731617477814 140731617477892 140731617477892 140731617480650 0
/proc/9019/statm: 252068 182273 773 405 0 249012 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 1008272 KiB
Current children cumulated memory: 729092 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.9
CPU time (s): 2520.08
CPU user time (s): 2515.88
CPU system time (s): 4.20232
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 1053760
Max. memory (cumulated for all children) (KiB): 748988

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2515.88
system time used= 4.20232
maximum resident set size= 748988
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 268002
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27
involuntary context switches= 714


# summary of solver processes directly reported to runsolver:
#   pid: 9019
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2515.88
#   total CPU system time (s): 4.20232

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.4246 second user time and 18.4549 second system time

The end

Launcher Data 

Begin job on node133 at 2018-07-23 01:13:23
IDJOB=4293000
IDBENCH=141057
IDSOLVER=2754
FILE ID=node133/4293000-1532301203
RUNJOBID= node133-1532296142-8379
PBS_JOBID= 21018985
Free space on /tmp= 52644 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/NurseRostering/NurseRostering-13_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293000-1532301203/watcher-4293000-1532301203 -o /tmp/evaluation-result-4293000-1532301203/solver-4293000-1532301203 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1532296142-8379 --watchdog 2580  xcsp_picat HOME/instance-4293000-1532301203.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bfb8f77ba8ae689b0ec737170bc63bca
RANDOM SEED=193299965

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        16973672 kB
MemAvailable:   31771100 kB
Buffers:          209312 kB
Cached:         14665228 kB
SwapCached:            0 kB
Active:          1434120 kB
Inactive:       13661876 kB
Active(anon):     211904 kB
Inactive(anon):    29520 kB
Active(file):    1222216 kB
Inactive(file): 13632356 kB
Unevictable:        7104 kB
Mlocked:            7104 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              4048 kB
Writeback:             0 kB
AnonPages:        226124 kB
Mapped:            39036 kB
Shmem:             17056 kB
Slab:             398640 kB
SReclaimable:     371316 kB
SUnreclaim:        27324 kB
KernelStack:        3648 kB
PageTables:         5004 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     637780 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    133120 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 52640 MiB
End job on node133 at 2018-07-23 01:55:23