Trace number 4293008

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.83 2520.02

General information on the benchmark

NameNurseRostering/
NurseRostering-02_c18.xml
MD5SUM87663e99bef5ddcf16b35e20b5ad163d
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1025
Best CPU time to get the best result obtained on this benchmark2520.04
Satisfiable
(Un)Satisfiability was proved
Number of variables412
Number of constraints945
Number of domains11
Minimum domain size1
Maximum domain size15
Distribution of domain sizes[{"size":1,"count":18},{"size":2,"count":90},{"size":3,"count":196},{"size":15,"count":108}]
Minimum variable degree2
Maximum variable degree21
Distribution of variable degrees[{"degree":2,"count":188},{"degree":3,"count":28},{"degree":10,"count":3},{"degree":11,"count":13},{"degree":12,"count":10},{"degree":13,"count":5},{"degree":14,"count":13},{"degree":15,"count":21},{"degree":16,"count":25},{"degree":17,"count":23},{"degree":18,"count":31},{"degree":19,"count":24},{"degree":20,"count":20},{"degree":21,"count":8}]
Minimum constraint arity2
Maximum constraint arity15
Distribution of constraint arities[{"arity":2,"count":480},{"arity":3,"count":254},{"arity":6,"count":126},{"arity":14,"count":1},{"arity":15,"count":84}]
Number of extensional constraints224
Number of intensional constraints138
Distribution of constraint types[{"type":"extension","count":224},{"type":"intension","count":138},{"type":"regular","count":344},{"type":"sum","count":28},{"type":"count","count":210},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10911 MiB free)
  memory of node 1: 16384 MiB (8851 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293008-1532302174/watcher-4293008-1532302174 -o /tmp/evaluation-result-4293008-1532302174/solver-4293008-1532302174 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532294350-7318 --watchdog 2580 xcsp_picat HOME/instance-4293008-1532302174.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=8219, runsolver pid=8216
Current StackSize limit: 8192 KiB


[startup+0.100186 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20216096/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=119632 memory=24248 CPUtime=0.09 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 1612 0 0 0 9 0 0 0 20 0 1 0 47780616 122503168 6062 33554432000 4194304 5849740 140736254388032 140736254387128 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 29908 6062 731 405 0 26852 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 119632 KiB
Current children cumulated memory: 24248 KiB

[startup+0.209622 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20214976/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=120596 memory=25068 CPUtime=0.2 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 1913 0 0 0 20 0 0 0 20 0 1 0 47780616 123490304 6267 33554432000 4194304 5849740 140736254388032 140736254387128 5606176 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 30149 6267 731 405 0 27093 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 120596 KiB
Current children cumulated memory: 25068 KiB

[startup+0.309135 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20214976/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=120596 memory=25068 CPUtime=0.3 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 1913 0 0 0 30 0 0 0 20 0 1 0 47780616 123490304 6267 33554432000 4194304 5849740 140736254388032 140736254387128 5606197 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 30149 6267 731 405 0 27093 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 120596 KiB
Current children cumulated memory: 25068 KiB

[startup+0.700275 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20214976/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=121888 memory=26428 CPUtime=0.69 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 2506 0 0 0 68 1 0 0 20 0 1 0 47780616 124813312 6607 33554432000 4194304 5849740 140736254388032 140736254387272 5392006 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 30472 6607 747 405 0 27416 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 121888 KiB
Current children cumulated memory: 26428 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20212392/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=123308 memory=27800 CPUtime=1.48 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 3207 0 0 0 147 1 0 0 20 0 1 0 47780616 126267392 6950 33554432000 4194304 5849740 140736254388032 140736254387272 5308864 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 30827 6950 759 405 0 27771 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 123308 KiB
Current children cumulated memory: 27800 KiB

[startup+3.10939 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20185376/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=123344 memory=28128 CPUtime=3.09 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 4772 0 0 0 306 3 0 0 20 0 1 0 47780616 126304256 7032 33554432000 4194304 5849740 140736254388032 140736254386760 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 30836 7032 770 405 0 27780 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 123344 KiB
Current children cumulated memory: 28128 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20186156/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=124300 memory=28084 CPUtime=6.28 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 6629 0 0 0 619 9 0 0 20 0 1 0 47780616 127283200 7021 33554432000 4194304 5849740 140736254388032 140736254386520 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 31075 7021 772 405 0 28019 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 124300 KiB
Current children cumulated memory: 28084 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20180948/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=124004 memory=28632 CPUtime=12.68 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 10835 0 0 0 1250 18 0 0 20 0 1 0 47780616 126980096 7158 33554432000 4194304 5849740 140736254388032 140736254386520 4230789 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 31001 7158 772 405 0 27945 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 124004 KiB
Current children cumulated memory: 28632 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8220
/proc/meminfo: memFree=20235164/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=134516 memory=39308 CPUtime=25.49 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 17622 0 0 0 2515 34 0 0 20 0 1 0 47780616 137744384 9827 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 33629 9827 772 405 0 30573 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 134516 KiB
Current children cumulated memory: 39308 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 8229
/proc/meminfo: memFree=20207776/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=144176 memory=48760 CPUtime=51.09 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 29475 0 0 0 5053 56 0 0 20 0 1 0 47780616 147636224 12190 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 36044 12190 772 405 0 32988 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 144176 KiB
Current children cumulated memory: 48760 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 8230
/proc/meminfo: memFree=20191512/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=172796 memory=77516 CPUtime=102.28 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 55221 0 0 0 10141 87 0 0 20 0 1 0 47780616 176943104 19379 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 43199 19379 772 405 0 40143 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 172796 KiB
Current children cumulated memory: 77516 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 8231
/proc/meminfo: memFree=20102436/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=201392 memory=105972 CPUtime=162.27 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 79049 0 0 0 16112 115 0 0 20 0 1 0 47780616 206225408 26493 33554432000 4194304 5849740 140736254388032 140736254387032 5335585 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 50348 26493 772 405 0 47292 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 201392 KiB
Current children cumulated memory: 105972 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 8232
/proc/meminfo: memFree=20179104/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=190504 memory=95056 CPUtime=222.26 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 99742 0 0 0 22095 131 0 0 20 0 1 0 47780616 195076096 23764 33554432000 4194304 5849740 140736254388032 140736254387032 5335568 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 47626 23764 772 405 0 44570 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 190504 KiB
Current children cumulated memory: 95056 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 8293
/proc/meminfo: memFree=12719312/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=238828 memory=143440 CPUtime=282.25 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 117103 0 0 0 28069 156 0 0 20 0 1 0 47780616 244559872 35860 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 59707 35860 772 405 0 56651 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 238828 KiB
Current children cumulated memory: 143440 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8294
/proc/meminfo: memFree=7495684/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=295244 memory=206448 CPUtime=342.24 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 125097 0 0 0 34054 170 0 0 20 0 1 0 47780616 302329856 51612 33554432000 4194304 5849740 140736254388032 140736254387032 5335529 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 73811 51612 772 405 0 70755 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 295244 KiB
Current children cumulated memory: 206448 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8295
/proc/meminfo: memFree=7514572/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=226796 memory=138000 CPUtime=402.24 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 154594 0 0 0 40036 188 0 0 20 0 1 0 47780616 232239104 34500 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 56699 34500 772 405 0 53643 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 226796 KiB
Current children cumulated memory: 138000 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8296
/proc/meminfo: memFree=12636064/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=275892 memory=187008 CPUtime=462.24 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 156532 0 0 0 46022 202 0 0 20 0 1 0 47780616 282513408 46752 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 68973 46752 772 405 0 65917 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 275892 KiB
Current children cumulated memory: 187008 KiB


################
# More data... #
################

/proc/8219/statm: 108252 86053 772 405 0 105196 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 433008 KiB
Current children cumulated memory: 344212 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/187 8335
/proc/meminfo: memFree=6040524/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=448696 memory=359836 CPUtime=1782.13 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 625689 0 0 0 177728 485 0 0 20 0 1 0 47780616 459464704 89959 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 112174 89959 772 405 0 109118 0
Current children cumulated CPU time: 1782.13 s
Current children cumulated vsize: 448696 KiB
Current children cumulated memory: 359836 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/189 8345
/proc/meminfo: memFree=5991104/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=448696 memory=359900 CPUtime=1842.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 632517 0 0 0 183720 492 0 0 20 0 1 0 47780616 459464704 89975 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 112174 89975 772 405 0 109118 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 448696 KiB
Current children cumulated memory: 359900 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 8372
/proc/meminfo: memFree=5911384/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=476748 memory=387952 CPUtime=1902.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 635497 0 0 0 189712 500 0 0 20 0 1 0 47780616 488189952 96988 33554432000 4194304 5849740 140736254388032 140736254387032 5437766 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 119187 96988 772 405 0 116131 0
Current children cumulated CPU time: 1902.12 s
Current children cumulated vsize: 476748 KiB
Current children cumulated memory: 387952 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 8373
/proc/meminfo: memFree=5867800/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=472800 memory=384004 CPUtime=1962.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 655747 0 0 0 195699 513 0 0 20 0 1 0 47780616 484147200 96001 33554432000 4194304 5849740 140736254388032 140736254387032 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 118200 96001 772 405 0 115144 0
Current children cumulated CPU time: 1962.12 s
Current children cumulated vsize: 472800 KiB
Current children cumulated memory: 384004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 8374
/proc/meminfo: memFree=13907692/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2022.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 671481 0 0 0 201686 526 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387032 5437600 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2022.12 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 8375
/proc/meminfo: memFree=13205852/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2082.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 690944 0 0 0 207677 535 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387032 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2082.12 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 8376
/proc/meminfo: memFree=12636168/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2142.12 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 711874 0 0 0 213669 543 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387032 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2142.12 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 8377
/proc/meminfo: memFree=12096248/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2202.11 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 732853 0 0 0 219661 550 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387192 5312827 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2202.11 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 8378
/proc/meminfo: memFree=11600232/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2262.11 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 753970 0 0 0 225652 559 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387032 5313159 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2262.11 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 8379
/proc/meminfo: memFree=11212112/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2322.11 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 775198 0 0 0 231646 565 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387192 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2322.11 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 8380
/proc/meminfo: memFree=10912776/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2382.11 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 796509 0 0 0 237640 571 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387192 5438164 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2382.11 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 8390
/proc/meminfo: memFree=10673788/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=560824 memory=472028 CPUtime=2442.1 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 817887 0 0 0 243633 577 0 0 20 0 1 0 47780616 574283776 118007 33554432000 4194304 5849740 140736254388032 140736254387032 140651145166727 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 140206 118007 772 405 0 137150 0
Current children cumulated CPU time: 2442.1 s
Current children cumulated vsize: 560824 KiB
Current children cumulated memory: 472028 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 8391
/proc/meminfo: memFree=10442300/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=645836 memory=556872 CPUtime=2502.1 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 843280 0 0 0 249620 590 0 0 20 0 1 0 47780616 661336064 139218 33554432000 4194304 5849740 140736254388032 140736254387032 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 161459 139218 772 405 0 158403 0
Current children cumulated CPU time: 2502.1 s
Current children cumulated vsize: 645836 KiB
Current children cumulated memory: 556872 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 8391
/proc/meminfo: memFree=5229712/32770624 swapFree=67108860/67108860
[pid=8219] ppid=8216 vsize=645836 memory=557040 CPUtime=2519.81 cores=0,2,4,6
/proc/8219/stat : 8219 (xcsp_picat) R 8216 8219 7287 0 -1 4202496 855119 0 0 0 251390 591 0 0 20 0 1 0 47780616 661336064 139260 33554432000 4194304 5849740 140736254388032 140736254387032 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 48128000 140736254391478 140736254391556 140736254391556 140736254394314 0
/proc/8219/statm: 161459 139260 772 405 0 158403 0
Current children cumulated CPU time: 2519.81 s
Current children cumulated vsize: 645836 KiB
Current children cumulated memory: 557040 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 8219 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2513.9 s, system=5.92677 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2519.83
CPU user time (s): 2513.9
CPU system time (s): 5.92677
CPU usage (%): 99.9925
Max. virtual memory (cumulated for all children) (KiB): 645836
Max. memory (cumulated for all children) (KiB): 557040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2513.9
system time used= 5.92677
maximum resident set size= 557040
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 855119
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 133
involuntary context switches= 1046


# summary of solver processes directly reported to runsolver:
#   pid: 8219
#   total CPU time (s): 2519.83
#   total CPU user time (s): 2513.9
#   total CPU system time (s): 5.92677

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.2225 second user time and 18.5649 second system time

The end

Launcher Data 

Begin job on node151 at 2018-07-23 01:29:34
IDJOB=4293008
IDBENCH=141059
IDSOLVER=2754
FILE ID=node151/4293008-1532302174
RUNJOBID= node151-1532294350-7318
PBS_JOBID= 21018981
Free space on /tmp= 55068 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/NurseRostering/NurseRostering-02_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293008-1532302174/watcher-4293008-1532302174 -o /tmp/evaluation-result-4293008-1532302174/solver-4293008-1532302174 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532294350-7318 --watchdog 2580  xcsp_picat HOME/instance-4293008-1532302174.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 87663e99bef5ddcf16b35e20b5ad163d
RANDOM SEED=1376396506

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20237608 kB
MemAvailable:   31635104 kB
Buffers:          251524 kB
Cached:         11293980 kB
SwapCached:            0 kB
Active:          1370772 kB
Inactive:       10531440 kB
Active(anon):     359712 kB
Inactive(anon):    16936 kB
Active(file):    1011060 kB
Inactive(file): 10514504 kB
Unevictable:        7940 kB
Mlocked:            7940 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3128 kB
Writeback:             0 kB
AnonPages:        364592 kB
Mapped:            38760 kB
Shmem:             17032 kB
Slab:             327828 kB
SReclaimable:     300392 kB
SUnreclaim:        27436 kB
KernelStack:        3344 kB
PageTables:         5696 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     764816 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    260096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 55068 MiB
End job on node151 at 2018-07-23 02:11:34