Trace number 4292940

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.74 2520.01

General information on the benchmark

NameNurseRostering/
NurseRostering-04_c18.xml
MD5SUM3e14d2a5b30f836b117ab38c1a042f13
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2070
Best CPU time to get the best result obtained on this benchmark2400.07
Satisfiable
(Un)Satisfiability was proved
Number of variables589
Number of constraints1410
Number of domains13
Minimum domain size1
Maximum domain size29
Distribution of domain sizes[{"size":1,"count":30},{"size":2,"count":111},{"size":3,"count":280},{"size":11,"count":140},{"size":29,"count":28}]
Minimum variable degree2
Maximum variable degree21
Distribution of variable degrees[{"degree":2,"count":269},{"degree":3,"count":40},{"degree":11,"count":9},{"degree":12,"count":11},{"degree":14,"count":8},{"degree":15,"count":10},{"degree":16,"count":15},{"degree":17,"count":23},{"degree":18,"count":18},{"degree":19,"count":79},{"degree":20,"count":85},{"degree":21,"count":22}]
Minimum constraint arity2
Maximum constraint arity29
Distribution of constraint arities[{"arity":2,"count":525},{"arity":3,"count":530},{"arity":4,"count":10},{"arity":6,"count":230},{"arity":11,"count":84},{"arity":20,"count":1},{"arity":29,"count":30}]
Number of extensional constraints354
Number of intensional constraints171
Distribution of constraint types[{"type":"extension","count":354},{"type":"intension","count":171},{"type":"regular","count":520},{"type":"sum","count":20},{"type":"count","count":344},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10912 MiB free)
  memory of node 1: 16384 MiB (9095 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4292940-1532297133/watcher-4292940-1532297133 -o /tmp/evaluation-result-4292940-1532297133/solver-4292940-1532297133 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532294350-7318 --watchdog 2580 xcsp_picat HOME/instance-4292940-1532297133.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=7792, runsolver pid=7789

[startup+0.100141 s]*
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20459964/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=136548 memory=32096 CPUtime=0.1 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 2703 0 0 0 10 0 0 0 20 0 1 0 47276482 139825152 8024 33554432000 4194304 5849740 140723304108288 140723304108288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34137 8024 730 405 0 31081 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 136548 KiB
Current children cumulated memory: 32096 KiB

[startup+0.209786 s]*
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20459964/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=136548 memory=32096 CPUtime=0.21 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 2727 0 0 0 21 0 0 0 20 0 1 0 47276482 139825152 8024 33554432000 4194304 5849740 140723304108288 140723304108288 5488046 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34137 8024 730 405 0 31081 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 136548 KiB
Current children cumulated memory: 32096 KiB

[startup+0.309213 s]*
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20457732/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=138948 memory=34468 CPUtime=0.31 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 3303 0 0 0 30 1 0 0 20 0 1 0 47276482 142282752 8617 33554432000 4194304 5849740 140723304108288 140723304108288 5606227 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34737 8617 732 405 0 31681 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 138948 KiB
Current children cumulated memory: 34468 KiB

[startup+0.700191 s]
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20457732/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=138948 memory=34468 CPUtime=0.69 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 3303 0 0 0 68 1 0 0 20 0 1 0 47276482 142282752 8617 33554432000 4194304 5849740 140723304108288 140723304108288 5606176 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34737 8617 732 405 0 31681 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 138948 KiB
Current children cumulated memory: 34468 KiB

[startup+1.50027 s]
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20457528/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=138948 memory=34468 CPUtime=1.49 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 3303 0 0 0 148 1 0 0 20 0 1 0 47276482 142282752 8617 33554432000 4194304 5849740 140723304108288 140723304107384 5606222 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34737 8617 732 405 0 31681 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 138948 KiB
Current children cumulated memory: 34468 KiB

[startup+3.1095 s]
/proc/loadavg: 2.39 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20452444/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=144072 memory=39500 CPUtime=3.1 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 5307 0 0 0 308 2 0 0 20 0 1 0 47276482 147529728 9875 33554432000 4194304 5849740 140723304108288 140723304107160 5360982 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 36018 9875 751 405 0 32962 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 144072 KiB
Current children cumulated memory: 39500 KiB

[startup+6.30027 s]
/proc/loadavg: 2.36 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20456012/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=139972 memory=35820 CPUtime=6.29 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 6610 0 0 0 624 5 0 0 20 0 1 0 47276482 143331328 8955 33554432000 4194304 5849740 140723304108288 140723304107528 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34993 8955 773 405 0 31937 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 139972 KiB
Current children cumulated memory: 35820 KiB

[startup+12.7003 s]
/proc/loadavg: 2.33 2.07 1.98 3/188 7793
/proc/meminfo: memFree=20449000/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=146008 memory=43680 CPUtime=12.68 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 9481 0 0 0 1255 13 0 0 20 0 1 0 47276482 149512192 10920 33554432000 4194304 5849740 140723304108288 140723304107288 5307054 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 36502 10920 773 405 0 33446 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 146008 KiB
Current children cumulated memory: 43680 KiB

[startup+25.5003 s]
/proc/loadavg: 2.26 2.06 1.98 3/188 7793
/proc/meminfo: memFree=20450484/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=139220 memory=41020 CPUtime=25.48 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 15335 0 0 0 2518 30 0 0 20 0 1 0 47276482 142561280 10255 33554432000 4194304 5849740 140723304108288 140723304107464 5470727 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 34805 10255 774 405 0 31749 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 139220 KiB
Current children cumulated memory: 41020 KiB

[startup+51.1096 s]
/proc/loadavg: 2.17 2.06 1.98 3/187 7793
/proc/meminfo: memFree=20427796/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=159196 memory=64768 CPUtime=51.09 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 22786 0 0 0 5050 59 0 0 20 0 1 0 47276482 163016704 16192 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 39799 16192 774 405 0 36743 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 159196 KiB
Current children cumulated memory: 64768 KiB

[startup+102.3 s]
/proc/loadavg: 2.07 2.05 1.98 3/187 7794
/proc/meminfo: memFree=20406284/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=167032 memory=72624 CPUtime=102.28 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 30700 0 0 0 10133 95 0 0 20 0 1 0 47276482 171040768 18156 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 41758 18156 774 405 0 38702 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 167032 KiB
Current children cumulated memory: 72624 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.04 1.98 3/187 7796
/proc/meminfo: memFree=20403356/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=171280 memory=76940 CPUtime=162.28 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 43701 0 0 0 16087 141 0 0 20 0 1 0 47276482 175390720 19235 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 42820 19235 774 405 0 39764 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 171280 KiB
Current children cumulated memory: 76940 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.03 1.98 3/187 7797
/proc/meminfo: memFree=20410080/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=178456 memory=84116 CPUtime=222.26 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 62573 0 0 0 22046 180 0 0 20 0 1 0 47276482 182738944 21029 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 44614 21029 774 405 0 41558 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 178456 KiB
Current children cumulated memory: 84116 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 1.98 3/187 7869
/proc/meminfo: memFree=20404832/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=169936 memory=75548 CPUtime=282.26 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 76113 0 0 0 28014 212 0 0 20 0 1 0 47276482 174014464 18887 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 42484 18887 774 405 0 39428 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 169936 KiB
Current children cumulated memory: 75548 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 1.98 3/187 7870
/proc/meminfo: memFree=20374852/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=181356 memory=87080 CPUtime=342.26 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 88843 0 0 0 33982 244 0 0 20 0 1 0 47276482 185708544 21770 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 45339 21770 774 405 0 42283 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 181356 KiB
Current children cumulated memory: 87080 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 1.98 3/187 7871
/proc/meminfo: memFree=20357292/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=185012 memory=90788 CPUtime=402.25 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 104273 0 0 0 39948 277 0 0 20 0 1 0 47276482 189452288 22697 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 46253 22697 774 405 0 43197 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 185012 KiB
Current children cumulated memory: 90788 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.98 3/187 7872
/proc/meminfo: memFree=20373924/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=181084 memory=86828 CPUtime=462.24 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 116648 0 0 0 45918 306 0 0 20 0 1 0 47276482 185430016 21707 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 45271 21707 774 405 0 42215 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 181084 KiB
Current children cumulated memory: 86828 KiB


################
# More data... #
################

/proc/7792/statm: 51623 28060 774 405 0 48567 0
Current children cumulated CPU time: 1722.1 s
Current children cumulated vsize: 206492 KiB
Current children cumulated memory: 112240 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.06 2.04 3/187 7912
/proc/meminfo: memFree=20199456/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=204112 memory=109824 CPUtime=1782.09 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 346379 0 0 0 177347 862 0 0 20 0 1 0 47276482 209010688 27456 33554432000 4194304 5849740 140723304108288 140723304107288 5312988 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 51028 27456 774 405 0 47972 0
Current children cumulated CPU time: 1782.09 s
Current children cumulated vsize: 204112 KiB
Current children cumulated memory: 109824 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.05 2.04 3/187 7913
/proc/meminfo: memFree=20154308/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=207496 memory=113124 CPUtime=1842.09 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 351511 0 0 0 183322 887 0 0 20 0 1 0 47276482 212475904 28281 33554432000 4194304 5849740 140723304108288 140723304107288 5335585 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 51874 28281 774 405 0 48818 0
Current children cumulated CPU time: 1842.09 s
Current children cumulated vsize: 207496 KiB
Current children cumulated memory: 113124 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/187 7914
/proc/meminfo: memFree=20148456/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=214076 memory=119632 CPUtime=1902.08 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 358737 0 0 0 189298 910 0 0 20 0 1 0 47276482 219213824 29908 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 53519 29908 774 405 0 50463 0
Current children cumulated CPU time: 1902.08 s
Current children cumulated vsize: 214076 KiB
Current children cumulated memory: 119632 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/187 7915
/proc/meminfo: memFree=20152296/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=210496 memory=116116 CPUtime=1962.07 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 365510 0 0 0 195278 929 0 0 20 0 1 0 47276482 215547904 29029 33554432000 4194304 5849740 140723304108288 140723304107288 5437698 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 52624 29029 774 405 0 49568 0
Current children cumulated CPU time: 1962.07 s
Current children cumulated vsize: 210496 KiB
Current children cumulated memory: 116116 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/187 7916
/proc/meminfo: memFree=20199860/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=208816 memory=114596 CPUtime=2022.07 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 370667 0 0 0 201260 947 0 0 20 0 1 0 47276482 213827584 28649 33554432000 4194304 5849740 140723304108288 140723304107288 5437698 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 52204 28649 774 405 0 49148 0
Current children cumulated CPU time: 2022.07 s
Current children cumulated vsize: 208816 KiB
Current children cumulated memory: 114596 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/188 7925
/proc/meminfo: memFree=20198740/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=209216 memory=114996 CPUtime=2082.07 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 376725 0 0 0 207238 969 0 0 20 0 1 0 47276482 214237184 28749 33554432000 4194304 5849740 140723304108288 140723304107288 5437698 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 52304 28749 774 405 0 49248 0
Current children cumulated CPU time: 2082.07 s
Current children cumulated vsize: 209216 KiB
Current children cumulated memory: 114996 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/188 7926
/proc/meminfo: memFree=20198420/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=200400 memory=106120 CPUtime=2142.06 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 384973 0 0 0 213219 987 0 0 20 0 1 0 47276482 205209600 26530 33554432000 4194304 5849740 140723304108288 140723304107160 5335568 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 50100 26530 774 405 0 47044 0
Current children cumulated CPU time: 2142.06 s
Current children cumulated vsize: 200400 KiB
Current children cumulated memory: 106120 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 7927
/proc/meminfo: memFree=20147088/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=206548 memory=112204 CPUtime=2202.05 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 389736 0 0 0 219200 1005 0 0 20 0 1 0 47276482 211505152 28051 33554432000 4194304 5849740 140723304108288 140723304107288 5437698 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 51637 28051 774 405 0 48581 0
Current children cumulated CPU time: 2202.05 s
Current children cumulated vsize: 206548 KiB
Current children cumulated memory: 112204 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 7928
/proc/meminfo: memFree=20147288/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=206864 memory=112576 CPUtime=2262.05 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 395535 0 0 0 225185 1020 0 0 20 0 1 0 47276482 211828736 28144 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 51716 28144 774 405 0 48660 0
Current children cumulated CPU time: 2262.05 s
Current children cumulated vsize: 206864 KiB
Current children cumulated memory: 112576 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 7929
/proc/meminfo: memFree=20153908/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=199016 memory=104640 CPUtime=2322.04 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 400284 0 0 0 231168 1036 0 0 20 0 1 0 47276482 203792384 26160 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 49754 26160 774 405 0 46698 0
Current children cumulated CPU time: 2322.04 s
Current children cumulated vsize: 199016 KiB
Current children cumulated memory: 104640 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 7930
/proc/meminfo: memFree=20137804/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=191500 memory=97080 CPUtime=2382.04 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 406661 0 0 0 237145 1059 0 0 20 0 1 0 47276482 196096000 24270 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 47875 24270 774 405 0 44819 0
Current children cumulated CPU time: 2382.04 s
Current children cumulated vsize: 191500 KiB
Current children cumulated memory: 97080 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 7931
/proc/meminfo: memFree=20081568/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=212560 memory=118160 CPUtime=2442.03 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 413600 0 0 0 243122 1081 0 0 20 0 1 0 47276482 217661440 29540 33554432000 4194304 5849740 140723304108288 140723304107288 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 53140 29540 774 405 0 50084 0
Current children cumulated CPU time: 2442.03 s
Current children cumulated vsize: 212560 KiB
Current children cumulated memory: 118160 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 7932
/proc/meminfo: memFree=19955216/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=200792 memory=106392 CPUtime=2502.02 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 418602 0 0 0 249103 1099 0 0 20 0 1 0 47276482 205611008 26598 33554432000 4194304 5849740 140723304108288 140723304107448 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 50198 26598 774 405 0 47142 0
Current children cumulated CPU time: 2502.02 s
Current children cumulated vsize: 200792 KiB
Current children cumulated memory: 106392 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.04 3/187 7932
/proc/meminfo: memFree=19922688/32770624 swapFree=67108860/67108860
[pid=7792] ppid=7789 vsize=210556 memory=116336 CPUtime=2519.73 cores=0,2,4,6
/proc/7792/stat : 7792 (xcsp_picat) R 7789 7792 7287 0 -1 4202496 422226 0 0 0 250867 1106 0 0 20 0 1 0 47276482 215609344 29084 33554432000 4194304 5849740 140723304108288 140723304107448 140482652548999 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 30437376 140723304109238 140723304109316 140723304109316 140723304112074 0
/proc/7792/statm: 52639 29084 774 405 0 49583 0
Current children cumulated CPU time: 2519.73 s
Current children cumulated vsize: 210556 KiB
Current children cumulated memory: 116336 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 7792 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2508.68 s, system=11.064 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.74
CPU user time (s): 2508.68
CPU system time (s): 11.064
CPU usage (%): 99.9892
Max. virtual memory (cumulated for all children) (KiB): 216784
Max. memory (cumulated for all children) (KiB): 122564

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2508.68
system time used= 11.064
maximum resident set size= 122564
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 422227
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58
involuntary context switches= 3151


# summary of solver processes directly reported to runsolver:
#   pid: 7792
#   total CPU time (s): 2519.74
#   total CPU user time (s): 2508.68
#   total CPU system time (s): 11.064

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0059 second user time and 18.135 second system time

The end

Launcher Data 

Begin job on node151 at 2018-07-23 00:05:33
IDJOB=4292940
IDBENCH=141042
IDSOLVER=2754
FILE ID=node151/4292940-1532297133
RUNJOBID= node151-1532294350-7318
PBS_JOBID= 21018981
Free space on /tmp= 55068 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/NurseRostering/NurseRostering-04_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4292940-1532297133/watcher-4292940-1532297133 -o /tmp/evaluation-result-4292940-1532297133/solver-4292940-1532297133 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532294350-7318 --watchdog 2580  xcsp_picat HOME/instance-4292940-1532297133.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3e14d2a5b30f836b117ab38c1a042f13
RANDOM SEED=1744073939

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20489108 kB
MemAvailable:   31884468 kB
Buffers:          251068 kB
Cached:         11292124 kB
SwapCached:            0 kB
Active:          1120868 kB
Inactive:       10530552 kB
Active(anon):     110944 kB
Inactive(anon):    16936 kB
Active(file):    1009924 kB
Inactive(file): 10513616 kB
Unevictable:        7940 kB
Mlocked:            7940 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3160 kB
Writeback:             0 kB
AnonPages:        115588 kB
Mapped:            38620 kB
Shmem:             17032 kB
Slab:             327292 kB
SReclaimable:     300280 kB
SUnreclaim:        27012 kB
KernelStack:        3328 kB
PageTables:         5564 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     470404 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     49152 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 55068 MiB
End job on node151 at 2018-07-23 00:47:33