Trace number 4303131

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520 2520.01

General information on the benchmark

NameNurseRostering/
NurseRostering-12_c18.xml
MD5SUM2a283c05e31c4b30f3ec3c3182bebd94
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark56621
Best CPU time to get the best result obtained on this benchmark2519.9
Satisfiable
(Un)Satisfiability was proved
Number of variables3618
Number of constraints8519
Number of domains14
Minimum domain size1
Maximum domain size61
Distribution of domain sizes[{"size":1,"count":226},{"size":2,"count":662},{"size":3,"count":5},{"size":5,"count":30},{"size":11,"count":1680},{"size":29,"count":427},{"size":61,"count":588}]
Minimum variable degree2
Maximum variable degree39
Distribution of variable degrees[{"degree":2,"count":1698},{"degree":3,"count":240},{"degree":27,"count":44},{"degree":28,"count":69},{"degree":29,"count":7},{"degree":30,"count":41},{"degree":31,"count":67},{"degree":32,"count":93},{"degree":33,"count":97},{"degree":34,"count":125},{"degree":35,"count":445},{"degree":36,"count":418},{"degree":37,"count":184},{"degree":38,"count":76},{"degree":39,"count":14}]
Minimum constraint arity2
Maximum constraint arity120
Distribution of constraint arities[{"arity":2,"count":2950},{"arity":3,"count":2860},{"arity":4,"count":310},{"arity":6,"count":1150},{"arity":7,"count":220},{"arity":11,"count":60},{"arity":29,"count":660},{"arity":61,"count":308},{"arity":120,"count":1}]
Number of extensional constraints1928
Number of intensional constraints1022
Distribution of constraint types[{"type":"extension","count":1928},{"type":"intension","count":1022},{"type":"regular","count":3110},{"type":"sum","count":120},{"type":"count","count":2338},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10855 MiB free)
  memory of node 1: 16384 MiB (7042 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303131-1533993811/watcher-4303131-1533993811 -o /tmp/evaluation-result-4303131-1533993811/solver-4303131-1533993811 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1533991241-25513 --watchdog 2580 xcsp_picat HOME/instance-4303131-1533993811.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=25896, runsolver pid=25893

[startup+0.100114 s]*
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18294424/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2025744 memory=39012 CPUtime=0.1 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 1767 0 0 0 10 0 0 0 20 0 1 0 216944286 2074361856 9753 33554432000 4194304 5849708 140727792584832 140727792584832 4488866 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 506436 9753 620 405 0 503381 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 39012 KiB

[startup+0.209707 s]*
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18271772/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2025744 memory=59684 CPUtime=0.21 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 1802 0 0 0 20 1 0 0 20 0 1 0 216944286 2074361856 14921 33554432000 4194304 5849708 140727792584832 140727792584832 4548435 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 506436 14921 620 405 0 503381 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 59684 KiB

[startup+0.309645 s]*
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18256816/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2033560 memory=72724 CPUtime=0.31 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 1986 0 0 0 30 1 0 0 20 0 1 0 216944286 2082365440 18181 33554432000 4194304 5849708 140727792584832 140727792584832 4924440 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 508390 18181 634 405 0 505335 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 72724 KiB

[startup+0.70032 s]
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18231868/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2033560 memory=120088 CPUtime=0.69 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 2103 0 0 0 68 1 0 0 20 0 1 0 216944286 2082365440 30022 33554432000 4194304 5849708 140727792584832 140727792584832 4501777 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 508390 30022 634 405 0 505335 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 120088 KiB

[startup+1.50024 s]
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18152496/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2034044 memory=183152 CPUtime=1.49 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 2534 0 0 0 147 2 0 0 20 0 1 0 216944286 2082861056 45788 33554432000 4194304 5849708 140727792584832 140727792583928 139861221388167 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 508511 45788 733 405 0 505456 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2034044 KiB
Current children cumulated memory: 183152 KiB

[startup+3.10936 s]
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18127284/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2053248 memory=202560 CPUtime=3.1 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 8118 0 0 0 295 15 0 0 20 0 1 0 216944286 2102525952 50640 33554432000 4194304 5849708 140727792584832 140727792583928 5472755 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 513312 50640 736 405 0 510257 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2053248 KiB
Current children cumulated memory: 202560 KiB

[startup+6.30022 s]
/proc/loadavg: 2.04 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18123028/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2057344 memory=206656 CPUtime=6.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 9011 0 0 0 613 16 0 0 20 0 1 0 216944286 2106720256 51664 33554432000 4194304 5849708 140727792584832 140727792584072 5614497 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 514336 51664 736 405 0 511281 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2057344 KiB
Current children cumulated memory: 206656 KiB

[startup+12.7002 s]
/proc/loadavg: 2.03 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18123096/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2057344 memory=206656 CPUtime=12.69 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 10361 0 0 0 1249 20 0 0 20 0 1 0 216944286 2106720256 51664 33554432000 4194304 5849708 140727792584832 140727792583928 139861221388167 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 514336 51664 736 405 0 511281 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2057344 KiB
Current children cumulated memory: 206656 KiB

[startup+25.5004 s]
/proc/loadavg: 2.03 2.03 1.96 3/190 25897
/proc/meminfo: memFree=18070184/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2112104 memory=259992 CPUtime=25.49 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 26837 0 0 0 2522 27 0 0 20 0 1 0 216944286 2162794496 64998 33554432000 4194304 5849708 140727792584832 140727792583480 5416633 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528026 64998 760 405 0 524971 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2112104 KiB
Current children cumulated memory: 259992 KiB

[startup+51.1093 s]
/proc/loadavg: 2.02 2.02 1.96 3/190 25897
/proc/meminfo: memFree=18045388/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2118848 memory=266772 CPUtime=51.1 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 37889 0 0 0 5079 31 0 0 20 0 1 0 216944286 2169700352 66693 33554432000 4194304 5849708 140727792584832 140727792583320 5308652 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 529712 66693 768 405 0 526657 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2118848 KiB
Current children cumulated memory: 266772 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/191 25900
/proc/meminfo: memFree=18025524/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2114168 memory=262052 CPUtime=102.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 55451 0 0 0 10188 41 0 0 20 0 1 0 216944286 2164908032 65513 33554432000 4194304 5849708 140727792584832 140727792583832 139861221388167 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528542 65513 768 405 0 525487 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 2114168 KiB
Current children cumulated memory: 262052 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/191 25901
/proc/meminfo: memFree=18000732/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2109324 memory=257248 CPUtime=162.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 58745 0 0 0 16177 52 0 0 20 0 1 0 216944286 2159947776 64312 33554432000 4194304 5849708 140727792584832 140727792583992 5307573 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 527331 64312 768 405 0 524276 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2109324 KiB
Current children cumulated memory: 257248 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/191 25902
/proc/meminfo: memFree=18004892/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2113192 memory=261116 CPUtime=222.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 68951 0 0 0 22164 65 0 0 20 0 1 0 216944286 2163908608 65279 33554432000 4194304 5849708 140727792584832 140727792583832 5437824 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528298 65279 768 405 0 525243 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2113192 KiB
Current children cumulated memory: 261116 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/191 25904
/proc/meminfo: memFree=17962448/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2113388 memory=262704 CPUtime=282.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 80320 0 0 0 28151 77 0 0 20 0 1 0 216944286 2164109312 65676 33554432000 4194304 5849708 140727792584832 140727792583832 5339463 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528347 65676 768 405 0 525292 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2113388 KiB
Current children cumulated memory: 262704 KiB

[startup+342.3 s]
/proc/loadavg: 2.40 2.11 1.99 3/191 25905
/proc/meminfo: memFree=17914892/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2118816 memory=264108 CPUtime=342.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 82745 0 0 0 34134 95 0 0 20 0 1 0 216944286 2169667584 66027 33554432000 4194304 5849708 140727792584832 140727792583832 5372443 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 529704 66027 768 405 0 526649 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2118816 KiB
Current children cumulated memory: 264108 KiB

[startup+402.3 s]
/proc/loadavg: 2.29 2.15 2.01 3/191 25914
/proc/meminfo: memFree=17948728/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2122272 memory=267564 CPUtime=402.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 92531 0 0 0 40120 109 0 0 20 0 1 0 216944286 2173206528 66891 33554432000 4194304 5849708 140727792584832 140727792583832 5307573 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 530568 66891 768 405 0 527513 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2122272 KiB
Current children cumulated memory: 267564 KiB

[startup+462.3 s]
/proc/loadavg: 2.11 2.12 2.01 3/191 25915
/proc/meminfo: memFree=17919636/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2120140 memory=268148 CPUtime=462.29 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 102601 0 0 0 46105 124 0 0 20 0 1 0 216944286 2171023360 67037 33554432000 4194304 5849708 140727792584832 140727792583992 5307610 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 530035 67037 768 405 0 526980 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2120140 KiB
Current children cumulated memory: 268148 KiB


################
# More data... #
################

/proc/25896/statm: 516365 54070 777 405 0 513310 0
Current children cumulated CPU time: 1722.28 s
Current children cumulated vsize: 2065460 KiB
Current children cumulated memory: 216280 KiB

[startup+1782.3 s]
/proc/loadavg: 2.31 2.15 2.07 3/191 25954
/proc/meminfo: memFree=17793144/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2113340 memory=267432 CPUtime=1782.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 295794 0 0 0 177722 505 0 0 20 0 1 0 216944286 2164060160 66858 33554432000 4194304 5849708 140727792584832 140727792583704 4205577 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528335 66858 777 405 0 525280 0
Current children cumulated CPU time: 1782.27 s
Current children cumulated vsize: 2113340 KiB
Current children cumulated memory: 267432 KiB

[startup+1842.3 s]
/proc/loadavg: 2.17 2.14 2.07 3/191 25955
/proc/meminfo: memFree=17728088/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2114424 memory=267444 CPUtime=1842.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 296319 0 0 0 183698 530 0 0 20 0 1 0 216944286 2165170176 66861 33554432000 4194304 5849708 140727792584832 140727792583832 139861221388167 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 528606 66861 777 405 0 525551 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 2114424 KiB
Current children cumulated memory: 267444 KiB

[startup+1902.3 s]
/proc/loadavg: 2.06 2.11 2.07 3/191 25957
/proc/meminfo: memFree=17726164/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2121312 memory=269296 CPUtime=1902.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 305035 0 0 0 189672 555 0 0 20 0 1 0 216944286 2172223488 67324 33554432000 4194304 5849708 140727792584832 140727792583320 5307120 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 530328 67324 777 405 0 527273 0
Current children cumulated CPU time: 1902.27 s
Current children cumulated vsize: 2121312 KiB
Current children cumulated memory: 269296 KiB

[startup+1962.3 s]
/proc/loadavg: 2.02 2.09 2.06 3/190 25958
/proc/meminfo: memFree=17720092/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2121312 memory=275136 CPUtime=1962.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 313355 0 0 0 195644 583 0 0 20 0 1 0 216944286 2172223488 68784 33554432000 4194304 5849708 140727792584832 140727792583832 5307322 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 530328 68784 777 405 0 527273 0
Current children cumulated CPU time: 1962.27 s
Current children cumulated vsize: 2121312 KiB
Current children cumulated memory: 275136 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.07 2.05 3/190 25959
/proc/meminfo: memFree=17795840/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2131188 memory=283984 CPUtime=2022.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 322950 0 0 0 201611 617 0 0 20 0 1 0 216944286 2182336512 70996 33554432000 4194304 5849708 140727792584832 140727792583480 5438158 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 532797 70996 777 405 0 529742 0
Current children cumulated CPU time: 2022.28 s
Current children cumulated vsize: 2131188 KiB
Current children cumulated memory: 283984 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/190 25961
/proc/meminfo: memFree=17730336/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2131188 memory=283984 CPUtime=2082.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 331076 0 0 0 207583 645 0 0 20 0 1 0 216944286 2182336512 70996 33554432000 4194304 5849708 140727792584832 140727792583832 5307616 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 532797 70996 777 405 0 529742 0
Current children cumulated CPU time: 2082.28 s
Current children cumulated vsize: 2131188 KiB
Current children cumulated memory: 283984 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/191 25963
/proc/meminfo: memFree=17754456/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2131188 memory=283984 CPUtime=2142.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 340129 0 0 0 213549 679 0 0 20 0 1 0 216944286 2182336512 70996 33554432000 4194304 5849708 140727792584832 140727792583832 5437592 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 532797 70996 777 405 0 529742 0
Current children cumulated CPU time: 2142.28 s
Current children cumulated vsize: 2131188 KiB
Current children cumulated memory: 283984 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/192 25972
/proc/meminfo: memFree=17688060/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2131188 memory=283984 CPUtime=2202.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 349537 0 0 0 219524 704 0 0 20 0 1 0 216944286 2182336512 70996 33554432000 4194304 5849708 140727792584832 140727792583832 139861221388167 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 532797 70996 777 405 0 529742 0
Current children cumulated CPU time: 2202.28 s
Current children cumulated vsize: 2131188 KiB
Current children cumulated memory: 283984 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/193 25996
/proc/meminfo: memFree=17686204/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2131188 memory=283984 CPUtime=2262.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 358702 0 0 0 225496 731 0 0 20 0 1 0 216944286 2182336512 70996 33554432000 4194304 5849708 140727792584832 140727792583320 5309600 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 532797 70996 777 405 0 529742 0
Current children cumulated CPU time: 2262.27 s
Current children cumulated vsize: 2131188 KiB
Current children cumulated memory: 283984 KiB

[startup+2322.3 s]
/proc/loadavg: 2.12 2.06 2.05 3/193 25997
/proc/meminfo: memFree=17672068/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2145760 memory=298588 CPUtime=2322.28 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 370687 0 0 0 231454 774 0 0 20 0 1 0 216944286 2197258240 74647 33554432000 4194304 5849708 140727792584832 140727792583832 5437714 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 536440 74647 777 405 0 533385 0
Current children cumulated CPU time: 2322.28 s
Current children cumulated vsize: 2145760 KiB
Current children cumulated memory: 298588 KiB

[startup+2382.3 s]
/proc/loadavg: 2.04 2.05 2.05 3/193 25998
/proc/meminfo: memFree=17672352/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2145340 memory=298364 CPUtime=2382.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 386740 0 0 0 237425 802 0 0 20 0 1 0 216944286 2196828160 74591 33554432000 4194304 5849708 140727792584832 140727792583560 5307752 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 536335 74591 777 405 0 533280 0
Current children cumulated CPU time: 2382.27 s
Current children cumulated vsize: 2145340 KiB
Current children cumulated memory: 298364 KiB

[startup+2442.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/192 25999
/proc/meminfo: memFree=17640216/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2179052 memory=331892 CPUtime=2442.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 402793 0 0 0 243393 834 0 0 20 0 1 0 216944286 2231349248 82973 33554432000 4194304 5849708 140727792584832 140727792583832 5335520 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 544763 82973 777 405 0 541708 0
Current children cumulated CPU time: 2442.27 s
Current children cumulated vsize: 2179052 KiB
Current children cumulated memory: 331892 KiB

[startup+2502.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/191 26061
/proc/meminfo: memFree=18022592/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2178220 memory=331284 CPUtime=2502.27 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 417206 0 0 0 249365 862 0 0 20 0 1 0 216944286 2230497280 82821 33554432000 4194304 5849708 140727792584832 140727792583832 5437619 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 544555 82821 777 405 0 541500 0
Current children cumulated CPU time: 2502.27 s
Current children cumulated vsize: 2178220 KiB
Current children cumulated memory: 331284 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.04 2.04 2.05 3/191 26061
/proc/meminfo: memFree=18012020/32770624 swapFree=67108688/67108860
[pid=25896] ppid=25893 vsize=2178116 memory=331180 CPUtime=2519.98 cores=1,3,5,7
/proc/25896/stat : 25896 (xcsp_picat) R 25893 25896 25480 0 -1 4202496 429251 0 0 0 251128 870 0 0 20 0 1 0 216944286 2230390784 82795 33554432000 4194304 5849708 140727792584832 140727792583832 4209341 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9394900 24936448 140727792592054 140727792592132 140727792592132 140727792594890 0
/proc/25896/statm: 544529 82795 777 405 0 541474 0
Current children cumulated CPU time: 2519.98 s
Current children cumulated vsize: 2178116 KiB
Current children cumulated memory: 331180 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 25896 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2511.29 s, system=8.70797 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520
CPU user time (s): 2511.29
CPU system time (s): 8.70797
CPU usage (%): 99.9993
Max. virtual memory (cumulated for all children) (KiB): 2207560
Max. memory (cumulated for all children) (KiB): 361520

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2511.29
system time used= 8.70797
maximum resident set size= 361520
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 429251
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 880


# summary of solver processes directly reported to runsolver:
#   pid: 25896
#   total CPU time (s): 2520
#   total CPU user time (s): 2511.29
#   total CPU system time (s): 8.70797

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.7052 second user time and 17.9955 second system time

The end

Launcher Data 

Begin job on node134 at 2018-08-11 15:23:31
IDJOB=4303131
IDBENCH=141061
IDSOLVER=2778
FILE ID=node134/4303131-1533993811
RUNJOBID= node134-1533991241-25513
PBS_JOBID= 21036944
Free space on /tmp= 42312 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/NurseRostering/NurseRostering-12_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303131-1533993811/watcher-4303131-1533993811 -o /tmp/evaluation-result-4303131-1533993811/solver-4303131-1533993811 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1533991241-25513 --watchdog 2580  xcsp_picat HOME/instance-4303131-1533993811.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2a283c05e31c4b30f3ec3c3182bebd94
RANDOM SEED=1903633672

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18327684 kB
MemAvailable:   31848888 kB
Buffers:          167752 kB
Cached:         13502880 kB
SwapCached:           52 kB
Active:          4473780 kB
Inactive:        9306376 kB
Active(anon):      58956 kB
Inactive(anon):   103132 kB
Active(file):    4414824 kB
Inactive(file):  9203244 kB
Unevictable:        7392 kB
Mlocked:            7392 kB
SwapTotal:      67108860 kB
SwapFree:       67108688 kB
Dirty:              3500 kB
Writeback:             0 kB
AnonPages:        111032 kB
Mapped:            55604 kB
Shmem:             49652 kB
Slab:             360272 kB
SReclaimable:     331596 kB
SUnreclaim:        28676 kB
KernelStack:        3408 kB
PageTables:         5460 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2428428 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     36864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 42308 MiB
End job on node134 at 2018-08-11 16:05:31