Trace number 4309472

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.08 2519.9

General information on the benchmark

NameNurseRostering/
NurseRostering-13_c18.xml
MD5SUMbfb8f77ba8ae689b0ec737170bc63bca
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark62102
Best CPU time to get the best result obtained on this benchmark2520.11
Satisfiable
(Un)Satisfiability was proved
Number of variables8025
Number of constraints17841
Number of domains21
Minimum domain size1
Maximum domain size121
Distribution of domain sizes[{"size":1,"count":652},{"size":2,"count":1350},{"size":3,"count":156},{"size":4,"count":72},{"size":5,"count":33},{"size":6,"count":8},{"size":7,"count":121},{"size":8,"count":124},{"size":11,"count":96},{"size":12,"count":117},{"size":19,"count":3360},{"size":29,"count":900},{"size":120,"count":504},{"size":121,"count":532}]
Minimum variable degree2
Maximum variable degree55
Distribution of variable degrees[{"degree":2,"count":4185},{"degree":3,"count":480},{"degree":42,"count":5},{"degree":43,"count":95},{"degree":44,"count":120},{"degree":45,"count":25},{"degree":46,"count":79},{"degree":47,"count":137},{"degree":48,"count":190},{"degree":49,"count":200},{"degree":50,"count":288},{"degree":51,"count":991},{"degree":52,"count":861},{"degree":53,"count":271},{"degree":54,"count":78},{"degree":55,"count":20}]
Minimum constraint arity2
Maximum constraint arity240
Distribution of constraint arities[{"arity":2,"count":5938},{"arity":3,"count":5850},{"arity":4,"count":370},{"arity":6,"count":2530},{"arity":7,"count":220},{"arity":19,"count":120},{"arity":29,"count":2280},{"arity":121,"count":532},{"arity":240,"count":1}]
Number of extensional constraints3772
Number of intensional constraints2031
Distribution of constraint types[{"type":"extension","count":3772},{"type":"intension","count":2031},{"type":"regular","count":6235},{"type":"sum","count":240},{"type":"count","count":5562},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13090 MiB free)
  memory of node 1: 16384 MiB (13401 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309472-1534293911/watcher-4309472-1534293911 -o /tmp/evaluation-result-4309472-1534293911/solver-4309472-1534293911 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1534293911-23504 --watchdog 2580 xcsp_picat HOME/instance-4309472-1534293911.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=23534, runsolver pid=23527
Current StackSize limit: 8192 KiB


[startup+0.100116 s]*
/proc/loadavg: 0.53 0.73 1.07 4/187 23535
/proc/meminfo: memFree=27066492/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2025744 memory=39008 CPUtime=0.1 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 1751 0 0 0 10 0 0 0 20 0 1 0 246954269 2074361856 9752 33554432000 4194304 5849940 140733374761216 140733374761216 4475189 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 506436 9752 594 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 39008 KiB

[startup+0.209908 s]*
/proc/loadavg: 0.53 0.73 1.07 4/187 23535
/proc/meminfo: memFree=27025532/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2025744 memory=65632 CPUtime=0.21 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 1764 0 0 0 21 0 0 0 20 0 1 0 246954269 2074361856 16408 33554432000 4194304 5849940 140733374761216 140733374761216 4844987 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 506436 16408 594 405 0 503380 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 65632 KiB

[startup+0.309798 s]*
/proc/loadavg: 0.53 0.73 1.07 4/187 23535
/proc/meminfo: memFree=27000956/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2025744 memory=90208 CPUtime=0.31 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 1776 0 0 0 30 1 0 0 20 0 1 0 246954269 2074361856 22552 33554432000 4194304 5849940 140733374761216 140733374761216 4500649 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 506436 22552 594 405 0 503380 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 90208 KiB

[startup+0.700372 s]
/proc/loadavg: 0.53 0.73 1.07 4/187 23535
/proc/meminfo: memFree=26952736/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2025744 memory=160092 CPUtime=0.69 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 1848 0 0 0 67 2 0 0 20 0 1 0 246954269 2074361856 40023 33554432000 4194304 5849940 140733374761216 140733374761216 4657719 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 506436 40023 628 405 0 503380 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 160092 KiB

[startup+1.50044 s]
/proc/loadavg: 0.53 0.73 1.07 5/187 23535
/proc/meminfo: memFree=26881292/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2033560 memory=263424 CPUtime=1.49 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 2143 0 0 0 145 4 0 0 20 0 1 0 246954269 2082365440 65856 33554432000 4194304 5849940 140733374761216 140733374760520 4489778 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 508390 65856 634 405 0 505334 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 263424 KiB

[startup+3.10968 s]
/proc/loadavg: 0.65 0.75 1.07 5/187 23535
/proc/meminfo: memFree=26548944/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2216596 memory=535568 CPUtime=3.1 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 3977 0 0 0 300 10 0 0 20 0 1 0 246954269 2269794304 133892 33554432000 4194304 5849940 140733374761216 140733374760520 4490931 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 554149 133892 676 405 0 551093 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2216596 KiB
Current children cumulated memory: 535568 KiB

[startup+6.30034 s]
/proc/loadavg: 0.65 0.75 1.07 4/187 23535
/proc/meminfo: memFree=26442800/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2235388 memory=635820 CPUtime=6.29 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 7525 0 0 0 597 32 0 0 20 0 1 0 246954269 2289037312 158955 33554432000 4194304 5849940 140733374761216 140733374760328 140385717059463 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 558847 158955 740 405 0 555791 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2235388 KiB
Current children cumulated memory: 635820 KiB

[startup+12.7003 s]
/proc/loadavg: 0.85 0.79 1.08 4/187 23535
/proc/meminfo: memFree=26363828/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2313212 memory=713884 CPUtime=12.7 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 11530 0 0 0 1233 37 0 0 20 0 1 0 246954269 2368729088 178471 33554432000 4194304 5849940 140733374761216 140733374760456 5472131 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 578303 178471 740 405 0 575247 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 2313212 KiB
Current children cumulated memory: 713884 KiB

[startup+25.5003 s]
/proc/loadavg: 1.03 0.83 1.09 4/187 23535
/proc/meminfo: memFree=26356872/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2313212 memory=713884 CPUtime=25.49 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 12173 0 0 0 2508 41 0 0 20 0 1 0 246954269 2368729088 178471 33554432000 4194304 5849940 140733374761216 140733374760312 140385716609034 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 578303 178471 740 405 0 575247 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2313212 KiB
Current children cumulated memory: 713884 KiB

[startup+51.1092 s]
/proc/loadavg: 1.36 0.93 1.11 4/187 23535
/proc/meminfo: memFree=26318824/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2345984 memory=746656 CPUtime=51.11 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 13753 0 0 0 5064 47 0 0 20 0 1 0 246954269 2402287616 186664 33554432000 4194304 5849940 140733374761216 140733374760312 5472014 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 586496 186664 740 405 0 583440 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 2345984 KiB
Current children cumulated memory: 746656 KiB

[startup+102.3 s]
/proc/loadavg: 1.74 1.11 1.16 4/187 23536
/proc/meminfo: memFree=26309228/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2345984 memory=746656 CPUtime=102.3 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 14476 0 0 0 10177 53 0 0 20 0 1 0 246954269 2402287616 186664 33554432000 4194304 5849940 140733374761216 140733374760312 5521670 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 586496 186664 740 405 0 583440 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2345984 KiB
Current children cumulated memory: 746656 KiB

[startup+162.3 s]
/proc/loadavg: 1.91 1.27 1.22 4/187 23537
/proc/meminfo: memFree=26144020/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2495844 memory=896740 CPUtime=162.3 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 52808 0 0 0 16168 62 0 0 20 0 1 0 246954269 2555744256 224185 33554432000 4194304 5849940 140733374761216 140733374760216 5312806 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 623961 224185 773 405 0 620905 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 2495844 KiB
Current children cumulated memory: 896740 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.40 1.27 4/187 23538
/proc/meminfo: memFree=26132140/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2501368 memory=902272 CPUtime=222.31 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 76957 0 0 0 22164 67 0 0 20 0 1 0 246954269 2561400832 225568 33554432000 4194304 5849940 140733374761216 140733374759704 5308629 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 625342 225568 773 405 0 622286 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 2501368 KiB
Current children cumulated memory: 902272 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.51 1.31 4/187 23539
/proc/meminfo: memFree=26180376/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2461448 memory=862352 CPUtime=282.31 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 101774 0 0 0 28160 71 0 0 20 0 1 0 246954269 2520522752 215588 33554432000 4194304 5849940 140733374761216 140733374760216 5339651 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 615362 215588 773 405 0 612306 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 2461448 KiB
Current children cumulated memory: 862352 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.60 1.35 4/188 23548
/proc/meminfo: memFree=26125908/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2484428 memory=885332 CPUtime=342.32 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 151037 0 0 0 34155 77 0 0 20 0 1 0 246954269 2544054272 221333 33554432000 4194304 5849940 140733374761216 140733374758760 140385717059463 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 621107 221333 773 405 0 618051 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 2484428 KiB
Current children cumulated memory: 885332 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.67 1.40 4/188 23549
/proc/meminfo: memFree=26144684/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2467736 memory=868640 CPUtime=402.32 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 199625 0 0 0 40144 88 0 0 20 0 1 0 246954269 2526961664 217160 33554432000 4194304 5849940 140733374761216 140733374759864 5365660 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 616934 217160 773 405 0 613878 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 2467736 KiB
Current children cumulated memory: 868640 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.73 1.43 4/188 23550
/proc/meminfo: memFree=26129928/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2484864 memory=885768 CPUtime=462.32 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 247097 0 0 0 46136 96 0 0 20 0 1 0 246954269 2544500736 221442 33554432000 4194304 5849940 140733374761216 140733374760088 140385717059463 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 621216 221442 773 405 0 618160 0
Current children cumulated CPU time: 462.32 s
Current children cumulated vsize: 2484864 KiB
Current children cumulated memory: 885768 KiB


################
# More data... #
################

/proc/23534/statm: 622167 224007 773 405 0 619111 0
Current children cumulated CPU time: 1782.41 s
Current children cumulated vsize: 2488668 KiB
Current children cumulated memory: 896028 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 1.87 4/188 23610
/proc/meminfo: memFree=25960508/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2488668 memory=896028 CPUtime=1842.41 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 724388 0 0 0 183940 301 0 0 20 0 1 0 246954269 2548396032 224007 33554432000 4194304 5849940 140733374761216 140733374760376 5307856 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622167 224007 773 405 0 619111 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 2488668 KiB
Current children cumulated memory: 896028 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 1.88 4/188 23611
/proc/meminfo: memFree=25968744/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2488668 memory=896028 CPUtime=1902.42 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 724930 0 0 0 189932 310 0 0 20 0 1 0 246954269 2548396032 224007 33554432000 4194304 5849940 140733374761216 140733374760216 5437772 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622167 224007 773 405 0 619111 0
Current children cumulated CPU time: 1902.42 s
Current children cumulated vsize: 2488668 KiB
Current children cumulated memory: 896028 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 1.89 4/188 23612
/proc/meminfo: memFree=25931520/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2502644 memory=910004 CPUtime=1962.42 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 726114 0 0 0 195928 314 0 0 20 0 1 0 246954269 2562707456 227501 33554432000 4194304 5849940 140733374761216 140733374760376 5438264 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 625661 227501 773 405 0 622605 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 2502644 KiB
Current children cumulated memory: 910004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 1.89 4/188 23613
/proc/meminfo: memFree=26045740/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2502644 memory=910004 CPUtime=2022.42 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 727015 0 0 0 201916 326 0 0 20 0 1 0 246954269 2562707456 227501 33554432000 4194304 5849940 140733374761216 140733374760216 5307805 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 625661 227501 773 405 0 622605 0
Current children cumulated CPU time: 2022.42 s
Current children cumulated vsize: 2502644 KiB
Current children cumulated memory: 910004 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 1.90 5/188 23614
/proc/meminfo: memFree=26000860/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2502644 memory=910004 CPUtime=2082.43 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 727556 0 0 0 207908 335 0 0 20 0 1 0 246954269 2562707456 227501 33554432000 4194304 5849940 140733374761216 140733374760216 140385717059463 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 625661 227501 773 405 0 622605 0
Current children cumulated CPU time: 2082.43 s
Current children cumulated vsize: 2502644 KiB
Current children cumulated memory: 910004 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.00 1.90 4/188 23620
/proc/meminfo: memFree=26015476/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2488416 memory=895776 CPUtime=2142.44 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 728751 0 0 0 213901 343 0 0 20 0 1 0 246954269 2548137984 223944 33554432000 4194304 5849940 140733374761216 140733374760376 5339250 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622104 223944 773 405 0 619048 0
Current children cumulated CPU time: 2142.44 s
Current children cumulated vsize: 2488416 KiB
Current children cumulated memory: 895776 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 1.91 4/188 23621
/proc/meminfo: memFree=26013800/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2488416 memory=895776 CPUtime=2202.44 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 729617 0 0 0 219891 353 0 0 20 0 1 0 246954269 2548137984 223944 33554432000 4194304 5849940 140733374761216 140733374759704 4233904 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622104 223944 773 405 0 619048 0
Current children cumulated CPU time: 2202.44 s
Current children cumulated vsize: 2488416 KiB
Current children cumulated memory: 895776 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 1.91 4/188 23622
/proc/meminfo: memFree=26045748/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2490860 memory=898000 CPUtime=2262.44 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 731498 0 0 0 225871 373 0 0 20 0 1 0 246954269 2550640640 224500 33554432000 4194304 5849940 140733374761216 140733374760216 140385717059463 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622715 224500 773 405 0 619659 0
Current children cumulated CPU time: 2262.44 s
Current children cumulated vsize: 2490860 KiB
Current children cumulated memory: 898000 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.00 1.92 4/188 23623
/proc/meminfo: memFree=26044568/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2322.45 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 733504 0 0 0 231856 389 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760216 5339977 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2322.45 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.00 1.93 4/188 23624
/proc/meminfo: memFree=25961176/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2382.46 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 734290 0 0 0 237852 394 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760088 5416904 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2382.46 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.00 1.93 5/188 23626
/proc/meminfo: memFree=26059268/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2442.46 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 734768 0 0 0 243846 400 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760216 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2442.46 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.00 1.94 4/188 23627
/proc/meminfo: memFree=26041720/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2502.46 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 735356 0 0 0 249838 408 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760216 5438039 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2502.46 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.00 1.94 5/188 23627
/proc/meminfo: memFree=26031544/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2520.06 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 735619 0 0 0 251597 409 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760376 5354062 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 23534 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2515.98 s, system=4.10132 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.00 1.94 5/188 23627
/proc/meminfo: memFree=26031544/32770624 swapFree=67108804/67108860
[pid=23534] ppid=23527 vsize=2491460 memory=898152 CPUtime=2520.06 cores=0,2,4,6
/proc/23534/stat : 23534 (xcsp_picat) R 23527 23534 23473 0 -1 4202496 735619 0 0 0 251597 409 0 0 20 0 1 0 246954269 2551255040 224538 33554432000 4194304 5849940 140733374761216 140733374760376 5354062 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 26931200 140733374764214 140733374764292 140733374764292 140733374767050 0
/proc/23534/statm: 622865 224538 773 405 0 619809 0
Current children cumulated CPU time: 2520.06 s
Current children cumulated vsize: 2491460 KiB
Current children cumulated memory: 898152 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.9
CPU time (s): 2520.08
CPU user time (s): 2515.98
CPU system time (s): 4.10132
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 2531720
Max. memory (cumulated for all children) (KiB): 910688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2515.98
system time used= 4.10132
maximum resident set size= 910688
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 735619
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30
involuntary context switches= 686


# summary of solver processes directly reported to runsolver:
#   pid: 23534
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2515.98
#   total CPU system time (s): 4.10132

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.50754 second user time and 18.5338 second system time

The end

Launcher Data 

Begin job on node105 at 2018-08-15 02:45:11
IDJOB=4309472
IDBENCH=141057
IDSOLVER=2794
FILE ID=node105/4309472-1534293911
RUNJOBID= node105-1534293911-23504
PBS_JOBID= 21038146
Free space on /tmp= 44288 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/NurseRostering/NurseRostering-13_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309472-1534293911/watcher-4309472-1534293911 -o /tmp/evaluation-result-4309472-1534293911/solver-4309472-1534293911 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1534293911-23504 --watchdog 2580  xcsp_picat HOME/instance-4309472-1534293911.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bfb8f77ba8ae689b0ec737170bc63bca
RANDOM SEED=1616799364

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.32
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27129808 kB
MemAvailable:   31910936 kB
Buffers:          208180 kB
Cached:          4832684 kB
SwapCached:           16 kB
Active:          2087244 kB
Inactive:        3006040 kB
Active(anon):       3992 kB
Inactive(anon):   100476 kB
Active(file):    2083252 kB
Inactive(file):  2905564 kB
Unevictable:        7356 kB
Mlocked:            7356 kB
SwapTotal:      67108860 kB
SwapFree:       67108804 kB
Dirty:              6712 kB
Writeback:             0 kB
AnonPages:         58964 kB
Mapped:            52936 kB
Shmem:             49748 kB
Slab:             243804 kB
SReclaimable:     216292 kB
SUnreclaim:        27512 kB
KernelStack:        3136 kB
PageTables:         5808 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     351024 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 44280 MiB
End job on node105 at 2018-08-15 03:27:11