Trace number 4303128

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.08 2519.81

General information on the benchmark

NameNurseRostering/
NurseRostering-09_c18.xml
MD5SUM01a28a521b9bba3b9351b91d9c8d3e2f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2750
Best CPU time to get the best result obtained on this benchmark2520.08
Satisfiable
(Un)Satisfiability was proved
Number of variables1844
Number of constraints4787
Number of domains17
Minimum domain size1
Maximum domain size37
Distribution of domain sizes[{"size":1,"count":60},{"size":2,"count":376},{"size":3,"count":8},{"size":4,"count":7},{"size":5,"count":1014},{"size":6,"count":6},{"size":29,"count":121},{"size":37,"count":252}]
Minimum variable degree2
Maximum variable degree25
Distribution of variable degrees[{"degree":2,"count":692},{"degree":3,"count":144},{"degree":14,"count":14},{"degree":15,"count":38},{"degree":16,"count":18},{"degree":17,"count":15},{"degree":18,"count":42},{"degree":19,"count":59},{"degree":20,"count":68},{"degree":21,"count":132},{"degree":22,"count":199},{"degree":23,"count":238},{"degree":24,"count":163},{"degree":25,"count":22}]
Minimum constraint arity2
Maximum constraint arity72
Distribution of constraint arities[{"arity":2,"count":2474},{"arity":3,"count":936},{"arity":4,"count":186},{"arity":5,"count":180},{"arity":6,"count":690},{"arity":29,"count":180},{"arity":37,"count":140},{"arity":72,"count":1}]
Number of extensional constraints1112
Number of intensional constraints552
Distribution of constraint types[{"type":"extension","count":1112},{"type":"intension","count":552},{"type":"regular","count":1896},{"type":"sum","count":72},{"type":"count","count":1154},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (120 MiB free)
  memory of node 1: 16384 MiB (5716 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303128-1533992754/watcher-4303128-1533992754 -o /tmp/evaluation-result-4303128-1533992754/solver-4303128-1533992754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32498 --watchdog 2580 xcsp_picat HOME/instance-4303128-1533992754.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=566, runsolver pid=563
Current StackSize limit: 8192 KiB


[startup+0.100599 s]*
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5946280/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2033560 memory=33028 CPUtime=0.09 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 1258 0 0 0 9 0 0 0 20 0 1 0 216838615 2082365440 8257 33554432000 4194304 5849708 140734680750336 140734680749640 4572157 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 508390 8257 635 405 0 505335 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 33028 KiB

[startup+0.209593 s]*
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5933156/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2033560 memory=46352 CPUtime=0.2 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 1535 0 0 0 19 1 0 0 20 0 1 0 216838615 2082365440 11588 33554432000 4194304 5849708 140734680750336 140734680749640 4491760 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 508390 11588 639 405 0 505335 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 46352 KiB

[startup+0.309487 s]*
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5918076/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2033560 memory=63516 CPUtime=0.3 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 1745 0 0 0 29 1 0 0 20 0 1 0 216838615 2082365440 15879 33554432000 4194304 5849708 140734680750336 140734680749640 4488955 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 508390 15879 655 405 0 505335 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 63516 KiB

[startup+0.700273 s]
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5904424/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2034316 memory=75136 CPUtime=0.69 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 2121 0 0 0 67 2 0 0 20 0 1 0 216838615 2083139584 18784 33554432000 4194304 5849708 140734680750336 140734680749432 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 508579 18784 737 405 0 505524 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034316 KiB
Current children cumulated memory: 75136 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5898672/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2039816 memory=80764 CPUtime=1.49 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 3605 0 0 0 142 7 0 0 20 0 1 0 216838615 2088771584 20191 33554432000 4194304 5849708 140734680750336 140734680749432 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 509954 20191 737 405 0 506899 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2039816 KiB
Current children cumulated memory: 80764 KiB

[startup+3.10888 s]
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5897652/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2041352 memory=82300 CPUtime=3.09 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 4314 0 0 0 301 8 0 0 20 0 1 0 216838615 2090344448 20575 33554432000 4194304 5849708 140734680750336 140734680749432 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 510338 20575 737 405 0 507283 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 2041352 KiB
Current children cumulated memory: 82300 KiB

[startup+6.3004 s]
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5888692/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2062572 memory=100284 CPUtime=6.28 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 15255 0 0 0 615 13 0 0 20 0 1 0 216838615 2112073728 25071 33554432000 4194304 5849708 140734680750336 140734680748984 5340258 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 515643 25071 756 405 0 512588 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 2062572 KiB
Current children cumulated memory: 100284 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.96 1.66 3/187 567
/proc/meminfo: memFree=5888072/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2050564 memory=91516 CPUtime=12.69 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 18910 0 0 0 1254 15 0 0 20 0 1 0 216838615 2099777536 22879 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 512641 22879 769 405 0 509586 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2050564 KiB
Current children cumulated memory: 91516 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 1.96 1.67 3/187 567
/proc/meminfo: memFree=5885892/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2051600 memory=91644 CPUtime=25.49 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 25095 0 0 0 2530 19 0 0 20 0 1 0 216838615 2100838400 22911 33554432000 4194304 5849708 140734680750336 140734680749336 5437443 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 512900 22911 769 405 0 509845 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2051600 KiB
Current children cumulated memory: 91644 KiB

[startup+51.1093 s]
/proc/loadavg: 2.00 1.96 1.68 3/187 567
/proc/meminfo: memFree=5883800/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2054032 memory=94980 CPUtime=51.1 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 31307 0 0 0 5081 29 0 0 20 0 1 0 216838615 2103328768 23745 33554432000 4194304 5849708 140734680750336 140734680749336 5437841 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 513508 23745 769 405 0 510453 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2054032 KiB
Current children cumulated memory: 94980 KiB

[startup+102.3 s]
/proc/loadavg: 1.81 1.92 1.68 3/187 720
/proc/meminfo: memFree=5823192/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2062976 memory=107636 CPUtime=102.3 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 35689 0 0 0 10171 59 0 0 20 0 1 0 216838615 2112487424 26909 33554432000 4194304 5849708 140734680750336 140734680749208 5327668 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 515744 26909 778 405 0 512689 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2062976 KiB
Current children cumulated memory: 107636 KiB

[startup+162.3 s]
/proc/loadavg: 1.93 1.93 1.70 3/187 721
/proc/meminfo: memFree=5789392/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2071168 memory=117676 CPUtime=162.31 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 36790 0 0 0 16138 93 0 0 20 0 1 0 216838615 2120876032 29419 33554432000 4194304 5849708 140734680750336 140734680749336 5359131 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 517792 29419 778 405 0 514737 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 2071168 KiB
Current children cumulated memory: 117676 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.94 1.72 3/187 722
/proc/meminfo: memFree=5788096/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2071168 memory=117676 CPUtime=222.31 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 36797 0 0 0 22104 127 0 0 20 0 1 0 216838615 2120876032 29419 33554432000 4194304 5849708 140734680750336 140734680749336 5437835 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 517792 29419 778 405 0 514737 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 2071168 KiB
Current children cumulated memory: 117676 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.96 1.73 3/188 731
/proc/meminfo: memFree=5778588/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2077576 memory=124428 CPUtime=282.31 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 39496 0 0 0 28064 167 0 0 20 0 1 0 216838615 2127437824 31107 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 519394 31107 778 405 0 516339 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 2077576 KiB
Current children cumulated memory: 124428 KiB

[startup+342.3 s]
/proc/loadavg: 2.07 1.98 1.76 3/188 732
/proc/meminfo: memFree=5766372/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2078940 memory=125780 CPUtime=342.33 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 40636 0 0 0 34028 205 0 0 20 0 1 0 216838615 2128834560 31445 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 519735 31445 778 405 0 516680 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 2078940 KiB
Current children cumulated memory: 125780 KiB

[startup+402.3 s]
/proc/loadavg: 2.03 1.98 1.77 3/188 733
/proc/meminfo: memFree=5760416/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2080564 memory=127416 CPUtime=402.33 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 43158 0 0 0 39993 240 0 0 20 0 1 0 216838615 2130497536 31854 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 520141 31854 778 405 0 517086 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 2080564 KiB
Current children cumulated memory: 127416 KiB

[startup+462.3 s]
/proc/loadavg: 2.06 2.00 1.79 3/188 734
/proc/meminfo: memFree=5709848/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2097448 memory=144300 CPUtime=462.33 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 47320 0 0 0 45945 288 0 0 20 0 1 0 216838615 2147786752 36075 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 524362 36075 778 405 0 521307 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 2097448 KiB
Current children cumulated memory: 144300 KiB


################
# More data... #
################

/proc/566/statm: 534722 46382 778 405 0 531667 0
Current children cumulated CPU time: 1722.48 s
Current children cumulated vsize: 2138888 KiB
Current children cumulated memory: 185528 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 774
/proc/meminfo: memFree=5620080/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2145156 memory=191780 CPUtime=1782.48 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 131327 0 0 0 177163 1085 0 0 20 0 1 0 216838615 2196639744 47945 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 536289 47945 778 405 0 533234 0
Current children cumulated CPU time: 1782.48 s
Current children cumulated vsize: 2145156 KiB
Current children cumulated memory: 191780 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 775
/proc/meminfo: memFree=5567144/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2188816 memory=235632 CPUtime=1842.5 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 153178 0 0 0 183118 1132 0 0 20 0 1 0 216838615 2241347584 58908 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 547204 58908 778 405 0 544149 0
Current children cumulated CPU time: 1842.5 s
Current children cumulated vsize: 2188816 KiB
Current children cumulated memory: 235632 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 776
/proc/meminfo: memFree=5568964/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2154596 memory=201416 CPUtime=1902.5 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 163905 0 0 0 189069 1181 0 0 20 0 1 0 216838615 2206306304 50354 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 538649 50354 778 405 0 535594 0
Current children cumulated CPU time: 1902.5 s
Current children cumulated vsize: 2154596 KiB
Current children cumulated memory: 201416 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.03 1.96 3/187 777
/proc/meminfo: memFree=5590500/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2150536 memory=197192 CPUtime=1962.51 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 169378 0 0 0 195032 1219 0 0 20 0 1 0 216838615 2202148864 49298 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 537634 49298 778 405 0 534579 0
Current children cumulated CPU time: 1962.51 s
Current children cumulated vsize: 2150536 KiB
Current children cumulated memory: 197192 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 1.96 3/187 778
/proc/meminfo: memFree=5628540/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2149236 memory=195840 CPUtime=2022.51 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 174682 0 0 0 200999 1252 0 0 20 0 1 0 216838615 2200817664 48960 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 537309 48960 778 405 0 534254 0
Current children cumulated CPU time: 2022.51 s
Current children cumulated vsize: 2149236 KiB
Current children cumulated memory: 195840 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/187 786
/proc/meminfo: memFree=5604748/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2148060 memory=194712 CPUtime=2082.52 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 190472 0 0 0 206968 1284 0 0 20 0 1 0 216838615 2199613440 48678 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 537015 48678 778 405 0 533960 0
Current children cumulated CPU time: 2082.52 s
Current children cumulated vsize: 2148060 KiB
Current children cumulated memory: 194712 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 787
/proc/meminfo: memFree=5588504/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2157272 memory=204124 CPUtime=2142.52 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 197291 0 0 0 212938 1314 0 0 20 0 1 0 216838615 2209046528 51031 33554432000 4194304 5849708 140734680750336 140734680749336 5437835 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 539318 51031 778 405 0 536263 0
Current children cumulated CPU time: 2142.52 s
Current children cumulated vsize: 2157272 KiB
Current children cumulated memory: 204124 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 788
/proc/meminfo: memFree=5556168/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2154976 memory=201828 CPUtime=2202.53 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 207440 0 0 0 218901 1352 0 0 20 0 1 0 216838615 2206695424 50457 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 538744 50457 778 405 0 535689 0
Current children cumulated CPU time: 2202.53 s
Current children cumulated vsize: 2154976 KiB
Current children cumulated memory: 201828 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 789
/proc/meminfo: memFree=5604228/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2146532 memory=193268 CPUtime=2262.53 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 212084 0 0 0 224873 1380 0 0 20 0 1 0 216838615 2198048768 48317 33554432000 4194304 5849708 140734680750336 140734680749336 5437824 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 536633 48317 778 405 0 533578 0
Current children cumulated CPU time: 2262.53 s
Current children cumulated vsize: 2146532 KiB
Current children cumulated memory: 193268 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 790
/proc/meminfo: memFree=5553584/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2153972 memory=200824 CPUtime=2322.54 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 229977 0 0 0 230843 1411 0 0 20 0 1 0 216838615 2205667328 50206 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 538493 50206 778 405 0 535438 0
Current children cumulated CPU time: 2322.54 s
Current children cumulated vsize: 2153972 KiB
Current children cumulated memory: 200824 KiB

[startup+2382.3 s]
/proc/loadavg: 2.04 2.03 1.97 3/187 791
/proc/meminfo: memFree=5594656/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2146176 memory=192836 CPUtime=2382.55 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 239712 0 0 0 236814 1441 0 0 20 0 1 0 216838615 2197684224 48209 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 536544 48209 778 405 0 533489 0
Current children cumulated CPU time: 2382.55 s
Current children cumulated vsize: 2146176 KiB
Current children cumulated memory: 192836 KiB

[startup+2442.3 s]
/proc/loadavg: 2.22 2.07 1.99 3/187 792
/proc/meminfo: memFree=5563276/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2145116 memory=191820 CPUtime=2442.56 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 245353 0 0 0 242779 1477 0 0 20 0 1 0 216838615 2196598784 47955 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 536279 47955 778 405 0 533224 0
Current children cumulated CPU time: 2442.56 s
Current children cumulated vsize: 2145116 KiB
Current children cumulated memory: 191820 KiB

[startup+2502.3 s]
/proc/loadavg: 2.43 2.18 2.03 3/187 793
/proc/meminfo: memFree=5583792/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2156980 memory=203692 CPUtime=2502.56 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 257310 0 0 0 248743 1513 0 0 20 0 1 0 216838615 2208747520 50923 33554432000 4194304 5849708 140734680750336 140734680749336 5335601 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 539245 50923 778 405 0 536190 0
Current children cumulated CPU time: 2502.56 s
Current children cumulated vsize: 2156980 KiB
Current children cumulated memory: 203692 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.31 2.16 2.03 3/187 793
/proc/meminfo: memFree=5578584/32770624 swapFree=67108504/67108860
[pid=566] ppid=563 vsize=2149792 memory=196460 CPUtime=2520.07 cores=1,3,5,7
/proc/566/stat : 566 (xcsp_picat) R 563 566 32466 0 -1 4202496 259040 0 0 0 250485 1522 0 0 20 0 1 0 216838615 2201387008 49115 33554432000 4194304 5849708 140734680750336 140734680749336 139809880063879 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9394900 24719360 140734680753334 140734680753412 140734680753412 140734680756170 0
/proc/566/statm: 537448 49115 778 405 0 534393 0
Current children cumulated CPU time: 2520.07 s
Current children cumulated vsize: 2149792 KiB
Current children cumulated memory: 196460 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.81 s]
# the end of solver process 566 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2504.85 s, system=15.2247 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.81
CPU time (s): 2520.08
CPU user time (s): 2504.85
CPU system time (s): 15.2247
CPU usage (%): 100.011
Max. virtual memory (cumulated for all children) (KiB): 2286152
Max. memory (cumulated for all children) (KiB): 332740

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2504.85
system time used= 15.2247
maximum resident set size= 332740
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 259040
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 1058


# summary of solver processes directly reported to runsolver:
#   pid: 566
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2504.85
#   total CPU system time (s): 15.2247

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.87488 second user time and 18.3675 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-11 15:05:54
IDJOB=4303128
IDBENCH=141047
IDSOLVER=2778
FILE ID=node104/4303128-1533992754
RUNJOBID= node104-1533991815-32498
PBS_JOBID= 21036946
Free space on /tmp= 37256 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/NurseRostering/NurseRostering-09_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303128-1533992754/watcher-4303128-1533992754 -o /tmp/evaluation-result-4303128-1533992754/solver-4303128-1533992754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1533991815-32498 --watchdog 2580  xcsp_picat HOME/instance-4303128-1533992754.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 01a28a521b9bba3b9351b91d9c8d3e2f
RANDOM SEED=813452128

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:         5977408 kB
MemAvailable:   31854756 kB
Buffers:          188684 kB
Cached:         25579448 kB
SwapCached:            8 kB
Active:          8692440 kB
Inactive:       17178148 kB
Active(anon):      53216 kB
Inactive(anon):   100928 kB
Active(file):    8639224 kB
Inactive(file): 17077220 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:              3196 kB
Writeback:             0 kB
AnonPages:        160396 kB
Mapped:            53224 kB
Shmem:             49636 kB
Slab:             618152 kB
SReclaimable:     589364 kB
SUnreclaim:        28788 kB
KernelStack:        3616 kB
PageTables:         5132 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2415168 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 37252 MiB
End job on node104 at 2018-08-11 15:47:54