Trace number 4309473

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2519.89 2520.01

General information on the benchmark

NameNurseRostering/
NurseRostering-14_c18.xml
MD5SUM22d4927d0bd5c0ea6a9359fe3e752ee5
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark27589
Best CPU time to get the best result obtained on this benchmark2519.95
Satisfiable
(Un)Satisfiability was proved
Number of variables2475
Number of constraints6489
Number of domains18
Minimum domain size1
Maximum domain size43
Distribution of domain sizes[{"size":1,"count":76},{"size":2,"count":551},{"size":3,"count":3},{"size":5,"count":1344},{"size":6,"count":17},{"size":11,"count":8},{"size":22,"count":34},{"size":33,"count":378},{"size":43,"count":64}]
Minimum variable degree2
Maximum variable degree27
Distribution of variable degrees[{"degree":2,"count":939},{"degree":3,"count":192},{"degree":14,"count":4},{"degree":15,"count":23},{"degree":16,"count":35},{"degree":17,"count":6},{"degree":18,"count":18},{"degree":19,"count":41},{"degree":20,"count":52},{"degree":21,"count":51},{"degree":22,"count":124},{"degree":23,"count":377},{"degree":24,"count":320},{"degree":25,"count":177},{"degree":26,"count":94},{"degree":27,"count":22}]
Minimum constraint arity2
Maximum constraint arity128
Distribution of constraint arities[{"arity":2,"count":2524},{"arity":3,"count":2080},{"arity":4,"count":273},{"arity":5,"count":32},{"arity":6,"count":957},{"arity":7,"count":252},{"arity":33,"count":210},{"arity":43,"count":160},{"arity":128,"count":1}]
Number of extensional constraints1522
Number of intensional constraints797
Distribution of constraint types[{"type":"extension","count":1522},{"type":"intension","count":797},{"type":"regular","count":2558},{"type":"sum","count":64},{"type":"count","count":1547},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6977 MiB free)
  memory of node 1: 16384 MiB (11111 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309473-1534293237/watcher-4309473-1534293237 -o /tmp/evaluation-result-4309473-1534293237/solver-4309473-1534293237 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1534293054-21341 --watchdog 2580 xcsp_picat HOME/instance-4309473-1534293237.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=21562, runsolver pid=21559

[startup+0.10017 s]*
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18491480/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2033560 memory=34344 CPUtime=0.1 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 1587 0 0 0 10 0 0 0 20 0 1 0 246886933 2082365440 8586 33554432000 4194304 5849940 140736933875488 140736933875488 4924536 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 508390 8586 633 405 0 505334 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 34344 KiB

[startup+0.20963 s]*
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18476648/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2033560 memory=49180 CPUtime=0.21 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 1722 0 0 0 20 1 0 0 20 0 1 0 246886933 2082365440 12295 33554432000 4194304 5849940 140736933875488 140736933875488 4580756 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 508390 12295 635 405 0 505334 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 49180 KiB

[startup+0.309517 s]*
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18463864/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2033560 memory=64028 CPUtime=0.31 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 1858 0 0 0 30 1 0 0 20 0 1 0 246886933 2082365440 16007 33554432000 4194304 5849940 140736933875488 140736933875488 4493984 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 508390 16007 638 405 0 505334 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 64028 KiB

[startup+0.700281 s]
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18424960/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2034312 memory=102204 CPUtime=0.69 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 2246 0 0 0 67 2 0 0 20 0 1 0 246886933 2083135488 25551 33554432000 4194304 5849940 140736933875488 140736933874792 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 508578 25551 737 405 0 505522 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034312 KiB
Current children cumulated memory: 102204 KiB

[startup+1.5003 s]
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18424216/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2036556 memory=104468 CPUtime=1.49 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 2791 0 0 0 141 8 0 0 20 0 1 0 246886933 2085433344 26117 33554432000 4194304 5849940 140736933875488 140736933874584 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 509139 26117 737 405 0 506083 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2036556 KiB
Current children cumulated memory: 104468 KiB

[startup+3.10911 s]
/proc/loadavg: 2.04 1.60 1.44 3/188 21563
/proc/meminfo: memFree=18415504/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2042648 memory=110668 CPUtime=3.1 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 4497 0 0 0 299 11 0 0 20 0 1 0 246886933 2091671552 27667 33554432000 4194304 5849940 140736933875488 140736933874728 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 510662 27667 737 405 0 507606 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2042648 KiB
Current children cumulated memory: 110668 KiB

[startup+6.30027 s]
/proc/loadavg: 2.03 1.61 1.44 3/188 21563
/proc/meminfo: memFree=18412540/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2045720 memory=113740 CPUtime=6.29 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 5756 0 0 0 615 14 0 0 20 0 1 0 246886933 2094817280 28435 33554432000 4194304 5849940 140736933875488 140736933874584 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 511430 28435 737 405 0 508374 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2045720 KiB
Current children cumulated memory: 113740 KiB

[startup+12.7003 s]
/proc/loadavg: 2.03 1.62 1.44 3/188 21563
/proc/meminfo: memFree=18389716/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2068688 memory=136692 CPUtime=12.69 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 25174 0 0 0 1249 20 0 0 20 0 1 0 246886933 2118336512 34173 33554432000 4194304 5849940 140736933875488 140736933873032 5309774 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 517172 34173 765 405 0 514116 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2068688 KiB
Current children cumulated memory: 136692 KiB

[startup+25.5003 s]
/proc/loadavg: 2.02 1.64 1.45 3/188 21563
/proc/meminfo: memFree=18387048/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2068036 memory=135868 CPUtime=25.49 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 31810 0 0 0 2522 27 0 0 20 0 1 0 246886933 2117668864 33967 33554432000 4194304 5849940 140736933875488 140736933873032 4207882 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 517009 33967 769 405 0 513953 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2068036 KiB
Current children cumulated memory: 135868 KiB

[startup+51.1094 s]
/proc/loadavg: 2.02 1.67 1.47 3/188 21563
/proc/meminfo: memFree=18379012/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2074060 memory=139892 CPUtime=51.09 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 45443 0 0 0 5057 52 0 0 20 0 1 0 246886933 2123837440 34973 33554432000 4194304 5849940 140736933875488 140736933874488 5311616 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 518515 34973 769 405 0 515459 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2074060 KiB
Current children cumulated memory: 139892 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 1.72 1.50 3/188 21564
/proc/meminfo: memFree=18383704/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2075044 memory=142068 CPUtime=102.28 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 54646 0 0 0 10137 91 0 0 20 0 1 0 246886933 2124845056 35517 33554432000 4194304 5849940 140736933875488 140736933873752 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 518761 35517 769 405 0 515705 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2075044 KiB
Current children cumulated memory: 142068 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 1.78 1.53 3/187 21565
/proc/meminfo: memFree=18375620/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2080632 memory=148216 CPUtime=162.28 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 64746 0 0 0 16083 145 0 0 20 0 1 0 246886933 2130567168 37054 33554432000 4194304 5849940 140736933875488 140736933874648 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 520158 37054 769 405 0 517102 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2080632 KiB
Current children cumulated memory: 148216 KiB

[startup+222.3 s]
/proc/loadavg: 2.10 1.84 1.57 3/187 21566
/proc/meminfo: memFree=18370396/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2081316 memory=149200 CPUtime=222.27 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 81849 0 0 0 22035 192 0 0 20 0 1 0 246886933 2131267584 37300 33554432000 4194304 5849940 140736933875488 140736933874360 5309859 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 520329 37300 769 405 0 517273 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2081316 KiB
Current children cumulated memory: 149200 KiB

[startup+282.3 s]
/proc/loadavg: 2.68 2.09 1.67 3/187 21567
/proc/meminfo: memFree=18410344/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2076528 memory=144524 CPUtime=282.27 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 101824 0 0 0 27982 245 0 0 20 0 1 0 246886933 2126364672 36131 33554432000 4194304 5849940 140736933875488 140736933874200 5326416 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 519132 36131 778 405 0 516076 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 2076528 KiB
Current children cumulated memory: 144524 KiB

[startup+342.3 s]
/proc/loadavg: 2.25 2.07 1.69 3/187 21568
/proc/meminfo: memFree=18382164/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2079600 memory=145360 CPUtime=342.27 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 108104 0 0 0 33923 304 0 0 20 0 1 0 246886933 2129510400 36340 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 519900 36340 778 405 0 516844 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 2079600 KiB
Current children cumulated memory: 145360 KiB

[startup+402.3 s]
/proc/loadavg: 2.14 2.07 1.72 3/188 21577
/proc/meminfo: memFree=18348212/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2100508 memory=168672 CPUtime=402.27 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 110173 0 0 0 39876 351 0 0 20 0 1 0 246886933 2150920192 42168 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 525127 42168 778 405 0 522071 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 2100508 KiB
Current children cumulated memory: 168672 KiB

[startup+462.3 s]
/proc/loadavg: 2.05 2.06 1.73 3/188 21578
/proc/meminfo: memFree=18321852/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2116892 memory=185012 CPUtime=462.26 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 119146 0 0 0 45828 398 0 0 20 0 1 0 246886933 2167697408 46253 33554432000 4194304 5849940 140736933875488 140736933874488 5392374 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 529223 46253 778 405 0 526167 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 2116892 KiB
Current children cumulated memory: 185012 KiB


################
# More data... #
################

/proc/21562/statm: 536699 54497 778 405 0 533643 0
Current children cumulated CPU time: 1722.2 s
Current children cumulated vsize: 2146796 KiB
Current children cumulated memory: 217988 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.93 3/189 21703
/proc/meminfo: memFree=9493860/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2166288 memory=232124 CPUtime=1782.2 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 253970 0 0 0 176826 1394 0 0 20 0 1 0 246886933 2218278912 58031 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 541572 58031 778 405 0 538516 0
Current children cumulated CPU time: 1782.2 s
Current children cumulated vsize: 2166288 KiB
Current children cumulated memory: 232124 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 1.94 3/189 21704
/proc/meminfo: memFree=5288788/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2133848 memory=199784 CPUtime=1842.2 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 259285 0 0 0 182783 1437 0 0 20 0 1 0 246886933 2185060352 49946 33554432000 4194304 5849940 140736933875488 140736933874488 5438474 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 533462 49946 778 405 0 530406 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 2133848 KiB
Current children cumulated memory: 199784 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 21705
/proc/meminfo: memFree=5241472/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2131796 memory=197732 CPUtime=1902.2 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 268239 0 0 0 188742 1478 0 0 20 0 1 0 246886933 2182959104 49433 33554432000 4194304 5849940 140736933875488 140736933874488 5312969 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 532949 49433 778 405 0 529893 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 2131796 KiB
Current children cumulated memory: 197732 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 21706
/proc/meminfo: memFree=11983532/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2134260 memory=205400 CPUtime=1962.19 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 272773 0 0 0 194701 1518 0 0 20 0 1 0 246886933 2185482240 51350 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 533565 51350 778 405 0 530509 0
Current children cumulated CPU time: 1962.19 s
Current children cumulated vsize: 2134260 KiB
Current children cumulated memory: 205400 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 21707
/proc/meminfo: memFree=9892268/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2154688 memory=225840 CPUtime=2022.19 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 281111 0 0 0 200662 1557 0 0 20 0 1 0 246886933 2206400512 56460 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 538672 56460 778 405 0 535616 0
Current children cumulated CPU time: 2022.19 s
Current children cumulated vsize: 2154688 KiB
Current children cumulated memory: 225840 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 21708
/proc/meminfo: memFree=4995232/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2202736 memory=273848 CPUtime=2082.18 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 284885 0 0 0 206617 1601 0 0 20 0 1 0 246886933 2255601664 68462 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 550684 68462 778 405 0 547628 0
Current children cumulated CPU time: 2082.18 s
Current children cumulated vsize: 2202736 KiB
Current children cumulated memory: 273848 KiB

[startup+2142.3 s]
/proc/loadavg: 2.08 2.03 1.96 3/188 21709
/proc/meminfo: memFree=4987036/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2161296 memory=232384 CPUtime=2142.18 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 294305 0 0 0 212576 1642 0 0 20 0 1 0 246886933 2213167104 58096 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 540324 58096 778 405 0 537268 0
Current children cumulated CPU time: 2142.18 s
Current children cumulated vsize: 2161296 KiB
Current children cumulated memory: 232384 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.02 1.96 3/188 21715
/proc/meminfo: memFree=4942052/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2154904 memory=225948 CPUtime=2202.18 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 298647 0 0 0 218520 1698 0 0 20 0 1 0 246886933 2206621696 56487 33554432000 4194304 5849940 140736933875488 140736933874648 5417043 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 538726 56487 778 405 0 535670 0
Current children cumulated CPU time: 2202.18 s
Current children cumulated vsize: 2154904 KiB
Current children cumulated memory: 225948 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 1.96 3/188 21716
/proc/meminfo: memFree=11928980/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2161284 memory=232368 CPUtime=2262.18 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 305272 0 0 0 224477 1741 0 0 20 0 1 0 246886933 2213154816 58092 33554432000 4194304 5849940 140736933875488 140736933874488 5313082 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 540321 58092 778 405 0 537265 0
Current children cumulated CPU time: 2262.18 s
Current children cumulated vsize: 2161284 KiB
Current children cumulated memory: 232368 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/188 21717
/proc/meminfo: memFree=10256464/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2161500 memory=232684 CPUtime=2322.18 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 309441 0 0 0 230432 1786 0 0 20 0 1 0 246886933 2213376000 58171 33554432000 4194304 5849940 140736933875488 140736933874488 5312960 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 540375 58171 778 405 0 537319 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 2161500 KiB
Current children cumulated memory: 232684 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/188 21718
/proc/meminfo: memFree=9008728/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2194244 memory=265376 CPUtime=2382.17 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 318270 0 0 0 236382 1835 0 0 20 0 1 0 246886933 2246905856 66344 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 548561 66344 778 405 0 545505 0
Current children cumulated CPU time: 2382.17 s
Current children cumulated vsize: 2194244 KiB
Current children cumulated memory: 265376 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/188 21719
/proc/meminfo: memFree=4711848/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2165836 memory=237016 CPUtime=2442.17 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 322147 0 0 0 242341 1876 0 0 20 0 1 0 246886933 2217816064 59254 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 541459 59254 778 405 0 538403 0
Current children cumulated CPU time: 2442.17 s
Current children cumulated vsize: 2165836 KiB
Current children cumulated memory: 237016 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.96 3/188 21720
/proc/meminfo: memFree=4668436/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2160436 memory=231548 CPUtime=2502.17 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 330542 0 0 0 248298 1919 0 0 20 0 1 0 246886933 2212286464 57887 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 540109 57887 778 405 0 537053 0
Current children cumulated CPU time: 2502.17 s
Current children cumulated vsize: 2160436 KiB
Current children cumulated memory: 231548 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 1.96 3/188 21720
/proc/meminfo: memFree=9245020/32770624 swapFree=67108792/67108860
[pid=21562] ppid=21559 vsize=2189852 memory=260772 CPUtime=2519.87 cores=1,3,5,7
/proc/21562/stat : 21562 (xcsp_picat) R 21559 21562 21309 0 -1 4202496 337029 0 0 0 250055 1932 0 0 20 0 1 0 246886933 2242408448 65193 33554432000 4194304 5849940 140736933875488 140736933874488 140557149134727 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7949816 9396308 34660352 140736933881014 140736933881092 140736933881092 140736933883850 0
/proc/21562/statm: 547463 65193 778 405 0 544407 0
Current children cumulated CPU time: 2519.87 s
Current children cumulated vsize: 2189852 KiB
Current children cumulated memory: 260772 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 21562 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2500.56 s, system=19.3301 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.89
CPU user time (s): 2500.56
CPU system time (s): 19.3301
CPU usage (%): 99.995
Max. virtual memory (cumulated for all children) (KiB): 2206604
Max. memory (cumulated for all children) (KiB): 277788

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2500.56
system time used= 19.3301
maximum resident set size= 277788
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 337029
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24
involuntary context switches= 1256


# summary of solver processes directly reported to runsolver:
#   pid: 21562
#   total CPU time (s): 2519.89
#   total CPU user time (s): 2500.56
#   total CPU system time (s): 19.3301

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1103 second user time and 17.4848 second system time

The end

Launcher Data 

Begin job on node150 at 2018-08-15 02:33:57
IDJOB=4309473
IDBENCH=141045
IDSOLVER=2794
FILE ID=node150/4309473-1534293237
RUNJOBID= node150-1534293054-21341
PBS_JOBID= 21038136
Free space on /tmp= 38000 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/NurseRostering/NurseRostering-14_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309473-1534293237/watcher-4309473-1534293237 -o /tmp/evaluation-result-4309473-1534293237/solver-4309473-1534293237 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1534293054-21341 --watchdog 2580  xcsp_picat HOME/instance-4309473-1534293237.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 22d4927d0bd5c0ea6a9359fe3e752ee5
RANDOM SEED=1470216285

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18523748 kB
MemAvailable:   31829448 kB
Buffers:          243576 kB
Cached:         13220668 kB
SwapCached:           32 kB
Active:          6347068 kB
Inactive:        7246148 kB
Active(anon):      80420 kB
Inactive(anon):   100944 kB
Active(file):    6266648 kB
Inactive(file):  7145204 kB
Unevictable:        7740 kB
Mlocked:            7740 kB
SwapTotal:      67108860 kB
SwapFree:       67108792 kB
Dirty:              3568 kB
Writeback:             0 kB
AnonPages:        148592 kB
Mapped:            57948 kB
Shmem:             49732 kB
Slab:             350776 kB
SReclaimable:     322308 kB
SUnreclaim:        28468 kB
KernelStack:        3584 kB
PageTables:         5520 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2434492 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     79872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 37996 MiB
End job on node150 at 2018-08-15 03:15:57