Trace number 4395724

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2019-09-12? (TO) 2400.04 2400.11

General information on the benchmark

NameNurseRostering/
NurseRostering-18_c18.xml
MD5SUM2080050c46f9199df44cd86a0d29de9d
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark48151
Best CPU time to get the best result obtained on this benchmark2400.1
Satisfiable
(Un)Satisfiability was proved
Number of variables3286
Number of constraints8967
Number of domains16
Minimum domain size1
Maximum domain size85
Distribution of domain sizes[{"size":1,"count":96},{"size":2,"count":678},{"size":4,"count":1848},{"size":23,"count":588},{"size":41,"count":2},{"size":44,"count":16},{"size":85,"count":58}]
Minimum variable degree2
Maximum variable degree23
Distribution of variable degrees[{"degree":2,"count":1174},{"degree":3,"count":264},{"degree":13,"count":19},{"degree":14,"count":23},{"degree":15,"count":2},{"degree":16,"count":17},{"degree":17,"count":24},{"degree":18,"count":38},{"degree":19,"count":38},{"degree":20,"count":189},{"degree":21,"count":776},{"degree":22,"count":573},{"degree":23,"count":149}]
Minimum constraint arity2
Maximum constraint arity176
Distribution of constraint arities[{"arity":2,"count":3148},{"arity":3,"count":3608},{"arity":4,"count":22},{"arity":5,"count":320},{"arity":6,"count":1422},{"arity":12,"count":22},{"arity":23,"count":336},{"arity":85,"count":88},{"arity":176,"count":1}]
Number of extensional constraints2162
Number of intensional constraints986
Distribution of constraint types[{"type":"extension","count":2162},{"type":"intension","count":986},{"type":"regular","count":3608},{"type":"sum","count":44},{"type":"count","count":2166},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

45.19/45.29	c xcsp_picat version 2.7b12 (9/12/2019)
350.47/350.55	o 30407

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11637 MiB free)
  memory of node 1: 16384 MiB (14438 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4395724-1568348871/watcher-4395724-1568348871 -o /tmp/evaluation-result-4395724-1568348871/solver-4395724-1568348871 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1568328264-22070 --watchdog 2560 xcsp_picat HOME/instance-4395724-1568348871.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=29037, runsolver pid=29034
Current StackSize limit: 8192 KiB


[startup+0.100165 s]*
/proc/loadavg: 2.01 2.00 2.04 3/199 29038
/proc/meminfo: memFree=26671180/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2031716 memory=36052 CPUtime=0.1 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 2053 0 0 0 10 0 0 0 20 0 1 0 410800988 2080477184 9013 33554432000 4194304 5870510 140726145841184 140726145838328 4460015 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 507929 9013 866 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 36052 KiB

[startup+0.20981 s]*
/proc/loadavg: 2.01 2.00 2.04 3/199 29038
/proc/meminfo: memFree=26652500/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2039532 memory=54700 CPUtime=0.2 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 2120 0 0 0 20 0 0 0 20 0 1 0 410800988 2088480768 13675 33554432000 4194304 5870510 140726145841184 140726145838328 4849456 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 509883 13675 879 410 0 505356 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2039532 KiB
Current children cumulated memory: 54700 KiB

[startup+0.309596 s]*
/proc/loadavg: 2.01 2.00 2.04 3/199 29038
/proc/meminfo: memFree=26633944/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2039532 memory=73364 CPUtime=0.3 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 2179 0 0 0 30 0 0 0 20 0 1 0 410800988 2088480768 18341 33554432000 4194304 5870510 140726145841184 140726145838328 4475081 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 509883 18341 879 410 0 505356 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2039532 KiB
Current children cumulated memory: 73364 KiB

[startup+0.700399 s]
/proc/loadavg: 2.01 2.00 2.04 3/199 29038
/proc/meminfo: memFree=26600804/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2039532 memory=133412 CPUtime=0.69 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 2335 0 0 0 68 1 0 0 20 0 1 0 410800988 2088480768 33353 33554432000 4194304 5870510 140726145841184 140726145838328 4466606 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 509883 33353 900 410 0 505356 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2039532 KiB
Current children cumulated memory: 133412 KiB

[startup+1.50028 s]
/proc/loadavg: 2.01 2.00 2.04 3/199 29038
/proc/meminfo: memFree=26550784/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2039832 memory=155336 CPUtime=1.49 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 2707 0 0 0 147 2 0 0 20 0 1 0 410800988 2088787968 38834 33554432000 4194304 5870510 140726145841184 140726145840488 5558772 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 509958 38834 976 410 0 505431 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2039832 KiB
Current children cumulated memory: 155336 KiB

[startup+3.10939 s]
/proc/loadavg: 2.09 2.02 2.05 3/199 29038
/proc/meminfo: memFree=26527660/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2071820 memory=210080 CPUtime=3.09 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 9917 0 0 0 307 2 0 0 20 0 1 0 410800988 2121543680 52520 33554432000 4194304 5870510 140726145841184 140726145840360 140704095443941 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 517955 52520 985 410 0 513428 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 2071820 KiB
Current children cumulated memory: 210080 KiB

[startup+6.30027 s]
/proc/loadavg: 2.09 2.02 2.05 3/199 29038
/proc/meminfo: memFree=26477320/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2094984 memory=228812 CPUtime=6.29 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 14012 0 0 0 619 10 0 0 20 0 1 0 410800988 2145263616 57203 33554432000 4194304 5870510 140726145841184 140726145840280 5562056 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 523746 57203 986 410 0 519219 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2094984 KiB
Current children cumulated memory: 228812 KiB

[startup+12.7003 s]
/proc/loadavg: 2.08 2.02 2.05 3/199 29038
/proc/meminfo: memFree=26475088/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2101312 memory=231580 CPUtime=12.69 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 16619 0 0 0 1258 11 0 0 20 0 1 0 410800988 2151743488 57895 33554432000 4194304 5870510 140726145841184 140726145839512 140704095492034 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 525328 57895 986 410 0 520801 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2101312 KiB
Current children cumulated memory: 231580 KiB

[startup+25.5003 s]
/proc/loadavg: 2.07 2.02 2.05 3/199 29040
/proc/meminfo: memFree=26464940/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2106284 memory=240740 CPUtime=25.49 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 21342 0 0 0 2536 13 0 0 20 0 1 0 410800988 2156834816 60185 33554432000 4194304 5870510 140726145841184 140726145840280 140704095903623 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 526571 60185 986 410 0 522044 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2106284 KiB
Current children cumulated memory: 240740 KiB

[startup+51.1096 s]
/proc/loadavg: 2.04 2.01 2.05 3/199 29041
/proc/meminfo: memFree=26415856/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2158924 memory=289788 CPUtime=51.09 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 57670 0 0 0 5081 28 0 0 20 0 1 0 410800988 2210738176 72447 33554432000 4194304 5870510 140726145841184 140726145839752 5274889 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 539731 72447 1018 410 0 535204 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2158924 KiB
Current children cumulated memory: 289788 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.01 2.05 3/199 29045
/proc/meminfo: memFree=26341564/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2229696 memory=357520 CPUtime=102.28 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 82014 0 0 0 10196 32 0 0 20 0 1 0 410800988 2283208704 89380 33554432000 4194304 5870510 140726145841184 140726145839624 140704095443419 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 557424 89380 1018 410 0 552897 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2229696 KiB
Current children cumulated memory: 357520 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 29051
/proc/meminfo: memFree=26312836/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2254724 memory=391108 CPUtime=162.27 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 118676 0 0 0 16190 37 0 0 20 0 1 0 410800988 2308837376 97777 33554432000 4194304 5870510 140726145841184 140726145840200 5304464 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 563681 97777 1018 410 0 559154 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2254724 KiB
Current children cumulated memory: 391108 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29064
/proc/meminfo: memFree=26312320/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2254724 memory=391108 CPUtime=222.28 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 145623 0 0 0 22182 46 0 0 20 0 1 0 410800988 2308837376 97777 33554432000 4194304 5870510 140726145841184 140726145840200 5289561 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 563681 97777 1018 410 0 559154 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2254724 KiB
Current children cumulated memory: 391108 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29068
/proc/meminfo: memFree=26289604/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2304044 memory=425856 CPUtime=282.27 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 173317 0 0 0 28173 54 0 0 20 0 1 0 410800988 2359341056 106464 33554432000 4194304 5870510 140726145841184 140726145839624 5311042 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 576011 106464 1018 410 0 571484 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 2304044 KiB
Current children cumulated memory: 425856 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29074
/proc/meminfo: memFree=26397700/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2180304 memory=318172 CPUtime=342.27 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 198009 0 0 0 34145 82 0 0 20 0 1 0 410800988 2232631296 79543 33554432000 4194304 5870510 140726145841184 140726145839896 5282578 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 545076 79543 1025 410 0 540549 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 2180304 KiB
Current children cumulated memory: 318172 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29078
/proc/meminfo: memFree=26359112/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2223712 memory=354248 CPUtime=402.28 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 199869 0 0 0 40145 83 0 0 20 0 1 0 410800988 2277081088 88562 33554432000 4194304 5870510 140726145841184 140726145839752 5282464 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 555928 88562 1025 410 0 551401 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 2223712 KiB
Current children cumulated memory: 354248 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29146
/proc/meminfo: memFree=26362748/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2224476 memory=362708 CPUtime=462.27 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 214882 0 0 0 46138 89 0 0 20 0 1 0 410800988 2277863424 90677 33554432000 4194304 5870510 140726145841184 140726145840200 5282606 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 556119 90677 1025 410 0 551592 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 2224476 KiB
Current children cumulated memory: 362708 KiB


################
# More data... #
################

/proc/29037/statm: 594332 126158 1025 410 0 589805 0
Current children cumulated CPU time: 1662.23 s
Current children cumulated vsize: 2377328 KiB
Current children cumulated memory: 504632 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 29260
/proc/meminfo: memFree=26087616/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2377328 memory=498612 CPUtime=1722.23 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 399933 0 0 0 171948 275 0 0 20 0 1 0 410800988 2434383872 124653 33554432000 4194304 5870510 140726145841184 140726145840136 5282738 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 594332 124653 1025 410 0 589805 0
Current children cumulated CPU time: 1722.23 s
Current children cumulated vsize: 2377328 KiB
Current children cumulated memory: 498612 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 29266
/proc/meminfo: memFree=26078480/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=513804 CPUtime=1782.23 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 405255 0 0 0 177943 280 0 0 20 0 1 0 410800988 2449190912 128451 33554432000 4194304 5870510 140726145841184 140726145840200 5282280 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 128451 1025 410 0 593420 0
Current children cumulated CPU time: 1782.23 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 513804 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29270
/proc/meminfo: memFree=26096684/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=524312 CPUtime=1842.23 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 409621 0 0 0 183930 293 0 0 20 0 1 0 410800988 2449190912 131078 33554432000 4194304 5870510 140726145841184 140726145840200 140704101141074 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 131078 1025 410 0 593420 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 524312 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29275
/proc/meminfo: memFree=26063524/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=526092 CPUtime=1902.23 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 418204 0 0 0 189914 309 0 0 20 0 1 0 410800988 2449190912 131523 33554432000 4194304 5870510 140726145841184 140726145840200 5282505 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 131523 1025 410 0 593420 0
Current children cumulated CPU time: 1902.23 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 526092 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29281
/proc/meminfo: memFree=26068356/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2441876 memory=551184 CPUtime=1962.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 425462 0 0 0 195900 322 0 0 20 0 1 0 410800988 2500481024 137796 33554432000 4194304 5870510 140726145841184 140726145840136 5282425 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 610469 137796 1025 410 0 605942 0
Current children cumulated CPU time: 1962.22 s
Current children cumulated vsize: 2441876 KiB
Current children cumulated memory: 551184 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 29293
/proc/meminfo: memFree=26069524/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=512024 CPUtime=2022.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 448647 0 0 0 201885 337 0 0 20 0 1 0 410800988 2449190912 128006 33554432000 4194304 5870510 140726145841184 140726145840200 5283630 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 128006 1025 410 0 593420 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 512024 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29320
/proc/meminfo: memFree=26099292/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=517900 CPUtime=2082.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 451512 0 0 0 207882 340 0 0 20 0 1 0 410800988 2449190912 129475 33554432000 4194304 5870510 140726145841184 140726145840200 5283106 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 129475 1025 410 0 593420 0
Current children cumulated CPU time: 2082.22 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 517900 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 29326
/proc/meminfo: memFree=26092080/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2391788 memory=524312 CPUtime=2142.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 455728 0 0 0 213878 344 0 0 20 0 1 0 410800988 2449190912 131078 33554432000 4194304 5870510 140726145841184 140726145840200 5282515 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 597947 131078 1025 410 0 593420 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 2391788 KiB
Current children cumulated memory: 524312 KiB

[startup+2202.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/201 29330
/proc/meminfo: memFree=26074384/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=542164 CPUtime=2202.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 462113 0 0 0 219872 350 0 0 20 0 1 0 410800988 2474786816 135541 33554432000 4194304 5870510 140726145841184 140726145840200 5308364 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 135541 1025 410 0 599669 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 542164 KiB

[startup+2262.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/201 29334
/proc/meminfo: memFree=26036636/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=548308 CPUtime=2262.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 467584 0 0 0 225862 360 0 0 20 0 1 0 410800988 2474786816 137077 33554432000 4194304 5870510 140726145841184 140726145840200 5282609 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 137077 1025 410 0 599669 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 548308 KiB

[startup+2322.3 s]
/proc/loadavg: 2.42 2.15 2.09 3/200 29340
/proc/meminfo: memFree=26028632/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=554452 CPUtime=2322.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 473298 0 0 0 231852 370 0 0 20 0 1 0 410800988 2474786816 138613 33554432000 4194304 5870510 140726145841184 140726145840200 5283024 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 138613 1025 410 0 599669 0
Current children cumulated CPU time: 2322.22 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 554452 KiB

[startup+2382.3 s]
/proc/loadavg: 2.15 2.12 2.08 3/199 29344
/proc/meminfo: memFree=26069268/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=548040 CPUtime=2382.22 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 479061 0 0 0 237845 377 0 0 20 0 1 0 410800988 2474786816 137010 33554432000 4194304 5870510 140726145841184 140726145840200 5274516 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 137010 1025 410 0 599669 0
Current children cumulated CPU time: 2382.22 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 548040 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.11 2.12 2.08 3/199 29345
/proc/meminfo: memFree=26035200/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=548308 CPUtime=2400.03 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 480937 0 0 0 239625 378 0 0 20 0 1 0 410800988 2474786816 137077 33554432000 4194304 5870510 140726145841184 140726145840200 5282759 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 137077 1025 410 0 599669 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 548308 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 29037 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2396.25 s, system=3.78893 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.11 2.12 2.08 3/199 29345
/proc/meminfo: memFree=26035200/32770624 swapFree=66957012/67108860
[pid=29037] ppid=29034 vsize=2416784 memory=548308 CPUtime=2400.03 cores=1,3,5,7
/proc/29037/stat : 29037 (xcsp_picat) R 29034 29037 22038 0 -1 4202496 480937 0 0 0 239625 378 0 0 20 0 1 0 410800988 2474786816 137077 33554432000 4194304 5870510 140726145841184 140726145840200 5282759 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7970040 9572284 41963520 140726145844255 140726145844333 140726145844333 140726145847242 0
/proc/29037/statm: 604196 137077 1025 410 0 599669 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 2416784 KiB
Current children cumulated memory: 548308 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.11
CPU time (s): 2400.04
CPU user time (s): 2396.25
CPU system time (s): 3.78893
CPU usage (%): 99.997
Max. virtual memory (cumulated for all children) (KiB): 2547012
Max. memory (cumulated for all children) (KiB): 642544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2396.25
system time used= 3.78893
maximum resident set size= 646552
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 480937
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 32
involuntary context switches= 2656


# summary of solver processes directly reported to runsolver:
#   pid: 29037
#   total CPU time (s): 2400.04
#   total CPU user time (s): 2396.25
#   total CPU system time (s): 3.78893

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.61649 second user time and 17.7268 second system time

The end

Launcher Data 

Begin job on node147 at 2019-09-13 06:27:08
IDJOB=4395724
IDBENCH=141053
IDSOLVER=2845
FILE ID=node147/4395724-1568348871
RUNJOBID= node147-1568328264-22070
PBS_JOBID= 21701153
Free space on /tmp= 56540 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP18/NurseRostering/NurseRostering-18_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4395724-1568348871/watcher-4395724-1568348871 -o /tmp/evaluation-result-4395724-1568348871/solver-4395724-1568348871 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node147-1568328264-22070 --watchdog 2560  xcsp_picat HOME/instance-4395724-1568348871.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2080050c46f9199df44cd86a0d29de9d
RANDOM SEED=1197035547

node147.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26701536 kB
MemAvailable:   31703772 kB
Buffers:          146952 kB
Cached:          5073336 kB
SwapCached:        48500 kB
Active:          2188568 kB
Inactive:        3194088 kB
Active(anon):     114424 kB
Inactive(anon):    89340 kB
Active(file):    2074144 kB
Inactive(file):  3104748 kB
Unevictable:      107768 kB
Mlocked:          107768 kB
SwapTotal:      67108860 kB
SwapFree:       66957012 kB
Dirty:              3644 kB
Writeback:            12 kB
AnonPages:        231488 kB
Mapped:            46392 kB
Shmem:             32768 kB
Slab:             280664 kB
SReclaimable:     251804 kB
SUnreclaim:        28860 kB
KernelStack:        3552 kB
PageTables:         5928 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2579404 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    161792 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 56540 MiB
End job on node147 at 2019-09-13 07:07:08