Trace number 4303138

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.09 2520.02

General information on the benchmark

NameNurseRostering/
NurseRostering-19_c18.xml
MD5SUM4516482276b9b550f1c9d24d3edf9abb
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables5922
Number of constraints16251
Number of domains21
Minimum domain size1
Maximum domain size85
Distribution of domain sizes[{"size":1,"count":156},{"size":2,"count":1314},{"size":6,"count":3360},{"size":8,"count":2},{"size":12,"count":4},{"size":13,"count":16},{"size":21,"count":3},{"size":22,"count":15},{"size":41,"count":924},{"size":85,"count":128}]
Minimum variable degree2
Maximum variable degree27
Distribution of variable degrees[{"degree":2,"count":2082},{"degree":3,"count":480},{"degree":17,"count":32},{"degree":18,"count":39},{"degree":19,"count":7},{"degree":20,"count":30},{"degree":21,"count":44},{"degree":22,"count":52},{"degree":23,"count":70},{"degree":24,"count":83},{"degree":25,"count":1394},{"degree":26,"count":1316},{"degree":27,"count":293}]
Minimum constraint arity2
Maximum constraint arity320
Distribution of constraint arities[{"arity":2,"count":5706},{"arity":3,"count":6232},{"arity":4,"count":324},{"arity":5,"count":320},{"arity":6,"count":2884},{"arity":12,"count":40},{"arity":41,"count":504},{"arity":85,"count":240},{"arity":320,"count":1}]
Number of extensional constraints3824
Number of intensional constraints1882
Distribution of constraint types[{"type":"extension","count":3824},{"type":"intension","count":1882},{"type":"regular","count":6556},{"type":"sum","count":80},{"type":"count","count":3908},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (2857 MiB free)
  memory of node 1: 16384 MiB (2446 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303138-1533992582/watcher-4303138-1533992582 -o /tmp/evaluation-result-4303138-1533992582/solver-4303138-1533992582 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1533990060-10870 --watchdog 2580 xcsp_picat HOME/instance-4303138-1533992582.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=11125, runsolver pid=11122
Current StackSize limit: 8192 KiB


[startup+0.100194 s]*
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5395392/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2025744 memory=40532 CPUtime=0.1 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 1632 0 0 0 9 1 0 0 20 0 1 0 216821387 2074361856 10133 33554432000 4194304 5849708 140734066867808 140734066867808 4533288 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 506436 10133 619 405 0 503381 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 40532 KiB

[startup+0.209905 s]*
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5374788/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2025744 memory=61200 CPUtime=0.21 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 1681 0 0 0 20 1 0 0 20 0 1 0 216821387 2074361856 15300 33554432000 4194304 5849708 140734066867808 140734066867808 140028859608064 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 506436 15300 620 405 0 503381 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 61200 KiB

[startup+0.309816 s]*
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5358280/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2033560 memory=77808 CPUtime=0.31 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 1761 0 0 0 30 1 0 0 20 0 1 0 216821387 2082365440 19452 33554432000 4194304 5849708 140734066867808 140734066867808 4840207 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 508390 19452 635 405 0 505335 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 77808 KiB

[startup+0.700418 s]
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5330788/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2033560 memory=123616 CPUtime=0.69 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 1942 0 0 0 67 2 0 0 20 0 1 0 216821387 2082365440 30904 33554432000 4194304 5849708 140734066867808 140734066867808 4467757 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 508390 30904 635 405 0 505335 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 123616 KiB

[startup+1.50043 s]
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5274720/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2034244 memory=243524 CPUtime=1.49 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 2294 0 0 0 143 6 0 0 20 0 1 0 216821387 2083065856 60881 33554432000 4194304 5849708 140734066867808 140734066867112 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 508561 60881 721 405 0 505506 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2034244 KiB
Current children cumulated memory: 243524 KiB

[startup+3.10922 s]
/proc/loadavg: 1.92 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5186352/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2035088 memory=244436 CPUtime=3.1 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 2638 0 0 0 303 7 0 0 20 0 1 0 216821387 2083930112 61109 33554432000 4194304 5849708 140734066867808 140734066867048 5521474 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 508772 61109 738 405 0 505717 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2035088 KiB
Current children cumulated memory: 244436 KiB

[startup+6.30034 s]
/proc/loadavg: 1.93 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5156712/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2062752 memory=272228 CPUtime=6.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 8955 0 0 0 600 29 0 0 20 0 1 0 216821387 2112258048 68057 33554432000 4194304 5849708 140734066867808 140734066866904 5521478 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 515688 68057 738 405 0 512633 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2062752 KiB
Current children cumulated memory: 272228 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5158944/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2064800 memory=274276 CPUtime=12.69 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 11340 0 0 0 1237 32 0 0 20 0 1 0 216821387 2114355200 68569 33554432000 4194304 5849708 140734066867808 140734066866920 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 516200 68569 738 405 0 513145 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2064800 KiB
Current children cumulated memory: 274276 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 1.95 3/191 11126
/proc/meminfo: memFree=5143356/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2072992 memory=282468 CPUtime=25.49 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 14186 0 0 0 2503 46 0 0 20 0 1 0 216821387 2122743808 70617 33554432000 4194304 5849708 140734066867808 140734066866904 5354378 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 518248 70617 738 405 0 515193 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2072992 KiB
Current children cumulated memory: 282468 KiB

[startup+51.1096 s]
/proc/loadavg: 1.97 2.00 1.95 3/191 11190
/proc/meminfo: memFree=4291960/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2120864 memory=330344 CPUtime=51.1 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 39509 0 0 0 5053 57 0 0 20 0 1 0 216821387 2171764736 82586 33554432000 4194304 5849708 140734066867808 140734066866296 5310086 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 530216 82586 770 405 0 527161 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2120864 KiB
Current children cumulated memory: 330344 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 1.95 3/191 11191
/proc/meminfo: memFree=4181460/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2118896 memory=331104 CPUtime=102.28 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 45914 0 0 0 10147 81 0 0 20 0 1 0 216821387 2169749504 82776 33554432000 4194304 5849708 140734066867808 140734066865352 5308477 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 529724 82776 770 405 0 526669 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2118896 KiB
Current children cumulated memory: 331104 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 1.95 3/191 11192
/proc/meminfo: memFree=4011900/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2118376 memory=332888 CPUtime=162.28 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 47892 0 0 0 16113 115 0 0 20 0 1 0 216821387 2169217024 83222 33554432000 4194304 5849708 140734066867808 140734066866808 5340254 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 529594 83222 770 405 0 526539 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2118376 KiB
Current children cumulated memory: 332888 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/191 11193
/proc/meminfo: memFree=4038980/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2125528 memory=340008 CPUtime=222.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 51504 0 0 0 22085 144 0 0 20 0 1 0 216821387 2176540672 85002 33554432000 4194304 5849708 140734066867808 140734066866808 5307669 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 531382 85002 770 405 0 528327 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2125528 KiB
Current children cumulated memory: 340008 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/191 11194
/proc/meminfo: memFree=4038580/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2125456 memory=340052 CPUtime=282.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 55918 0 0 0 28058 171 0 0 20 0 1 0 216821387 2176466944 85013 33554432000 4194304 5849708 140734066867808 140734066866808 5438033 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 531364 85013 770 405 0 528309 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2125456 KiB
Current children cumulated memory: 340052 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/187 11195
/proc/meminfo: memFree=4017100/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2125300 memory=339896 CPUtime=342.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 66631 0 0 0 34033 196 0 0 20 0 1 0 216821387 2176307200 84974 33554432000 4194304 5849708 140734066867808 140734066866808 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 531325 84974 770 405 0 528270 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2125300 KiB
Current children cumulated memory: 339896 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/187 11196
/proc/meminfo: memFree=3995072/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2158320 memory=372640 CPUtime=402.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 78612 0 0 0 40007 222 0 0 20 0 1 0 216821387 2210119680 93160 33554432000 4194304 5849708 140734066867808 140734066866808 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 539580 93160 770 405 0 536525 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2158320 KiB
Current children cumulated memory: 372640 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.95 3/188 11205
/proc/meminfo: memFree=4010760/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2125512 memory=340024 CPUtime=462.29 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 89914 0 0 0 45983 246 0 0 20 0 1 0 216821387 2176524288 85006 33554432000 4194304 5849708 140734066867808 140734066866808 5307534 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 531378 85006 770 405 0 528323 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2125512 KiB
Current children cumulated memory: 340024 KiB


################
# More data... #
################

/proc/11125/statm: 542904 95322 770 405 0 539849 0
Current children cumulated CPU time: 1722.33 s
Current children cumulated vsize: 2171616 KiB
Current children cumulated memory: 381288 KiB

[startup+1782.3 s]
/proc/loadavg: 2.04 2.11 2.05 3/188 11245
/proc/meminfo: memFree=3883508/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191372 memory=405884 CPUtime=1782.34 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 373372 0 0 0 177428 806 0 0 20 0 1 0 216821387 2243964928 101471 33554432000 4194304 5849708 140734066867808 140734066866808 5339058 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547843 101471 770 405 0 544788 0
Current children cumulated CPU time: 1782.34 s
Current children cumulated vsize: 2191372 KiB
Current children cumulated memory: 405884 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.09 2.05 3/188 11246
/proc/meminfo: memFree=3846032/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191148 memory=405660 CPUtime=1842.34 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 384422 0 0 0 183414 820 0 0 20 0 1 0 216821387 2243735552 101415 33554432000 4194304 5849708 140734066867808 140734066866968 5437647 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547787 101415 770 405 0 544732 0
Current children cumulated CPU time: 1842.34 s
Current children cumulated vsize: 2191148 KiB
Current children cumulated memory: 405660 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.07 2.05 3/188 11247
/proc/meminfo: memFree=3859624/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191144 memory=405656 CPUtime=1902.35 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 397481 0 0 0 189400 835 0 0 20 0 1 0 216821387 2243731456 101414 33554432000 4194304 5849708 140734066867808 140734066866968 5437841 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547786 101414 770 405 0 544731 0
Current children cumulated CPU time: 1902.35 s
Current children cumulated vsize: 2191144 KiB
Current children cumulated memory: 405656 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 11248
/proc/meminfo: memFree=3859272/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191464 memory=405976 CPUtime=1962.35 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 408404 0 0 0 195379 856 0 0 20 0 1 0 216821387 2244059136 101494 33554432000 4194304 5849708 140734066867808 140734066866808 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547866 101494 770 405 0 544811 0
Current children cumulated CPU time: 1962.35 s
Current children cumulated vsize: 2191464 KiB
Current children cumulated memory: 405976 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 11249
/proc/meminfo: memFree=3859020/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191144 memory=405656 CPUtime=2022.35 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 421447 0 0 0 201359 876 0 0 20 0 1 0 216821387 2243731456 101414 33554432000 4194304 5849708 140734066867808 140734066866808 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547786 101414 770 405 0 544731 0
Current children cumulated CPU time: 2022.35 s
Current children cumulated vsize: 2191144 KiB
Current children cumulated memory: 405656 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 11250
/proc/meminfo: memFree=3859032/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191144 memory=405656 CPUtime=2082.35 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 431692 0 0 0 207344 891 0 0 20 0 1 0 216821387 2243731456 101414 33554432000 4194304 5849708 140734066867808 140734066866808 5437580 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547786 101414 770 405 0 544731 0
Current children cumulated CPU time: 2082.35 s
Current children cumulated vsize: 2191144 KiB
Current children cumulated memory: 405656 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 11251
/proc/meminfo: memFree=3858896/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191464 memory=405976 CPUtime=2142.35 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 443094 0 0 0 213330 905 0 0 20 0 1 0 216821387 2244059136 101494 33554432000 4194304 5849708 140734066867808 140734066866808 140028859629447 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547866 101494 770 405 0 544811 0
Current children cumulated CPU time: 2142.35 s
Current children cumulated vsize: 2191464 KiB
Current children cumulated memory: 405976 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 11252
/proc/meminfo: memFree=3932012/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191140 memory=405652 CPUtime=2202.36 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 459081 0 0 0 219307 929 0 0 20 0 1 0 216821387 2243727360 101413 33554432000 4194304 5849708 140734066867808 140734066866808 5437714 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547785 101413 770 405 0 544730 0
Current children cumulated CPU time: 2202.36 s
Current children cumulated vsize: 2191140 KiB
Current children cumulated memory: 405652 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 11261
/proc/meminfo: memFree=3879220/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191140 memory=405652 CPUtime=2262.36 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 469818 0 0 0 225288 948 0 0 20 0 1 0 216821387 2243727360 101413 33554432000 4194304 5849708 140734066867808 140734066866808 5438079 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547785 101413 770 405 0 544730 0
Current children cumulated CPU time: 2262.36 s
Current children cumulated vsize: 2191140 KiB
Current children cumulated memory: 405652 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 11262
/proc/meminfo: memFree=3930348/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191140 memory=405652 CPUtime=2322.36 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 481801 0 0 0 231274 962 0 0 20 0 1 0 216821387 2243727360 101413 33554432000 4194304 5849708 140734066867808 140734066866296 5326241 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547785 101413 770 405 0 544730 0
Current children cumulated CPU time: 2322.36 s
Current children cumulated vsize: 2191140 KiB
Current children cumulated memory: 405652 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 11263
/proc/meminfo: memFree=3935056/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191140 memory=405652 CPUtime=2382.36 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 493961 0 0 0 237254 982 0 0 20 0 1 0 216821387 2243727360 101413 33554432000 4194304 5849708 140734066867808 140734066866968 5437625 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547785 101413 770 405 0 544730 0
Current children cumulated CPU time: 2382.36 s
Current children cumulated vsize: 2191140 KiB
Current children cumulated memory: 405652 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 11264
/proc/meminfo: memFree=3933516/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191140 memory=405652 CPUtime=2442.37 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 508030 0 0 0 243231 1006 0 0 20 0 1 0 216821387 2243727360 101413 33554432000 4194304 5849708 140734066867808 140734066866968 5437865 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547785 101413 770 405 0 544730 0
Current children cumulated CPU time: 2442.37 s
Current children cumulated vsize: 2191140 KiB
Current children cumulated memory: 405652 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 11265
/proc/meminfo: memFree=3933768/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191396 memory=405880 CPUtime=2502.36 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 520211 0 0 0 249211 1025 0 0 20 0 1 0 216821387 2243989504 101470 33554432000 4194304 5849708 140734066867808 140734066866968 5437847 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547849 101470 770 405 0 544794 0
Current children cumulated CPU time: 2502.36 s
Current children cumulated vsize: 2191396 KiB
Current children cumulated memory: 405880 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 11266
/proc/meminfo: memFree=3934144/32770624 swapFree=67030624/67108860
[pid=11125] ppid=11122 vsize=2191396 memory=405908 CPUtime=2520.07 cores=0,2,4,6
/proc/11125/stat : 11125 (xcsp_picat) R 11122 11125 10838 0 -1 4202496 520672 0 0 0 250977 1030 0 0 20 0 1 0 216821387 2243989504 101477 33554432000 4194304 5849708 140734066867808 140734066866808 5437851 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9394900 42496000 140734066873526 140734066873604 140734066873604 140734066876362 0
/proc/11125/statm: 547849 101477 770 405 0 544794 0
Current children cumulated CPU time: 2520.07 s
Current children cumulated vsize: 2191396 KiB
Current children cumulated memory: 405908 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 11125 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2509.78 s, system=10.3123 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2520.09
CPU user time (s): 2509.78
CPU system time (s): 10.3123
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 2206828
Max. memory (cumulated for all children) (KiB): 421340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2509.78
system time used= 10.3123
maximum resident set size= 421340
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 520673
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 975


# summary of solver processes directly reported to runsolver:
#   pid: 11125
#   total CPU time (s): 2520.09
#   total CPU user time (s): 2509.78
#   total CPU system time (s): 10.3123

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.30746 second user time and 18.7499 second system time

The end

Launcher Data 

Begin job on node102 at 2018-08-11 15:03:02
IDJOB=4303138
IDBENCH=141041
IDSOLVER=2778
FILE ID=node102/4303138-1533992582
RUNJOBID= node102-1533990060-10870
PBS_JOBID= 21036939
Free space on /tmp= 38204 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/NurseRostering/NurseRostering-19_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303138-1533992582/watcher-4303138-1533992582 -o /tmp/evaluation-result-4303138-1533992582/solver-4303138-1533992582 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1533990060-10870 --watchdog 2580  xcsp_picat HOME/instance-4303138-1533992582.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4516482276b9b550f1c9d24d3edf9abb
RANDOM SEED=925576196

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:         5432176 kB
MemAvailable:   31863472 kB
Buffers:          126812 kB
Cached:         26170912 kB
SwapCached:        51280 kB
Active:          8689220 kB
Inactive:       17705720 kB
Active(anon):      21752 kB
Inactive(anon):   126960 kB
Active(file):    8667468 kB
Inactive(file): 17578760 kB
Unevictable:        7360 kB
Mlocked:            7360 kB
SwapTotal:      67108860 kB
SwapFree:       67030624 kB
Dirty:              6708 kB
Writeback:             4 kB
AnonPages:         53800 kB
Mapped:            52644 kB
Shmem:             48948 kB
Slab:             641284 kB
SReclaimable:     613528 kB
SUnreclaim:        27756 kB
KernelStack:        3344 kB
PageTables:         5260 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2391916 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     14336 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 38200 MiB
End job on node102 at 2018-08-11 15:45:02