Trace number 4292952

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.89 2520.01

General information on the benchmark

NameNurseRostering/
NurseRostering-14_c18.xml
MD5SUM22d4927d0bd5c0ea6a9359fe3e752ee5
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark27589
Best CPU time to get the best result obtained on this benchmark2519.95
Satisfiable
(Un)Satisfiability was proved
Number of variables2475
Number of constraints6489
Number of domains18
Minimum domain size1
Maximum domain size43
Distribution of domain sizes[{"size":1,"count":76},{"size":2,"count":551},{"size":3,"count":3},{"size":5,"count":1344},{"size":6,"count":17},{"size":11,"count":8},{"size":22,"count":34},{"size":33,"count":378},{"size":43,"count":64}]
Minimum variable degree2
Maximum variable degree27
Distribution of variable degrees[{"degree":2,"count":939},{"degree":3,"count":192},{"degree":14,"count":4},{"degree":15,"count":23},{"degree":16,"count":35},{"degree":17,"count":6},{"degree":18,"count":18},{"degree":19,"count":41},{"degree":20,"count":52},{"degree":21,"count":51},{"degree":22,"count":124},{"degree":23,"count":377},{"degree":24,"count":320},{"degree":25,"count":177},{"degree":26,"count":94},{"degree":27,"count":22}]
Minimum constraint arity2
Maximum constraint arity128
Distribution of constraint arities[{"arity":2,"count":2524},{"arity":3,"count":2080},{"arity":4,"count":273},{"arity":5,"count":32},{"arity":6,"count":957},{"arity":7,"count":252},{"arity":33,"count":210},{"arity":43,"count":160},{"arity":128,"count":1}]
Number of extensional constraints1522
Number of intensional constraints797
Distribution of constraint types[{"type":"extension","count":1522},{"type":"intension","count":797},{"type":"regular","count":2558},{"type":"sum","count":64},{"type":"count","count":1547},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10118 MiB free)
  memory of node 1: 16384 MiB (12176 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4292952-1532297650/watcher-4292952-1532297650 -o /tmp/evaluation-result-4292952-1532297650/solver-4292952-1532297650 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532297650-6630 --watchdog 2580 xcsp_picat HOME/instance-4292952-1532297650.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=6656, runsolver pid=6652
Current StackSize limit: 8192 KiB


[startup+0.100204 s]*
/proc/loadavg: 1.17 1.29 1.31 3/189 6662
/proc/meminfo: memFree=22768104/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=119504 memory=35604 CPUtime=0.1 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 1397 0 0 0 10 0 0 0 20 0 1 0 47328186 122372096 8901 33554432000 4194304 5849740 140723309761088 140723309761088 4524355 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 29876 8901 631 405 0 26820 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 35604 KiB

[startup+0.209831 s]*
/proc/loadavg: 1.17 1.29 1.31 3/189 6662
/proc/meminfo: memFree=22736640/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=119504 memory=50452 CPUtime=0.21 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 1575 0 0 0 20 1 0 0 20 0 1 0 47328186 122372096 12613 33554432000 4194304 5849740 140723309761088 140723309761088 4504018 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 29876 12613 636 405 0 26820 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 50452 KiB

[startup+0.309692 s]*
/proc/loadavg: 1.17 1.29 1.31 3/189 6662
/proc/meminfo: memFree=22712564/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=119504 memory=61724 CPUtime=0.31 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 1803 0 0 0 30 1 0 0 20 0 1 0 47328186 122372096 15431 33554432000 4194304 5849740 140723309761088 140723309761088 4536595 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 29876 15431 644 405 0 26820 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 119504 KiB
Current children cumulated memory: 61724 KiB

[startup+0.700349 s]
/proc/loadavg: 1.17 1.29 1.31 3/189 6662
/proc/meminfo: memFree=22676512/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=157080 memory=103524 CPUtime=0.69 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 5457 0 0 0 66 3 0 0 20 0 1 0 47328186 160849920 25881 33554432000 4194304 5849740 140723309761088 140723309761088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 39270 25881 695 405 0 36214 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 157080 KiB
Current children cumulated memory: 103524 KiB

[startup+1.50034 s]
/proc/loadavg: 1.17 1.29 1.31 3/189 6662
/proc/meminfo: memFree=22644204/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=158972 memory=105504 CPUtime=1.49 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 5935 0 0 0 143 6 0 0 20 0 1 0 47328186 162787328 26376 33554432000 4194304 5849740 140723309761088 140723309761088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 39743 26376 740 405 0 36687 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 158972 KiB
Current children cumulated memory: 105504 KiB

[startup+3.10935 s]
/proc/loadavg: 1.24 1.31 1.32 3/189 6662
/proc/meminfo: memFree=22624460/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=167164 memory=113788 CPUtime=3.09 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 8660 0 0 0 297 12 0 0 20 0 1 0 47328186 171175936 28447 33554432000 4194304 5849740 140723309761088 140723309760184 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 41791 28447 740 405 0 38735 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 167164 KiB
Current children cumulated memory: 113788 KiB

[startup+6.30033 s]
/proc/loadavg: 1.24 1.31 1.32 3/189 6662
/proc/meminfo: memFree=22617884/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=171260 memory=117884 CPUtime=6.29 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 10137 0 0 0 612 17 0 0 20 0 1 0 47328186 175370240 29471 33554432000 4194304 5849740 140723309761088 140723309760088 5473012 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 42815 29471 740 405 0 39759 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 171260 KiB
Current children cumulated memory: 117884 KiB

[startup+12.7003 s]
/proc/loadavg: 1.30 1.32 1.32 3/189 6662
/proc/meminfo: memFree=22568936/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=201984 memory=148536 CPUtime=12.68 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 14806 0 0 0 1246 22 0 0 20 0 1 0 47328186 206831616 37134 33554432000 4194304 5849740 140723309761088 140723309759736 5309642 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 50496 37134 756 405 0 47440 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 201984 KiB
Current children cumulated memory: 148536 KiB

[startup+25.5004 s]
/proc/loadavg: 1.38 1.33 1.33 3/189 6662
/proc/meminfo: memFree=22576568/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=201984 memory=148736 CPUtime=25.49 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 18915 0 0 0 2520 29 0 0 20 0 1 0 47328186 206831616 37184 33554432000 4194304 5849740 140723309761088 140723309760088 5308384 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 50496 37184 772 405 0 47440 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 201984 KiB
Current children cumulated memory: 148736 KiB

[startup+51.1096 s]
/proc/loadavg: 1.59 1.39 1.34 3/189 6662
/proc/meminfo: memFree=22558828/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=201984 memory=148736 CPUtime=51.09 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 21996 0 0 0 5063 46 0 0 20 0 1 0 47328186 206831616 37184 33554432000 4194304 5849740 140723309761088 140723309760248 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 50496 37184 772 405 0 47440 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 201984 KiB
Current children cumulated memory: 148736 KiB

[startup+102.3 s]
/proc/loadavg: 1.82 1.48 1.38 3/188 6663
/proc/meminfo: memFree=22541200/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=201984 memory=153728 CPUtime=102.28 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 24496 0 0 0 10136 92 0 0 20 0 1 0 47328186 206831616 38432 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 50496 38432 772 405 0 47440 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 201984 KiB
Current children cumulated memory: 153728 KiB

[startup+162.3 s]
/proc/loadavg: 1.94 1.58 1.42 3/188 6664
/proc/meminfo: memFree=22509972/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=206152 memory=157892 CPUtime=162.28 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 30361 0 0 0 16077 151 0 0 20 0 1 0 47328186 211099648 39473 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 51538 39473 772 405 0 48482 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 206152 KiB
Current children cumulated memory: 157892 KiB

[startup+222.3 s]
/proc/loadavg: 2.04 1.67 1.46 3/188 6665
/proc/meminfo: memFree=22509248/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=206152 memory=157892 CPUtime=222.28 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 38760 0 0 0 22026 202 0 0 20 0 1 0 47328186 211099648 39473 33554432000 4194304 5849740 140723309761088 140723309759960 5350184 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 51538 39473 772 405 0 48482 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 206152 KiB
Current children cumulated memory: 157892 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 1.73 1.49 3/188 6666
/proc/meminfo: memFree=22491044/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=229492 memory=181236 CPUtime=282.28 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 47739 0 0 0 27973 255 0 0 20 0 1 0 47328186 234999808 45309 33554432000 4194304 5849740 140723309761088 140723309760088 5312592 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 57373 45309 772 405 0 54317 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 229492 KiB
Current children cumulated memory: 181236 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 1.78 1.52 3/187 6667
/proc/meminfo: memFree=22510852/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=248804 memory=200540 CPUtime=342.27 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 53746 0 0 0 33934 293 0 0 20 0 1 0 47328186 254775296 50135 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 62201 50135 772 405 0 59145 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 248804 KiB
Current children cumulated memory: 200540 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 1.83 1.56 3/188 6676
/proc/meminfo: memFree=22495180/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=248804 memory=200548 CPUtime=402.27 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 54901 0 0 0 39892 335 0 0 20 0 1 0 47328186 254775296 50137 33554432000 4194304 5849740 140723309761088 140723309760248 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 62201 50137 772 405 0 59145 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 248804 KiB
Current children cumulated memory: 200548 KiB

[startup+462.3 s]
/proc/loadavg: 2.08 1.89 1.60 3/188 6677
/proc/meminfo: memFree=22538188/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=201996 memory=153732 CPUtime=462.27 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 61691 0 0 0 45836 391 0 0 20 0 1 0 47328186 206843904 38433 33554432000 4194304 5849740 140723309761088 140723309760088 5323451 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 50499 38433 782 405 0 47443 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 201996 KiB
Current children cumulated memory: 153732 KiB


################
# More data... #
################

/proc/6656/statm: 60871 48801 782 405 0 57815 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 243484 KiB
Current children cumulated memory: 195204 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 1.95 3/188 6718
/proc/meminfo: memFree=22389748/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=281572 memory=233408 CPUtime=1782.2 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 311924 0 0 0 176711 1509 0 0 20 0 1 0 47328186 288329728 58352 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 70393 58352 782 405 0 67337 0
Current children cumulated CPU time: 1782.2 s
Current children cumulated vsize: 281572 KiB
Current children cumulated memory: 233408 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 1.95 3/188 6719
/proc/meminfo: memFree=22387464/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=279092 memory=230960 CPUtime=1842.2 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 326571 0 0 0 182668 1552 0 0 20 0 1 0 47328186 285790208 57740 33554432000 4194304 5849740 140723309761088 140723309759576 5375954 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 69773 57740 782 405 0 66717 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 279092 KiB
Current children cumulated memory: 230960 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 1.95 3/187 6720
/proc/meminfo: memFree=22404028/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=255276 memory=206924 CPUtime=1902.2 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 341567 0 0 0 188625 1595 0 0 20 0 1 0 47328186 261402624 51731 33554432000 4194304 5849740 140723309761088 140723309760248 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 63819 51731 782 405 0 60763 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 255276 KiB
Current children cumulated memory: 206924 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 1.95 3/187 6721
/proc/meminfo: memFree=22410172/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=254852 memory=206568 CPUtime=1962.2 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 353000 0 0 0 194581 1639 0 0 20 0 1 0 47328186 260968448 51642 33554432000 4194304 5849740 140723309761088 140723309760088 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 63713 51642 782 405 0 60657 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 254852 KiB
Current children cumulated memory: 206568 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 1.95 3/187 6722
/proc/meminfo: memFree=22371024/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=264852 memory=216476 CPUtime=2022.19 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 367168 0 0 0 200534 1685 0 0 20 0 1 0 47328186 271208448 54119 33554432000 4194304 5849740 140723309761088 140723309760088 5339519 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 66213 54119 782 405 0 63157 0
Current children cumulated CPU time: 2022.19 s
Current children cumulated vsize: 264852 KiB
Current children cumulated memory: 216476 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 6723
/proc/meminfo: memFree=22331288/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=298556 memory=250216 CPUtime=2082.19 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 378678 0 0 0 206494 1725 0 0 20 0 1 0 47328186 305721344 62554 33554432000 4194304 5849740 140723309761088 140723309759960 5338829 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 74639 62554 782 405 0 71583 0
Current children cumulated CPU time: 2082.19 s
Current children cumulated vsize: 298556 KiB
Current children cumulated memory: 250216 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 6724
/proc/meminfo: memFree=22364956/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=295404 memory=247100 CPUtime=2142.19 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 390078 0 0 0 212453 1766 0 0 20 0 1 0 47328186 302493696 61775 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 73851 61775 782 405 0 70795 0
Current children cumulated CPU time: 2142.19 s
Current children cumulated vsize: 295404 KiB
Current children cumulated memory: 247100 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 6733
/proc/meminfo: memFree=22327184/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=303364 memory=255004 CPUtime=2202.19 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 403768 0 0 0 218404 1815 0 0 20 0 1 0 47328186 310644736 63751 33554432000 4194304 5849740 140723309761088 140723309760088 5335566 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 75841 63751 782 405 0 72785 0
Current children cumulated CPU time: 2202.19 s
Current children cumulated vsize: 303364 KiB
Current children cumulated memory: 255004 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 6734
/proc/meminfo: memFree=22410040/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=247272 memory=199068 CPUtime=2262.19 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 424760 0 0 0 224355 1864 0 0 20 0 1 0 47328186 253206528 49767 33554432000 4194304 5849740 140723309761088 140723309760088 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 61818 49767 782 405 0 58762 0
Current children cumulated CPU time: 2262.19 s
Current children cumulated vsize: 247272 KiB
Current children cumulated memory: 199068 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 6735
/proc/meminfo: memFree=22319616/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=283048 memory=234824 CPUtime=2322.18 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 440309 0 0 0 230308 1910 0 0 20 0 1 0 47328186 289841152 58706 33554432000 4194304 5849740 140723309761088 140723309760248 5339710 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 70762 58706 782 405 0 67706 0
Current children cumulated CPU time: 2322.18 s
Current children cumulated vsize: 283048 KiB
Current children cumulated memory: 234824 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 6736
/proc/meminfo: memFree=22396324/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=273984 memory=225792 CPUtime=2382.18 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 453759 0 0 0 236266 1952 0 0 20 0 1 0 47328186 280559616 56448 33554432000 4194304 5849740 140723309761088 140723309760088 5307529 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 68496 56448 782 405 0 65440 0
Current children cumulated CPU time: 2382.18 s
Current children cumulated vsize: 273984 KiB
Current children cumulated memory: 225792 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 6737
/proc/meminfo: memFree=22345516/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=307080 memory=258812 CPUtime=2442.18 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 466666 0 0 0 242217 2001 0 0 20 0 1 0 47328186 314449920 64703 33554432000 4194304 5849740 140723309761088 140723309759960 5312898 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 76770 64703 782 405 0 73714 0
Current children cumulated CPU time: 2442.18 s
Current children cumulated vsize: 307080 KiB
Current children cumulated memory: 258812 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/187 6739
/proc/meminfo: memFree=22373560/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=258440 memory=210112 CPUtime=2502.17 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 478479 0 0 0 248170 2047 0 0 20 0 1 0 47328186 264642560 52528 33554432000 4194304 5849740 140723309761088 140723309759960 139913097637767 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 64610 52528 782 405 0 61554 0
Current children cumulated CPU time: 2502.17 s
Current children cumulated vsize: 258440 KiB
Current children cumulated memory: 210112 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 1.95 3/187 6739
/proc/meminfo: memFree=22347800/32770624 swapFree=67108860/67108860
[pid=6656] ppid=6652 vsize=290812 memory=242628 CPUtime=2519.88 cores=0,2,4,6
/proc/6656/stat : 6656 (xcsp_picat) R 6652 6656 6599 0 -1 4202496 487624 0 0 0 249926 2062 0 0 20 0 1 0 47328186 297791488 60657 33554432000 4194304 5849740 140723309761088 140723309760248 5311410 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 38064128 140723309769910 140723309769988 140723309769988 140723309772746 0
/proc/6656/statm: 72703 60657 782 405 0 69647 0
Current children cumulated CPU time: 2519.88 s
Current children cumulated vsize: 290812 KiB
Current children cumulated memory: 242628 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 6656 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2499.26 s, system=20.6324 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.89
CPU user time (s): 2499.26
CPU system time (s): 20.6324
CPU usage (%): 99.9953
Max. virtual memory (cumulated for all children) (KiB): 333124
Max. memory (cumulated for all children) (KiB): 284992

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2499.26
system time used= 20.6324
maximum resident set size= 284992
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 487624
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 60
involuntary context switches= 1447


# summary of solver processes directly reported to runsolver:
#   pid: 6656
#   total CPU time (s): 2519.89
#   total CPU user time (s): 2499.26
#   total CPU system time (s): 20.6324

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.88713 second user time and 17.9638 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-23 00:14:10
IDJOB=4292952
IDBENCH=141045
IDSOLVER=2754
FILE ID=node138/4292952-1532297650
RUNJOBID= node138-1532297650-6630
PBS_JOBID= 21018993
Free space on /tmp= 59108 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/NurseRostering/NurseRostering-14_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4292952-1532297650/watcher-4292952-1532297650 -o /tmp/evaluation-result-4292952-1532297650/solver-4292952-1532297650 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532297650-6630 --watchdog 2580  xcsp_picat HOME/instance-4292952-1532297650.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 22d4927d0bd5c0ea6a9359fe3e752ee5
RANDOM SEED=1746314991

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22830332 kB
MemAvailable:   31950864 kB
Buffers:          251400 kB
Cached:          9109792 kB
SwapCached:            0 kB
Active:          2332056 kB
Inactive:        7088024 kB
Active(anon):      61348 kB
Inactive(anon):    16960 kB
Active(file):    2270708 kB
Inactive(file):  7071064 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              6244 kB
Writeback:             0 kB
AnonPages:         65656 kB
Mapped:            36108 kB
Shmem:             17036 kB
Slab:             216948 kB
SReclaimable:     189192 kB
SUnreclaim:        27756 kB
KernelStack:        3200 kB
PageTables:         4816 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     317988 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     12288 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 59104 MiB
End job on node138 at 2018-07-23 00:56:10