Trace number 4303125

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-02? (TO) 2520.02 2519.9

General information on the benchmark

NameNurseRostering/
NurseRostering-06_c18.xml
MD5SUM9a3bf89ae74321e3cfb193774a0c0983
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark4362
Best CPU time to get the best result obtained on this benchmark2520.1
Satisfiable
(Un)Satisfiability was proved
Number of variables1007
Number of constraints2471
Number of domains12
Minimum domain size1
Maximum domain size29
Distribution of domain sizes[{"size":1,"count":42},{"size":2,"count":207},{"size":4,"count":504},{"size":19,"count":196},{"size":29,"count":58}]
Minimum variable degree2
Maximum variable degree25
Distribution of variable degrees[{"degree":2,"count":431},{"degree":3,"count":72},{"degree":12,"count":3},{"degree":13,"count":12},{"degree":14,"count":16},{"degree":15,"count":8},{"degree":16,"count":11},{"degree":17,"count":26},{"degree":18,"count":25},{"degree":19,"count":30},{"degree":20,"count":53},{"degree":21,"count":120},{"degree":22,"count":93},{"degree":23,"count":59},{"degree":24,"count":36},{"degree":25,"count":12}]
Minimum constraint arity2
Maximum constraint arity36
Distribution of constraint arities[{"arity":2,"count":988},{"arity":3,"count":728},{"arity":4,"count":161},{"arity":6,"count":299},{"arity":7,"count":110},{"arity":19,"count":112},{"arity":29,"count":72},{"arity":36,"count":1}]
Number of extensional constraints598
Number of intensional constraints309
Distribution of constraint types[{"type":"extension","count":598},{"type":"intension","count":309},{"type":"regular","count":934},{"type":"sum","count":36},{"type":"count","count":593},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (2095 MiB free)
  memory of node 1: 16384 MiB (2694 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4303125-1533993611/watcher-4303125-1533993611 -o /tmp/evaluation-result-4303125-1533993611/solver-4303125-1533993611 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node107-1533993611-5741 --watchdog 2580 xcsp_picat HOME/instance-4303125-1533993611.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=5766, runsolver pid=5763
Current StackSize limit: 8192 KiB


[startup+0.100171 s]*
/proc/loadavg: 1.00 1.05 1.36 3/187 5771
/proc/meminfo: memFree=4842460/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2033560 memory=29540 CPUtime=0.1 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 1945 0 0 0 10 0 0 0 20 0 1 0 216924299 2082365440 7385 33554432000 4194304 5849708 140737321105520 140737321105520 4489731 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 508390 7385 638 405 0 505335 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 29540 KiB

[startup+0.209773 s]*
/proc/loadavg: 1.00 1.05 1.36 3/187 5771
/proc/meminfo: memFree=4803176/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2033716 memory=44728 CPUtime=0.21 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 2131 0 0 0 20 1 0 0 20 0 1 0 216924299 2082525184 11182 33554432000 4194304 5849708 140737321105520 140737321105520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 508429 11182 735 405 0 505374 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2033716 KiB
Current children cumulated memory: 44728 KiB

[startup+0.309425 s]*
/proc/loadavg: 1.00 1.05 1.36 3/187 5771
/proc/meminfo: memFree=4778288/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2033876 memory=44728 CPUtime=0.31 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 2148 0 0 0 30 1 0 0 20 0 1 0 216924299 2082689024 11182 33554432000 4194304 5849708 140737321105520 140737321105520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 508469 11182 735 405 0 505414 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2033876 KiB
Current children cumulated memory: 44728 KiB

[startup+0.700324 s]
/proc/loadavg: 1.00 1.05 1.36 3/187 5771
/proc/meminfo: memFree=4728640/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2037352 memory=48148 CPUtime=0.69 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 3050 0 0 0 65 4 0 0 20 0 1 0 216924299 2086248448 12037 33554432000 4194304 5849708 140737321105520 140737321104760 140378311455275 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 509338 12037 736 405 0 506283 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2037352 KiB
Current children cumulated memory: 48148 KiB

[startup+1.50023 s]
/proc/loadavg: 1.00 1.05 1.35 3/187 5771
/proc/meminfo: memFree=4659956/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2037352 memory=48148 CPUtime=1.49 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 3050 0 0 0 145 4 0 0 20 0 1 0 216924299 2086248448 12037 33554432000 4194304 5849708 140737321105520 140737321104760 5521474 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 509338 12037 736 405 0 506283 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2037352 KiB
Current children cumulated memory: 48148 KiB

[startup+3.10895 s]
/proc/loadavg: 1.00 1.05 1.35 3/187 5771
/proc/meminfo: memFree=4329096/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2037608 memory=48656 CPUtime=3.1 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 3506 0 0 0 306 4 0 0 20 0 1 0 216924299 2086510592 12164 33554432000 4194304 5849708 140737321105520 140737321104760 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 509402 12164 736 405 0 506347 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2037608 KiB
Current children cumulated memory: 48656 KiB

[startup+6.30034 s]
/proc/loadavg: 1.00 1.05 1.35 3/187 5771
/proc/meminfo: memFree=4221432/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2047360 memory=58120 CPUtime=6.29 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 12791 0 0 0 621 8 0 0 20 0 1 0 216924299 2096496640 14530 33554432000 4194304 5849708 140737321105520 140737321104760 140378311505824 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 511840 14530 760 405 0 508785 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2047360 KiB
Current children cumulated memory: 58120 KiB

[startup+12.7003 s]
/proc/loadavg: 1.08 1.06 1.36 3/187 5771
/proc/meminfo: memFree=4143928/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2037428 memory=48516 CPUtime=12.69 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 14972 0 0 0 1254 15 0 0 20 0 1 0 216924299 2086326272 12129 33554432000 4194304 5849708 140737321105520 140737321104616 5606238 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 509357 12129 777 405 0 506302 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2037428 KiB
Current children cumulated memory: 48516 KiB

[startup+25.5003 s]
/proc/loadavg: 1.22 1.09 1.36 3/187 5771
/proc/meminfo: memFree=4137304/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2043380 memory=56820 CPUtime=25.49 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 18704 0 0 0 2523 26 0 0 20 0 1 0 216924299 2092421120 14205 33554432000 4194304 5849708 140737321105520 140737321104392 5305490 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 510845 14205 777 405 0 507790 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2043380 KiB
Current children cumulated memory: 56820 KiB

[startup+51.1094 s]
/proc/loadavg: 1.53 1.18 1.38 3/187 5771
/proc/meminfo: memFree=4091016/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2053764 memory=69548 CPUtime=51.1 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 24488 0 0 0 5052 58 0 0 20 0 1 0 216924299 2103054336 17387 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 513441 17387 777 405 0 510386 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2053764 KiB
Current children cumulated memory: 69548 KiB

[startup+102.3 s]
/proc/loadavg: 1.80 1.31 1.42 3/187 5772
/proc/meminfo: memFree=4068816/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2076200 memory=91984 CPUtime=102.29 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 33708 0 0 0 10115 114 0 0 20 0 1 0 216924299 2126028800 22996 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 519050 22996 777 405 0 515995 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 2076200 KiB
Current children cumulated memory: 91984 KiB

[startup+162.3 s]
/proc/loadavg: 1.92 1.43 1.45 3/187 5773
/proc/meminfo: memFree=3917176/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2085092 memory=100876 CPUtime=162.3 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 47013 0 0 0 16058 172 0 0 20 0 1 0 216924299 2135134208 25219 33554432000 4194304 5849708 140737321105520 140737321104520 5305616 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 521273 25219 777 405 0 518218 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 2085092 KiB
Current children cumulated memory: 100876 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.54 1.49 3/187 5774
/proc/meminfo: memFree=3938700/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2086128 memory=101732 CPUtime=222.3 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 58787 0 0 0 22004 226 0 0 20 0 1 0 216924299 2136195072 25433 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 521532 25433 777 405 0 518477 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 2086128 KiB
Current children cumulated memory: 101732 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.62 1.52 3/187 5775
/proc/meminfo: memFree=3932536/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2085544 memory=101176 CPUtime=282.3 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 87532 0 0 0 27955 275 0 0 20 0 1 0 216924299 2135597056 25294 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 521386 25294 777 405 0 518331 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 2085544 KiB
Current children cumulated memory: 101176 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.69 1.55 3/187 5777
/proc/meminfo: memFree=3923324/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2087368 memory=103140 CPUtime=342.31 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 108638 0 0 0 33900 331 0 0 20 0 1 0 216924299 2137464832 25785 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 521842 25785 777 405 0 518787 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 2087368 KiB
Current children cumulated memory: 103140 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.75 1.58 3/187 5778
/proc/meminfo: memFree=3919736/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2092088 memory=107768 CPUtime=402.31 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 126910 0 0 0 39854 377 0 0 20 0 1 0 216924299 2142298112 26942 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 523022 26942 777 405 0 519967 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 2092088 KiB
Current children cumulated memory: 107768 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.79 1.60 3/187 5779
/proc/meminfo: memFree=3913372/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2082180 memory=97876 CPUtime=462.31 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 154478 0 0 0 45805 426 0 0 20 0 1 0 216924299 2132152320 24469 33554432000 4194304 5849708 140737321105520 140737321104520 5372465 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 520545 24469 777 405 0 517490 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 2082180 KiB
Current children cumulated memory: 97876 KiB


################
# More data... #
################

/proc/5766/statm: 541076 44982 777 405 0 538021 0
Current children cumulated CPU time: 1782.37 s
Current children cumulated vsize: 2164304 KiB
Current children cumulated memory: 179928 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.07 1.97 3/187 5825
/proc/meminfo: memFree=3804188/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2167960 memory=183676 CPUtime=1842.38 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 358008 0 0 0 182810 1428 0 0 20 0 1 0 216924299 2219991040 45919 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 541990 45919 777 405 0 538935 0
Current children cumulated CPU time: 1842.38 s
Current children cumulated vsize: 2167960 KiB
Current children cumulated memory: 183676 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.06 1.97 3/187 5826
/proc/meminfo: memFree=3920772/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2069452 memory=84972 CPUtime=1902.37 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 366703 0 0 0 188748 1489 0 0 20 0 1 0 216924299 2119118848 21243 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 517363 21243 777 405 0 514308 0
Current children cumulated CPU time: 1902.37 s
Current children cumulated vsize: 2069452 KiB
Current children cumulated memory: 84972 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.05 1.97 3/187 5827
/proc/meminfo: memFree=3890212/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2097124 memory=112832 CPUtime=1962.38 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 369824 0 0 0 194699 1539 0 0 20 0 1 0 216924299 2147454976 28208 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 524281 28208 777 405 0 521226 0
Current children cumulated CPU time: 1962.38 s
Current children cumulated vsize: 2097124 KiB
Current children cumulated memory: 112832 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 1.97 3/187 5828
/proc/meminfo: memFree=3879872/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2107884 memory=123592 CPUtime=2022.38 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 369982 0 0 0 200654 1584 0 0 20 0 1 0 216924299 2158473216 30898 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 526971 30898 777 405 0 523916 0
Current children cumulated CPU time: 2022.38 s
Current children cumulated vsize: 2107884 KiB
Current children cumulated memory: 123592 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 1.97 3/187 5829
/proc/meminfo: memFree=3865748/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2107884 memory=123592 CPUtime=2082.39 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 369982 0 0 0 206608 1631 0 0 20 0 1 0 216924299 2158473216 30898 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 526971 30898 777 405 0 523916 0
Current children cumulated CPU time: 2082.39 s
Current children cumulated vsize: 2107884 KiB
Current children cumulated memory: 123592 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.03 1.97 3/187 5831
/proc/meminfo: memFree=3845440/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2129056 memory=144752 CPUtime=2142.39 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 379727 0 0 0 212556 1683 0 0 20 0 1 0 216924299 2180153344 36188 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 532264 36188 777 405 0 529209 0
Current children cumulated CPU time: 2142.39 s
Current children cumulated vsize: 2129056 KiB
Current children cumulated memory: 144752 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/187 5832
/proc/meminfo: memFree=3836856/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136968 memory=152732 CPUtime=2202.39 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 380223 0 0 0 218513 1726 0 0 20 0 1 0 216924299 2188255232 38183 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534242 38183 777 405 0 531187 0
Current children cumulated CPU time: 2202.39 s
Current children cumulated vsize: 2136968 KiB
Current children cumulated memory: 152732 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 1.97 3/187 5833
/proc/meminfo: memFree=3837188/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136968 memory=152804 CPUtime=2262.39 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 388913 0 0 0 224477 1762 0 0 20 0 1 0 216924299 2188255232 38201 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534242 38201 777 405 0 531187 0
Current children cumulated CPU time: 2262.39 s
Current children cumulated vsize: 2136968 KiB
Current children cumulated memory: 152804 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/187 5835
/proc/meminfo: memFree=3850768/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136968 memory=152804 CPUtime=2322.4 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 389315 0 0 0 230435 1805 0 0 20 0 1 0 216924299 2188255232 38201 33554432000 4194304 5849708 140737321105520 140737321104520 5437714 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534242 38201 777 405 0 531187 0
Current children cumulated CPU time: 2322.4 s
Current children cumulated vsize: 2136968 KiB
Current children cumulated memory: 152804 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/187 5836
/proc/meminfo: memFree=3896824/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2090276 memory=106188 CPUtime=2382.4 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 392993 0 0 0 236397 1843 0 0 20 0 1 0 216924299 2140442624 26547 33554432000 4194304 5849708 140737321105520 140737321104520 5437714 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 522569 26547 777 405 0 519514 0
Current children cumulated CPU time: 2382.4 s
Current children cumulated vsize: 2090276 KiB
Current children cumulated memory: 106188 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/188 5845
/proc/meminfo: memFree=3859536/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2114844 memory=130628 CPUtime=2442.41 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 403564 0 0 0 242360 1881 0 0 20 0 1 0 216924299 2165600256 32657 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 528711 32657 777 405 0 525656 0
Current children cumulated CPU time: 2442.41 s
Current children cumulated vsize: 2114844 KiB
Current children cumulated memory: 130628 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.97 3/188 5868
/proc/meminfo: memFree=3837108/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136776 memory=152560 CPUtime=2502.41 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 407245 0 0 0 248317 1924 0 0 20 0 1 0 216924299 2188058624 38140 33554432000 4194304 5849708 140737321105520 140737321104520 140378311917447 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534194 38140 777 405 0 531139 0
Current children cumulated CPU time: 2502.41 s
Current children cumulated vsize: 2136776 KiB
Current children cumulated memory: 152560 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 1.97 3/188 5868
/proc/meminfo: memFree=3837304/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136776 memory=152560 CPUtime=2520.01 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 407245 0 0 0 250068 1933 0 0 20 0 1 0 216924299 2188058624 38140 33554432000 4194304 5849708 140737321105520 140737321104520 5312777 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534194 38140 777 405 0 531139 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 2136776 KiB
Current children cumulated memory: 152560 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 5766 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2500.68 s, system=19.3399 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 1.97 3/188 5868
/proc/meminfo: memFree=3837304/32770624 swapFree=67108860/67108860
[pid=5766] ppid=5763 vsize=2136776 memory=152560 CPUtime=2520.01 cores=1,3,5,7
/proc/5766/stat : 5766 (xcsp_picat) R 5763 5766 5709 0 -1 4202496 407245 0 0 0 250068 1933 0 0 20 0 1 0 216924299 2188058624 38140 33554432000 4194304 5849708 140737321105520 140737321104520 5312777 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9394900 24346624 140737321112758 140737321112836 140737321112836 140737321115594 0
/proc/5766/statm: 534194 38140 777 405 0 531139 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 2136776 KiB
Current children cumulated memory: 152560 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.9
CPU time (s): 2520.02
CPU user time (s): 2500.68
CPU system time (s): 19.3399
CPU usage (%): 100.005
Max. virtual memory (cumulated for all children) (KiB): 2281240
Max. memory (cumulated for all children) (KiB): 296792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2500.68
system time used= 19.3399
maximum resident set size= 297024
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 407245
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 1307


# summary of solver processes directly reported to runsolver:
#   pid: 5766
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2500.68
#   total CPU system time (s): 19.3399

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.48131 second user time and 18.4295 second system time

The end

Launcher Data 

Begin job on node107 at 2018-08-11 15:20:11
IDJOB=4303125
IDBENCH=141058
IDSOLVER=2778
FILE ID=node107/4303125-1533993611
RUNJOBID= node107-1533993611-5741
PBS_JOBID= 21036955
Free space on /tmp= 39332 MiB

SOLVER NAME= PicatSAT 2018-08-02
BENCH NAME= XCSP18/NurseRostering/NurseRostering-06_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4303125-1533993611/watcher-4303125-1533993611 -o /tmp/evaluation-result-4303125-1533993611/solver-4303125-1533993611 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node107-1533993611-5741 --watchdog 2580  xcsp_picat HOME/instance-4303125-1533993611.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9a3bf89ae74321e3cfb193774a0c0983
RANDOM SEED=699205505

node107.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:         4907152 kB
MemAvailable:   31902636 kB
Buffers:          277760 kB
Cached:         26614060 kB
SwapCached:            0 kB
Active:          8956988 kB
Inactive:       17988884 kB
Active(anon):       2716 kB
Inactive(anon):   103628 kB
Active(file):    8954272 kB
Inactive(file): 17885256 kB
Unevictable:        6976 kB
Mlocked:            6976 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              6124 kB
Writeback:           780 kB
AnonPages:         60748 kB
Mapped:            60656 kB
Shmem:             49804 kB
Slab:             612536 kB
SReclaimable:     584416 kB
SUnreclaim:        28120 kB
KernelStack:        3200 kB
PageTables:         5124 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     350316 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       91520 kB
DirectMap2M:    33454080 kB

Free space on /tmp at the end= 39328 MiB
End job on node107 at 2018-08-11 16:02:11