Trace number 4309469

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.06 2520.02

General information on the benchmark

NameNurseRostering/
NurseRostering-10_c18.xml
MD5SUM8e8c57bbf90dbce08cf7a3cf301ec8dd
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark10181
Best CPU time to get the best result obtained on this benchmark2520.06
Satisfiable
(Un)Satisfiability was proved
Number of variables2140
Number of constraints5421
Number of domains18
Minimum domain size1
Maximum domain size41
Distribution of domain sizes[{"size":1,"count":94},{"size":2,"count":444},{"size":6,"count":1141},{"size":9,"count":7},{"size":10,"count":18},{"size":29,"count":128},{"size":41,"count":308}]
Minimum variable degree2
Maximum variable degree27
Distribution of variable degrees[{"degree":2,"count":860},{"degree":3,"count":160},{"degree":17,"count":33},{"degree":18,"count":41},{"degree":19,"count":6},{"degree":20,"count":31},{"degree":21,"count":40},{"degree":22,"count":67},{"degree":23,"count":71},{"degree":24,"count":80},{"degree":25,"count":360},{"degree":26,"count":293},{"degree":27,"count":98}]
Minimum constraint arity2
Maximum constraint arity80
Distribution of constraint arities[{"arity":2,"count":1932},{"arity":3,"count":2080},{"arity":4,"count":40},{"arity":6,"count":960},{"arity":29,"count":240},{"arity":41,"count":168},{"arity":80,"count":1}]
Number of extensional constraints1248
Number of intensional constraints684
Distribution of constraint types[{"type":"extension","count":1248},{"type":"intension","count":684},{"type":"regular","count":2080},{"type":"sum","count":80},{"type":"count","count":1328},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11837 MiB free)
  memory of node 1: 16384 MiB (9851 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309469-1534293289/watcher-4309469-1534293289 -o /tmp/evaluation-result-4309469-1534293289/solver-4309469-1534293289 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1534293289-16868 --watchdog 2580 xcsp_picat HOME/instance-4309469-1534293289.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16894, runsolver pid=16890
Current StackSize limit: 8192 KiB


[startup+0.100162 s]*
/proc/loadavg: 1.04 0.78 0.87 3/189 16899
/proc/meminfo: memFree=22157480/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2033560 memory=36136 CPUtime=0.1 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 1547 0 0 0 10 0 0 0 20 0 1 0 246892098 2082365440 9034 33554432000 4194304 5849940 140730550904016 140730550904016 4924484 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 508390 9034 626 405 0 505334 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 36136 KiB

[startup+0.209916 s]*
/proc/loadavg: 1.04 0.78 0.87 3/189 16899
/proc/meminfo: memFree=22144864/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2033560 memory=49184 CPUtime=0.21 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 1743 0 0 0 20 1 0 0 20 0 1 0 246892098 2082365440 12296 33554432000 4194304 5849940 140730550904016 140730550904016 4924511 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 508390 12296 635 405 0 505334 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 49184 KiB

[startup+0.325384 s]*
/proc/loadavg: 1.04 0.78 0.87 3/189 16899
/proc/meminfo: memFree=22130088/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2033560 memory=62252 CPUtime=0.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 1952 0 0 0 32 1 0 0 20 0 1 0 246892098 2082365440 15563 33554432000 4194304 5849940 140730550904016 140730550904016 4548519 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 508390 15563 639 405 0 505334 0
Current children cumulated CPU time: 0.33 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 62252 KiB

[startup+0.700273 s]
/proc/loadavg: 1.04 0.78 0.87 3/189 16899
/proc/meminfo: memFree=22099928/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2034124 memory=93096 CPUtime=0.69 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 2503 0 0 0 67 2 0 0 20 0 1 0 246892098 2082942976 23274 33554432000 4194304 5849940 140730550904016 140730550904016 5472624 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 508531 23274 736 405 0 505475 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034124 KiB
Current children cumulated memory: 93096 KiB

[startup+1.50031 s]
/proc/loadavg: 1.04 0.78 0.87 3/189 16899
/proc/meminfo: memFree=22099916/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2036560 memory=95612 CPUtime=1.49 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 3131 0 0 0 141 8 0 0 20 0 1 0 246892098 2085437440 23903 33554432000 4194304 5849940 140730550904016 140730550903112 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 509140 23903 737 405 0 506084 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2036560 KiB
Current children cumulated memory: 95612 KiB

[startup+3.10917 s]
/proc/loadavg: 1.11 0.80 0.87 3/189 16899
/proc/meminfo: memFree=22090676/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2041368 memory=102588 CPUtime=3.1 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 4777 0 0 0 301 9 0 0 20 0 1 0 246892098 2090360832 25647 33554432000 4194304 5849940 140730550904016 140730550903112 5473336 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 510342 25647 737 405 0 507286 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2041368 KiB
Current children cumulated memory: 102588 KiB

[startup+6.30027 s]
/proc/loadavg: 1.11 0.80 0.87 3/189 16899
/proc/meminfo: memFree=22088776/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2043416 memory=104636 CPUtime=6.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 6350 0 0 0 616 13 0 0 20 0 1 0 246892098 2092457984 26159 33554432000 4194304 5849940 140730550904016 140730550903112 5606448 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 510854 26159 737 405 0 507798 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2043416 KiB
Current children cumulated memory: 104636 KiB

[startup+12.7003 s]
/proc/loadavg: 1.18 0.82 0.88 3/189 16899
/proc/meminfo: memFree=22067168/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2065856 memory=127060 CPUtime=12.69 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 21727 0 0 0 1251 18 0 0 20 0 1 0 246892098 2115436544 31765 33554432000 4194304 5849940 140730550904016 140730550901560 4212046 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 516464 31765 765 405 0 513408 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2065856 KiB
Current children cumulated memory: 127060 KiB

[startup+25.5004 s]
/proc/loadavg: 1.36 0.87 0.90 3/189 16963
/proc/meminfo: memFree=21922548/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2063568 memory=124788 CPUtime=25.49 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 27683 0 0 0 2525 24 0 0 20 0 1 0 246892098 2113093632 31197 33554432000 4194304 5849940 140730550904016 140730550903016 5359219 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 515892 31197 769 405 0 512836 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2063568 KiB
Current children cumulated memory: 124788 KiB

[startup+51.1098 s]
/proc/loadavg: 1.58 0.96 0.92 3/189 16963
/proc/meminfo: memFree=21869636/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2066716 memory=127936 CPUtime=51.09 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 38855 0 0 0 5073 36 0 0 20 0 1 0 246892098 2116317184 31984 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 516679 31984 769 405 0 513623 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2066716 KiB
Current children cumulated memory: 127936 KiB

[startup+102.3 s]
/proc/loadavg: 1.82 1.12 0.98 3/189 16964
/proc/meminfo: memFree=21867684/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2067896 memory=132848 CPUtime=102.28 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 41584 0 0 0 10168 60 0 0 20 0 1 0 246892098 2117525504 33212 33554432000 4194304 5849940 140730550904016 140730550903176 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 516974 33212 769 405 0 513918 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2067896 KiB
Current children cumulated memory: 132848 KiB

[startup+162.3 s]
/proc/loadavg: 2.02 1.31 1.06 3/189 16965
/proc/meminfo: memFree=21858816/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2070756 memory=136252 CPUtime=162.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 43902 0 0 0 16128 101 0 0 20 0 1 0 246892098 2120454144 34063 33554432000 4194304 5849940 140730550904016 140730550903016 5438016 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 517689 34063 778 405 0 514633 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2070756 KiB
Current children cumulated memory: 136252 KiB

[startup+222.3 s]
/proc/loadavg: 2.09 1.47 1.12 3/189 16966
/proc/meminfo: memFree=21854696/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2074244 memory=139740 CPUtime=222.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 45433 0 0 0 22091 138 0 0 20 0 1 0 246892098 2124025856 34935 33554432000 4194304 5849940 140730550904016 140730550903016 5407556 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 518561 34935 778 405 0 515505 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2074244 KiB
Current children cumulated memory: 139740 KiB

[startup+282.3 s]
/proc/loadavg: 2.12 1.59 1.19 3/189 16967
/proc/meminfo: memFree=21847676/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2076804 memory=142136 CPUtime=282.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 47235 0 0 0 28048 181 0 0 20 0 1 0 246892098 2126647296 35534 33554432000 4194304 5849940 140730550904016 140730550903016 5437808 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 519201 35534 778 405 0 516145 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2076804 KiB
Current children cumulated memory: 142136 KiB

[startup+342.3 s]
/proc/loadavg: 2.13 1.70 1.25 3/188 16973
/proc/meminfo: memFree=21839056/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2081380 memory=146876 CPUtime=342.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 51000 0 0 0 34003 226 0 0 20 0 1 0 246892098 2131333120 36719 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 520345 36719 778 405 0 517289 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2081380 KiB
Current children cumulated memory: 146876 KiB

[startup+402.3 s]
/proc/loadavg: 2.05 1.75 1.30 3/188 16974
/proc/meminfo: memFree=21804532/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2114152 memory=179596 CPUtime=402.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 55251 0 0 0 39961 268 0 0 20 0 1 0 246892098 2164891648 44899 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 528538 44899 778 405 0 525482 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2114152 KiB
Current children cumulated memory: 179596 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 1.80 1.34 3/188 16975
/proc/meminfo: memFree=21799008/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2119660 memory=185156 CPUtime=462.29 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 60518 0 0 0 45915 314 0 0 20 0 1 0 246892098 2170531840 46289 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 529915 46289 778 405 0 526859 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2119660 KiB
Current children cumulated memory: 185156 KiB


################
# More data... #
################

/proc/16894/statm: 567502 83844 778 405 0 564446 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 2270008 KiB
Current children cumulated memory: 335376 KiB

[startup+1782.3 s]
/proc/loadavg: 2.02 2.07 1.88 3/189 17031
/proc/meminfo: memFree=21747976/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2156620 memory=222116 CPUtime=1782.32 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 192744 0 0 0 177029 1203 0 0 20 0 1 0 246892098 2208378880 55529 33554432000 4194304 5849940 140730550904016 140730550903176 5307802 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 539155 55529 778 405 0 536099 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 2156620 KiB
Current children cumulated memory: 222116 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.06 1.89 3/189 17032
/proc/meminfo: memFree=21747428/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2156620 memory=222116 CPUtime=1842.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 194389 0 0 0 182995 1238 0 0 20 0 1 0 246892098 2208378880 55529 33554432000 4194304 5849940 140730550904016 140730550903016 5437633 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 539155 55529 778 405 0 536099 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 2156620 KiB
Current children cumulated memory: 222116 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.05 1.89 3/189 17033
/proc/meminfo: memFree=21714036/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2189388 memory=254740 CPUtime=1902.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 209132 0 0 0 188961 1272 0 0 20 0 1 0 246892098 2241933312 63685 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 547347 63685 778 405 0 544291 0
Current children cumulated CPU time: 1902.33 s
Current children cumulated vsize: 2189388 KiB
Current children cumulated memory: 254740 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 1.90 3/188 17037
/proc/meminfo: memFree=21735824/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2164584 memory=230080 CPUtime=1962.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 220367 0 0 0 194932 1301 0 0 20 0 1 0 246892098 2216534016 57520 33554432000 4194304 5849940 140730550904016 140730550903016 5437873 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 541146 57520 778 405 0 538090 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 2164584 KiB
Current children cumulated memory: 230080 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 1.90 3/188 17038
/proc/meminfo: memFree=21642844/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2258736 memory=324128 CPUtime=2022.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 227624 0 0 0 200894 1339 0 0 20 0 1 0 246892098 2312945664 81032 33554432000 4194304 5849940 140730550904016 140730550903016 5307856 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 564684 81032 778 405 0 561628 0
Current children cumulated CPU time: 2022.33 s
Current children cumulated vsize: 2258736 KiB
Current children cumulated memory: 324128 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 1.91 3/188 17039
/proc/meminfo: memFree=21676808/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2225936 memory=291360 CPUtime=2082.32 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 242003 0 0 0 206860 1372 0 0 20 0 1 0 246892098 2279358464 72840 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 556484 72840 778 405 0 553428 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 2225936 KiB
Current children cumulated memory: 291360 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.04 1.92 3/188 17045
/proc/meminfo: memFree=21603272/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2260204 memory=325700 CPUtime=2142.32 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 257093 0 0 0 212825 1407 0 0 20 0 1 0 246892098 2314448896 81425 33554432000 4194304 5849940 140730550904016 140730550902888 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 565051 81425 778 405 0 561995 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 2260204 KiB
Current children cumulated memory: 325700 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.03 1.93 3/188 17046
/proc/meminfo: memFree=21669248/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2226784 memory=292280 CPUtime=2202.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 270711 0 0 0 218790 1443 0 0 20 0 1 0 246892098 2280226816 73070 33554432000 4194304 5849940 140730550904016 140730550903016 5437641 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 556696 73070 778 405 0 553640 0
Current children cumulated CPU time: 2202.33 s
Current children cumulated vsize: 2226784 KiB
Current children cumulated memory: 292280 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 1.93 3/188 17047
/proc/meminfo: memFree=21668820/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2225860 memory=291356 CPUtime=2262.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 289573 0 0 0 224741 1492 0 0 20 0 1 0 246892098 2279280640 72839 33554432000 4194304 5849940 140730550904016 140730550902504 5438280 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 556465 72839 778 405 0 553409 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 2225860 KiB
Current children cumulated memory: 291356 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 1.94 3/188 17048
/proc/meminfo: memFree=21669020/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2225860 memory=291356 CPUtime=2322.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 303121 0 0 0 230710 1523 0 0 20 0 1 0 246892098 2279280640 72839 33554432000 4194304 5849940 140730550904016 140730550903016 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 556465 72839 778 405 0 553409 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 2225860 KiB
Current children cumulated memory: 291356 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 1.95 3/188 17049
/proc/meminfo: memFree=21636768/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2258628 memory=324124 CPUtime=2382.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 317851 0 0 0 236676 1557 0 0 20 0 1 0 246892098 2312835072 81031 33554432000 4194304 5849940 140730550904016 140730550903176 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 564657 81031 778 405 0 561601 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 2258628 KiB
Current children cumulated memory: 324124 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 17050
/proc/meminfo: memFree=21657136/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2225860 memory=291356 CPUtime=2442.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 331809 0 0 0 242645 1588 0 0 20 0 1 0 246892098 2279280640 72839 33554432000 4194304 5849940 140730550904016 140730550903016 5335776 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 556465 72839 778 405 0 553409 0
Current children cumulated CPU time: 2442.33 s
Current children cumulated vsize: 2225860 KiB
Current children cumulated memory: 291356 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/188 17051
/proc/meminfo: memFree=21640952/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2216708 memory=282204 CPUtime=2502.33 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 349921 0 0 0 248612 1621 0 0 20 0 1 0 246892098 2269908992 70551 33554432000 4194304 5849940 140730550904016 140730550902888 139823822364551 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 554177 70551 778 405 0 551121 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 2216708 KiB
Current children cumulated memory: 282204 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 1.95 3/188 17051
/proc/meminfo: memFree=21594468/32770624 swapFree=67105356/67108860
[pid=16894] ppid=16890 vsize=2264752 memory=330248 CPUtime=2520.04 cores=1,3,5,7
/proc/16894/stat : 16894 (xcsp_picat) R 16890 16894 16836 0 -1 4202496 352297 0 0 0 250373 1631 0 0 20 0 1 0 246892098 2319106048 82562 33554432000 4194304 5849940 140730550904016 140730550903016 5437768 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9396308 35860480 140730550912182 140730550912260 140730550912260 140730550915018 0
/proc/16894/statm: 566188 82562 778 405 0 563132 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 2264752 KiB
Current children cumulated memory: 330248 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 16894 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2503.73 s, system=16.3264 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.02
CPU time (s): 2520.06
CPU user time (s): 2503.73
CPU system time (s): 16.3264
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2278680
Max. memory (cumulated for all children) (KiB): 344036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2503.73
system time used= 16.3264
maximum resident set size= 344036
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 352297
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 3083


# summary of solver processes directly reported to runsolver:
#   pid: 16894
#   total CPU time (s): 2520.06
#   total CPU user time (s): 2503.73
#   total CPU system time (s): 16.3264

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.69577 second user time and 18.562 second system time

The end

Launcher Data 

Begin job on node149 at 2018-08-15 02:34:49
IDJOB=4309469
IDBENCH=141049
IDSOLVER=2794
FILE ID=node149/4309469-1534293289
RUNJOBID= node149-1534293289-16868
PBS_JOBID= 21038141
Free space on /tmp= 41788 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/NurseRostering/NurseRostering-10_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309469-1534293289/watcher-4309469-1534293289 -o /tmp/evaluation-result-4309469-1534293289/solver-4309469-1534293289 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1534293289-16868 --watchdog 2580  xcsp_picat HOME/instance-4309469-1534293289.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e8c57bbf90dbce08cf7a3cf301ec8dd
RANDOM SEED=1794998474

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22210064 kB
MemAvailable:   31904300 kB
Buffers:          181728 kB
Cached:          9685840 kB
SwapCached:         1704 kB
Active:          4169472 kB
Inactive:        5751392 kB
Active(anon):       4248 kB
Inactive(anon):   101520 kB
Active(file):    4165224 kB
Inactive(file):  5649872 kB
Unevictable:        7608 kB
Mlocked:            7608 kB
SwapTotal:      67108860 kB
SwapFree:       67105356 kB
Dirty:              6212 kB
Writeback:             0 kB
AnonPages:         59260 kB
Mapped:            54208 kB
Shmem:             49600 kB
Slab:             335356 kB
SReclaimable:     307600 kB
SUnreclaim:        27756 kB
KernelStack:        3120 kB
PageTables:         6124 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     351624 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 41780 MiB
End job on node149 at 2018-08-15 03:16:49