Trace number 4309471

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.01 2519.8

General information on the benchmark

NameNurseRostering/
NurseRostering-12_c18.xml
MD5SUM2a283c05e31c4b30f3ec3c3182bebd94
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark56621
Best CPU time to get the best result obtained on this benchmark2519.9
Satisfiable
(Un)Satisfiability was proved
Number of variables3618
Number of constraints8519
Number of domains14
Minimum domain size1
Maximum domain size61
Distribution of domain sizes[{"size":1,"count":226},{"size":2,"count":662},{"size":3,"count":5},{"size":5,"count":30},{"size":11,"count":1680},{"size":29,"count":427},{"size":61,"count":588}]
Minimum variable degree2
Maximum variable degree39
Distribution of variable degrees[{"degree":2,"count":1698},{"degree":3,"count":240},{"degree":27,"count":44},{"degree":28,"count":69},{"degree":29,"count":7},{"degree":30,"count":41},{"degree":31,"count":67},{"degree":32,"count":93},{"degree":33,"count":97},{"degree":34,"count":125},{"degree":35,"count":445},{"degree":36,"count":418},{"degree":37,"count":184},{"degree":38,"count":76},{"degree":39,"count":14}]
Minimum constraint arity2
Maximum constraint arity120
Distribution of constraint arities[{"arity":2,"count":2950},{"arity":3,"count":2860},{"arity":4,"count":310},{"arity":6,"count":1150},{"arity":7,"count":220},{"arity":11,"count":60},{"arity":29,"count":660},{"arity":61,"count":308},{"arity":120,"count":1}]
Number of extensional constraints1928
Number of intensional constraints1022
Distribution of constraint types[{"type":"extension","count":1928},{"type":"intension","count":1022},{"type":"regular","count":3110},{"type":"sum","count":120},{"type":"count","count":2338},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (6220 MiB free)
  memory of node 1: 16384 MiB (9063 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309471-1534294129/watcher-4309471-1534294129 -o /tmp/evaluation-result-4309471-1534294129/solver-4309471-1534294129 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534294082-5447 --watchdog 2580 xcsp_picat HOME/instance-4309471-1534294129.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5542, runsolver pid=5539

[startup+0.100412 s]*
/proc/loadavg: 1.43 0.81 0.84 3/188 5543
/proc/meminfo: memFree=15615140/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2025744 memory=38416 CPUtime=0.09 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 1108 0 0 0 9 0 0 0 20 0 1 0 246976099 2074361856 9604 33554432000 4194304 5849940 140734051026736 140734051026040 4475218 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 506436 9604 590 405 0 503380 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 38416 KiB

[startup+0.209585 s]*
/proc/loadavg: 1.43 0.81 0.84 3/188 5543
/proc/meminfo: memFree=15592596/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2025744 memory=61128 CPUtime=0.21 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 1144 0 0 0 20 1 0 0 20 0 1 0 246976099 2074361856 15282 33554432000 4194304 5849940 140734051026736 140734051026040 4513833 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 506436 15282 620 405 0 503380 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 61128 KiB

[startup+0.309433 s]*
/proc/loadavg: 1.43 0.81 0.84 3/188 5543
/proc/meminfo: memFree=15581240/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2033560 memory=74168 CPUtime=0.3 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 1323 0 0 0 29 1 0 0 20 0 1 0 246976099 2082365440 18542 33554432000 4194304 5849940 140734051026736 140734051026040 4580756 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 508390 18542 634 405 0 505334 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 74168 KiB

[startup+0.700315 s]
/proc/loadavg: 1.43 0.81 0.84 3/188 5543
/proc/meminfo: memFree=15554680/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2033560 memory=123604 CPUtime=0.69 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 1944 0 0 0 67 2 0 0 20 0 1 0 246976099 2082365440 30901 33554432000 4194304 5849940 140734051026736 140734051026040 4495203 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 508390 30901 642 405 0 505334 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 123604 KiB

[startup+1.50024 s]
/proc/loadavg: 1.43 0.81 0.84 3/188 5543
/proc/meminfo: memFree=15473392/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2035284 memory=183556 CPUtime=1.49 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 2689 0 0 0 144 5 0 0 20 0 1 0 246976099 2084130816 45889 33554432000 4194304 5849940 140734051026736 140734051026040 5605664 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 508821 45889 736 405 0 505765 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2035284 KiB
Current children cumulated memory: 183556 KiB

[startup+3.1093 s]
/proc/loadavg: 1.48 0.83 0.85 3/188 5543
/proc/meminfo: memFree=15451628/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2053384 memory=202044 CPUtime=3.1 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 7859 0 0 0 295 15 0 0 20 0 1 0 246976099 2102665216 50511 33554432000 4194304 5849940 140734051026736 140734051025832 5478039 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 513346 50511 736 405 0 510290 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2053384 KiB
Current children cumulated memory: 202044 KiB

[startup+6.30023 s]
/proc/loadavg: 1.48 0.83 0.85 3/188 5543
/proc/meminfo: memFree=15442200/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2057480 memory=206140 CPUtime=6.28 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 8725 0 0 0 612 16 0 0 20 0 1 0 246976099 2106859520 51535 33554432000 4194304 5849940 140734051026736 140734051025848 140343305091090 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 514370 51535 736 405 0 511314 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 2057480 KiB
Current children cumulated memory: 206140 KiB

[startup+12.7002 s]
/proc/loadavg: 1.52 0.85 0.86 3/188 5543
/proc/meminfo: memFree=15428940/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2057480 memory=206140 CPUtime=12.68 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 9792 0 0 0 1248 20 0 0 20 0 1 0 246976099 2106859520 51535 33554432000 4194304 5849940 140734051026736 140734051025976 5473114 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 514370 51535 736 405 0 511314 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 2057480 KiB
Current children cumulated memory: 206140 KiB

[startup+25.5003 s]
/proc/loadavg: 1.63 0.91 0.88 3/188 5543
/proc/meminfo: memFree=15377136/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2112048 memory=257440 CPUtime=25.48 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 26906 0 0 0 2520 28 0 0 20 0 1 0 246976099 2162737152 64360 33554432000 4194304 5849940 140734051026736 140734051024984 5416809 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 528012 64360 760 405 0 524956 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2112048 KiB
Current children cumulated memory: 257440 KiB

[startup+51.1092 s]
/proc/loadavg: 1.75 0.99 0.90 3/188 5543
/proc/meminfo: memFree=15349224/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2118796 memory=264220 CPUtime=51.08 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 37888 0 0 0 5077 31 0 0 20 0 1 0 246976099 2169647104 66055 33554432000 4194304 5849940 140734051026736 140734051025224 5308408 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 529699 66055 768 405 0 526643 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 2118796 KiB
Current children cumulated memory: 264220 KiB

[startup+102.3 s]
/proc/loadavg: 1.93 1.16 0.97 3/189 5552
/proc/meminfo: memFree=15354580/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2109328 memory=254752 CPUtime=102.27 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 55803 0 0 0 10183 44 0 0 20 0 1 0 246976099 2159951872 63688 33554432000 4194304 5849940 140734051026736 140734051025736 5438020 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 527332 63688 768 405 0 524276 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 2109328 KiB
Current children cumulated memory: 254752 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 1.32 1.03 3/189 5553
/proc/meminfo: memFree=15297172/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2113420 memory=260892 CPUtime=162.27 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 59635 0 0 0 16168 59 0 0 20 0 1 0 246976099 2164142080 65223 33554432000 4194304 5849940 140734051026736 140734051025736 5438016 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 528355 65223 768 405 0 525299 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2113420 KiB
Current children cumulated memory: 260892 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.44 1.09 3/189 5554
/proc/meminfo: memFree=15325324/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2122348 memory=271008 CPUtime=222.27 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 71416 0 0 0 22150 77 0 0 20 0 1 0 246976099 2173284352 67752 33554432000 4194304 5849940 140734051026736 140734051025736 5413271 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 530587 67752 768 405 0 527531 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2122348 KiB
Current children cumulated memory: 271008 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.54 1.15 3/188 5555
/proc/meminfo: memFree=15286972/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2118268 memory=266896 CPUtime=282.28 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 71569 0 0 0 28132 96 0 0 20 0 1 0 246976099 2169106432 66724 33554432000 4194304 5849940 140734051026736 140734051025736 5339232 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 529567 66724 768 405 0 526511 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 2118268 KiB
Current children cumulated memory: 266896 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.63 1.20 3/188 5556
/proc/meminfo: memFree=15217776/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2118404 memory=266556 CPUtime=342.29 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 81898 0 0 0 34117 112 0 0 20 0 1 0 246976099 2169245696 66639 33554432000 4194304 5849940 140734051026736 140734051025736 5307765 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 529601 66639 768 405 0 526545 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2118404 KiB
Current children cumulated memory: 266556 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.69 1.25 3/187 5558
/proc/meminfo: memFree=15180920/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2122424 memory=271084 CPUtime=402.29 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 89453 0 0 0 40101 128 0 0 20 0 1 0 246976099 2173362176 67771 33554432000 4194304 5849940 140734051026736 140734051025736 5339651 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 530606 67771 768 405 0 527550 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2122424 KiB
Current children cumulated memory: 271084 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.75 1.30 3/187 5559
/proc/meminfo: memFree=15266400/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2127336 memory=275952 CPUtime=462.29 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 94646 0 0 0 46075 154 0 0 20 0 1 0 246976099 2178392064 68988 33554432000 4194304 5849940 140734051026736 140734051025736 5307802 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 531834 68988 768 405 0 528778 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 2127336 KiB
Current children cumulated memory: 275952 KiB


################
# More data... #
################

/proc/5542/statm: 544709 83350 768 405 0 541653 0
Current children cumulated CPU time: 1722.4 s
Current children cumulated vsize: 2178836 KiB
Current children cumulated memory: 333400 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.85 3/188 5618
/proc/meminfo: memFree=15087696/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2184284 memory=339008 CPUtime=1782.4 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 301880 0 0 0 177594 646 0 0 20 0 1 0 246976099 2236706816 84752 33554432000 4194304 5849940 140734051026736 140734051025736 5314962 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 546071 84752 768 405 0 543015 0
Current children cumulated CPU time: 1782.4 s
Current children cumulated vsize: 2184284 KiB
Current children cumulated memory: 339008 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 1.86 3/188 5619
/proc/meminfo: memFree=15086428/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2186676 memory=341308 CPUtime=1842.41 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 316401 0 0 0 183574 667 0 0 20 0 1 0 246976099 2239156224 85327 33554432000 4194304 5849940 140734051026736 140734051025736 5307478 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 546669 85327 768 405 0 543613 0
Current children cumulated CPU time: 1842.41 s
Current children cumulated vsize: 2186676 KiB
Current children cumulated memory: 341308 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 1.87 3/188 5625
/proc/meminfo: memFree=15035992/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2186192 memory=340676 CPUtime=1902.41 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 323224 0 0 0 189551 690 0 0 20 0 1 0 246976099 2238660608 85169 33554432000 4194304 5849940 140734051026736 140734051025896 5339072 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 546548 85169 768 405 0 543492 0
Current children cumulated CPU time: 1902.41 s
Current children cumulated vsize: 2186192 KiB
Current children cumulated memory: 340676 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 1.87 3/188 5626
/proc/meminfo: memFree=15029896/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2193476 memory=348080 CPUtime=1962.42 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 330908 0 0 0 195532 710 0 0 20 0 1 0 246976099 2246119424 87020 33554432000 4194304 5849940 140734051026736 140734051025608 140343305559943 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 548369 87020 768 405 0 545313 0
Current children cumulated CPU time: 1962.42 s
Current children cumulated vsize: 2193476 KiB
Current children cumulated memory: 348080 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 1.88 3/188 5627
/proc/meminfo: memFree=15030092/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2180616 memory=335188 CPUtime=2022.43 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 340574 0 0 0 201506 737 0 0 20 0 1 0 246976099 2232950784 83797 33554432000 4194304 5849940 140734051026736 140734051025736 5307758 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 545154 83797 768 405 0 542098 0
Current children cumulated CPU time: 2022.43 s
Current children cumulated vsize: 2180616 KiB
Current children cumulated memory: 335188 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 1.88 3/188 5628
/proc/meminfo: memFree=14946420/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2199648 memory=354144 CPUtime=2082.44 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 351938 0 0 0 207485 759 0 0 20 0 1 0 246976099 2252439552 88536 33554432000 4194304 5849940 140734051026736 140734051025736 5438354 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 549912 88536 768 405 0 546856 0
Current children cumulated CPU time: 2082.44 s
Current children cumulated vsize: 2199648 KiB
Current children cumulated memory: 354144 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.00 1.89 3/188 5629
/proc/meminfo: memFree=14955556/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2190372 memory=344936 CPUtime=2142.45 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 358647 0 0 0 213465 780 0 0 20 0 1 0 246976099 2242940928 86234 33554432000 4194304 5849940 140734051026736 140734051025736 5437906 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 547593 86234 768 405 0 544537 0
Current children cumulated CPU time: 2142.45 s
Current children cumulated vsize: 2190372 KiB
Current children cumulated memory: 344936 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 1.90 3/188 5631
/proc/meminfo: memFree=14964176/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2181584 memory=336060 CPUtime=2202.45 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 370219 0 0 0 219441 804 0 0 20 0 1 0 246976099 2233942016 84015 33554432000 4194304 5849940 140734051026736 140734051025896 5438533 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 545396 84015 768 405 0 542340 0
Current children cumulated CPU time: 2202.45 s
Current children cumulated vsize: 2181584 KiB
Current children cumulated memory: 336060 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 1.90 3/192 5653
/proc/meminfo: memFree=14947672/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2195004 memory=349664 CPUtime=2262.47 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 376915 0 0 0 225421 826 0 0 20 0 1 0 246976099 2247684096 87416 33554432000 4194304 5849940 140734051026736 140734051025736 5438707 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 548751 87416 768 405 0 545695 0
Current children cumulated CPU time: 2262.47 s
Current children cumulated vsize: 2195004 KiB
Current children cumulated memory: 349664 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/188 5655
/proc/meminfo: memFree=14965488/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2180952 memory=335580 CPUtime=2322.47 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 385140 0 0 0 231401 846 0 0 20 0 1 0 246976099 2233294848 83895 33554432000 4194304 5849940 140734051026736 140734051025736 5307536 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 545238 83895 768 405 0 542182 0
Current children cumulated CPU time: 2322.47 s
Current children cumulated vsize: 2180952 KiB
Current children cumulated memory: 335580 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/188 5657
/proc/meminfo: memFree=14922468/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2179880 memory=334392 CPUtime=2382.47 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 400811 0 0 0 237360 887 0 0 20 0 1 0 246976099 2232197120 83598 33554432000 4194304 5849940 140734051026736 140734051025224 5307765 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 544970 83598 768 405 0 541914 0
Current children cumulated CPU time: 2382.47 s
Current children cumulated vsize: 2179880 KiB
Current children cumulated memory: 334392 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/188 5658
/proc/meminfo: memFree=14918416/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2187944 memory=342488 CPUtime=2442.49 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 410314 0 0 0 243340 909 0 0 20 0 1 0 246976099 2240454656 85622 33554432000 4194304 5849940 140734051026736 140734051025896 5307449 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 546986 85622 768 405 0 543930 0
Current children cumulated CPU time: 2442.49 s
Current children cumulated vsize: 2187944 KiB
Current children cumulated memory: 342488 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/188 5725
/proc/meminfo: memFree=15236920/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2194628 memory=349208 CPUtime=2502.49 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 415252 0 0 0 249320 929 0 0 20 0 1 0 246976099 2247299072 87302 33554432000 4194304 5849940 140734051026736 140734051025896 5307953 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 548657 87302 768 405 0 545601 0
Current children cumulated CPU time: 2502.49 s
Current children cumulated vsize: 2194628 KiB
Current children cumulated memory: 349208 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.00 1.93 3/188 5725
/proc/meminfo: memFree=15249816/32770624 swapFree=67108504/67108860
[pid=5542] ppid=5539 vsize=2181312 memory=335988 CPUtime=2520 cores=0,2,4,6
/proc/5542/stat : 5542 (xcsp_picat) R 5539 5542 5416 0 -1 4202496 416827 0 0 0 251065 935 0 0 20 0 1 0 246976099 2233663488 83997 33554432000 4194304 5849940 140734051026736 140734051025736 5354021 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 18497536 140734051030198 140734051030276 140734051030276 140734051033034 0
/proc/5542/statm: 545328 83997 768 405 0 542272 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 2181312 KiB
Current children cumulated memory: 335988 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 5542 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2510.65 s, system=9.35685 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2510.65
CPU system time (s): 9.35685
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 2218056
Max. memory (cumulated for all children) (KiB): 372560

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2510.65
system time used= 9.35685
maximum resident set size= 372560
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 416827
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 28
involuntary context switches= 2494


# summary of solver processes directly reported to runsolver:
#   pid: 5542
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2510.65
#   total CPU system time (s): 9.35685

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.87368 second user time and 18.1713 second system time

The end

Launcher Data 

Begin job on node104 at 2018-08-15 02:48:49
IDJOB=4309471
IDBENCH=141061
IDSOLVER=2794
FILE ID=node104/4309471-1534294129
RUNJOBID= node104-1534294082-5447
PBS_JOBID= 21038148
Free space on /tmp= 40048 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/NurseRostering/NurseRostering-12_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309471-1534294129/watcher-4309471-1534294129 -o /tmp/evaluation-result-4309471-1534294129/solver-4309471-1534294129 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1534294082-5447 --watchdog 2580  xcsp_picat HOME/instance-4309471-1534294129.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2a283c05e31c4b30f3ec3c3182bebd94
RANDOM SEED=1150144829

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        15651620 kB
MemAvailable:   31857572 kB
Buffers:          243080 kB
Cached:         16009264 kB
SwapCached:            8 kB
Active:          7806452 kB
Inactive:        8546828 kB
Active(anon):      51776 kB
Inactive(anon):   101360 kB
Active(file):    7754676 kB
Inactive(file):  8445468 kB
Unevictable:        7304 kB
Mlocked:            7304 kB
SwapTotal:      67108860 kB
SwapFree:       67108504 kB
Dirty:              3544 kB
Writeback:             8 kB
AnonPages:        108288 kB
Mapped:            57356 kB
Shmem:             49636 kB
Slab:             462312 kB
SReclaimable:     434268 kB
SUnreclaim:        28044 kB
KernelStack:        3328 kB
PageTables:         5068 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2423812 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     30720 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 40044 MiB
End job on node104 at 2018-08-15 03:30:49