Trace number 4309468

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2520.03 2520.01

General information on the benchmark

NameNurseRostering/
NurseRostering-09_c18.xml
MD5SUM01a28a521b9bba3b9351b91d9c8d3e2f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2750
Best CPU time to get the best result obtained on this benchmark2520.08
Satisfiable
(Un)Satisfiability was proved
Number of variables1844
Number of constraints4787
Number of domains17
Minimum domain size1
Maximum domain size37
Distribution of domain sizes[{"size":1,"count":60},{"size":2,"count":376},{"size":3,"count":8},{"size":4,"count":7},{"size":5,"count":1014},{"size":6,"count":6},{"size":29,"count":121},{"size":37,"count":252}]
Minimum variable degree2
Maximum variable degree25
Distribution of variable degrees[{"degree":2,"count":692},{"degree":3,"count":144},{"degree":14,"count":14},{"degree":15,"count":38},{"degree":16,"count":18},{"degree":17,"count":15},{"degree":18,"count":42},{"degree":19,"count":59},{"degree":20,"count":68},{"degree":21,"count":132},{"degree":22,"count":199},{"degree":23,"count":238},{"degree":24,"count":163},{"degree":25,"count":22}]
Minimum constraint arity2
Maximum constraint arity72
Distribution of constraint arities[{"arity":2,"count":2474},{"arity":3,"count":936},{"arity":4,"count":186},{"arity":5,"count":180},{"arity":6,"count":690},{"arity":29,"count":180},{"arity":37,"count":140},{"arity":72,"count":1}]
Number of extensional constraints1112
Number of intensional constraints552
Distribution of constraint types[{"type":"extension","count":1112},{"type":"intension","count":552},{"type":"regular","count":1896},{"type":"sum","count":72},{"type":"count","count":1154},{"type":"instantiation","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14059 MiB free)
  memory of node 1: 16384 MiB (9345 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309468-1534293246/watcher-4309468-1534293246 -o /tmp/evaluation-result-4309468-1534293246/solver-4309468-1534293246 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1534293186-11147 --watchdog 2580 xcsp_picat HOME/instance-4309468-1534293246.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=11371, runsolver pid=11368
Current StackSize limit: 8192 KiB


[startup+0.100189 s]*
/proc/loadavg: 1.65 1.42 1.47 3/194 11372
/proc/meminfo: memFree=23925416/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2033560 memory=37976 CPUtime=0.1 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 1989 0 0 0 10 0 0 0 20 0 1 0 246887782 2082365440 9494 33554432000 4194304 5849940 140721540877792 140721540877792 4924536 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 508390 9494 635 405 0 505334 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 37976 KiB

[startup+0.210021 s]*
/proc/loadavg: 1.65 1.42 1.47 3/194 11372
/proc/meminfo: memFree=23913016/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2033560 memory=50516 CPUtime=0.21 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 2082 0 0 0 20 1 0 0 20 0 1 0 246887782 2082365440 12629 33554432000 4194304 5849940 140721540877792 140721540877792 5086435 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 508390 12629 636 405 0 505334 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 50516 KiB

[startup+0.309911 s]*
/proc/loadavg: 1.65 1.42 1.47 3/194 11372
/proc/meminfo: memFree=23896104/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2033560 memory=67140 CPUtime=0.31 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 2170 0 0 0 30 1 0 0 20 0 1 0 246887782 2082365440 16785 33554432000 4194304 5849940 140721540877792 140721540877792 4819811 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 508390 16785 655 405 0 505334 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2033560 KiB
Current children cumulated memory: 67140 KiB

[startup+0.700342 s]
/proc/loadavg: 1.65 1.42 1.47 3/194 11372
/proc/meminfo: memFree=23887280/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2034316 memory=74528 CPUtime=0.69 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 2482 0 0 0 67 2 0 0 20 0 1 0 246887782 2083139584 18632 33554432000 4194304 5849940 140721540877792 140721540877792 140322401562503 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 508579 18632 737 405 0 505523 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2034316 KiB
Current children cumulated memory: 74528 KiB

[startup+1.50034 s]
/proc/loadavg: 1.68 1.43 1.47 3/194 11372
/proc/meminfo: memFree=23879972/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2039844 memory=80184 CPUtime=1.49 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 3946 0 0 0 141 8 0 0 20 0 1 0 246887782 2088800256 20046 33554432000 4194304 5849940 140721540877792 140721540876728 140322401562503 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 509961 20046 737 405 0 506905 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2039844 KiB
Current children cumulated memory: 80184 KiB

[startup+3.10941 s]
/proc/loadavg: 1.68 1.43 1.47 3/194 11372
/proc/meminfo: memFree=23878428/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2041380 memory=81720 CPUtime=3.1 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 4667 0 0 0 299 11 0 0 20 0 1 0 246887782 2090373120 20430 33554432000 4194304 5849940 140721540877792 140721540876904 140322401562503 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 510345 20430 737 405 0 507289 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2041380 KiB
Current children cumulated memory: 81720 KiB

[startup+6.30032 s]
/proc/loadavg: 1.71 1.44 1.47 3/194 11372
/proc/meminfo: memFree=23877364/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2062524 memory=97596 CPUtime=6.29 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 15711 0 0 0 613 16 0 0 20 0 1 0 246887782 2112024576 23887 33554432000 4194304 5849940 140721540877792 140721540876184 140322401150880 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 515631 24399 756 405 0 512575 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2062524 KiB
Current children cumulated memory: 97596 KiB

[startup+12.7003 s]
/proc/loadavg: 1.73 1.45 1.48 3/195 11373
/proc/meminfo: memFree=23876920/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2050108 memory=90452 CPUtime=12.69 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 20355 0 0 0 1251 18 0 0 20 0 1 0 246887782 2099310592 22613 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 512527 22613 769 405 0 509471 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2050108 KiB
Current children cumulated memory: 90452 KiB

[startup+25.5003 s]
/proc/loadavg: 1.77 1.46 1.48 3/195 11373
/proc/meminfo: memFree=23862876/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2052416 memory=90808 CPUtime=25.49 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 27181 0 0 0 2526 23 0 0 20 0 1 0 246887782 2101673984 22702 33554432000 4194304 5849940 140721540877792 140721540876952 5438016 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 513104 22702 769 405 0 510048 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2052416 KiB
Current children cumulated memory: 90808 KiB

[startup+51.1097 s]
/proc/loadavg: 1.86 1.52 1.50 3/195 11373
/proc/meminfo: memFree=23851756/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2054456 memory=94720 CPUtime=51.09 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 33581 0 0 0 5077 32 0 0 20 0 1 0 246887782 2103762944 23680 33554432000 4194304 5849940 140721540877792 140721540876792 5307526 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 513614 23680 769 405 0 510558 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2054456 KiB
Current children cumulated memory: 94720 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.61 1.53 3/194 11374
/proc/meminfo: memFree=23861316/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2062976 memory=105260 CPUtime=102.28 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 39528 0 0 0 10166 62 0 0 20 0 1 0 246887782 2112487424 26315 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 515744 26315 778 405 0 512688 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2062976 KiB
Current children cumulated memory: 105260 KiB

[startup+162.3 s]
/proc/loadavg: 2.08 1.69 1.56 3/194 11375
/proc/meminfo: memFree=23831824/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2071168 memory=113328 CPUtime=162.28 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 43302 0 0 0 16131 97 0 0 20 0 1 0 246887782 2120876032 28332 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 517792 28332 778 405 0 514736 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2071168 KiB
Current children cumulated memory: 113328 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 1.75 1.59 3/194 11376
/proc/meminfo: memFree=23824236/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2071168 memory=113452 CPUtime=222.28 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 46804 0 0 0 22094 134 0 0 20 0 1 0 246887782 2120876032 28363 33554432000 4194304 5849940 140721540877792 140721540876952 5437772 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 517792 28363 778 405 0 514736 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2071168 KiB
Current children cumulated memory: 113452 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 1.80 1.62 3/192 11377
/proc/meminfo: memFree=23801728/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2075924 memory=118352 CPUtime=282.27 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 51377 0 0 0 28053 174 0 0 20 0 1 0 246887782 2125746176 29588 33554432000 4194304 5849940 140721540877792 140721540876664 140322401150852 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 518981 29588 778 405 0 515925 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 2075924 KiB
Current children cumulated memory: 118352 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.83 1.64 3/191 11379
/proc/meminfo: memFree=23794112/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2078332 memory=120588 CPUtime=342.26 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 56483 0 0 0 34015 211 0 0 20 0 1 0 246887782 2128211968 30147 33554432000 4194304 5849940 140721540877792 140721540876792 5438057 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 519583 30147 778 405 0 516527 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 2078332 KiB
Current children cumulated memory: 120588 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.86 1.66 3/192 11388
/proc/meminfo: memFree=23759680/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2087472 memory=129900 CPUtime=402.26 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 62823 0 0 0 39980 246 0 0 20 0 1 0 246887782 2137571328 32475 33554432000 4194304 5849940 140721540877792 140721540876792 5339655 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 521868 32475 778 405 0 518812 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 2087472 KiB
Current children cumulated memory: 129900 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.89 1.69 3/193 11390
/proc/meminfo: memFree=23718732/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2127964 memory=170328 CPUtime=462.26 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 73743 0 0 0 45935 291 0 0 20 0 1 0 246887782 2179035136 42582 33554432000 4194304 5849940 140721540877792 140721540876792 5438016 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 531991 42582 778 405 0 528935 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 2127964 KiB
Current children cumulated memory: 170328 KiB


################
# More data... #
################

/proc/11371/statm: 538890 50571 778 405 0 535834 0
Current children cumulated CPU time: 1722.26 s
Current children cumulated vsize: 2155560 KiB
Current children cumulated memory: 202284 KiB

[startup+1782.3 s]
/proc/loadavg: 2.07 2.05 1.97 3/193 11457
/proc/meminfo: memFree=23696624/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2132008 memory=178848 CPUtime=1782.27 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 185860 0 0 0 177148 1079 0 0 20 0 1 0 246887782 2183176192 44712 33554432000 4194304 5849940 140721540877792 140721540876952 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 533002 44712 778 405 0 529946 0
Current children cumulated CPU time: 1782.27 s
Current children cumulated vsize: 2132008 KiB
Current children cumulated memory: 178848 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.04 1.97 3/193 11458
/proc/meminfo: memFree=23666252/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2132388 memory=179100 CPUtime=1842.26 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 187628 0 0 0 183115 1111 0 0 20 0 1 0 246887782 2183565312 44775 33554432000 4194304 5849940 140721540877792 140721540876664 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 533097 44775 778 405 0 530041 0
Current children cumulated CPU time: 1842.26 s
Current children cumulated vsize: 2132388 KiB
Current children cumulated memory: 179100 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.04 1.97 3/192 11459
/proc/meminfo: memFree=23682560/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2144448 memory=191124 CPUtime=1902.27 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 195490 0 0 0 189077 1150 0 0 20 0 1 0 246887782 2195914752 47781 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 536112 47781 778 405 0 533056 0
Current children cumulated CPU time: 1902.27 s
Current children cumulated vsize: 2144448 KiB
Current children cumulated memory: 191124 KiB

[startup+1962.3 s]
/proc/loadavg: 2.04 2.04 1.97 3/192 11460
/proc/meminfo: memFree=23620400/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2165340 memory=211936 CPUtime=1962.27 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 213821 0 0 0 195028 1199 0 0 20 0 1 0 246887782 2217308160 52984 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 541335 52984 778 405 0 538279 0
Current children cumulated CPU time: 1962.27 s
Current children cumulated vsize: 2165340 KiB
Current children cumulated memory: 211936 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.04 1.97 3/192 11461
/proc/meminfo: memFree=23674684/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2144004 memory=190756 CPUtime=2022.27 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 221564 0 0 0 200988 1239 0 0 20 0 1 0 246887782 2195460096 47689 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 536001 47689 778 405 0 532945 0
Current children cumulated CPU time: 2022.27 s
Current children cumulated vsize: 2144004 KiB
Current children cumulated memory: 190756 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.03 1.97 3/192 11463
/proc/meminfo: memFree=23599692/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2197824 memory=244408 CPUtime=2082.28 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 229821 0 0 0 206957 1271 0 0 20 0 1 0 246887782 2250571776 61102 33554432000 4194304 5849940 140721540877792 140721540876792 5339663 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 549456 61102 778 405 0 546400 0
Current children cumulated CPU time: 2082.28 s
Current children cumulated vsize: 2197824 KiB
Current children cumulated memory: 244408 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.03 1.97 3/192 11464
/proc/meminfo: memFree=23689708/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2137260 memory=183968 CPUtime=2142.29 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 231387 0 0 0 212926 1303 0 0 20 0 1 0 246887782 2188554240 45992 33554432000 4194304 5849940 140721540877792 140721540876952 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 534315 45992 778 405 0 531259 0
Current children cumulated CPU time: 2142.29 s
Current children cumulated vsize: 2137260 KiB
Current children cumulated memory: 183968 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.04 1.98 3/192 11470
/proc/meminfo: memFree=23681436/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2137752 memory=184388 CPUtime=2202.29 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 242310 0 0 0 218893 1336 0 0 20 0 1 0 246887782 2189058048 46097 33554432000 4194304 5849940 140721540877792 140721540876792 5307683 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 534438 46097 778 405 0 531382 0
Current children cumulated CPU time: 2202.29 s
Current children cumulated vsize: 2137752 KiB
Current children cumulated memory: 184388 KiB

[startup+2262.3 s]
/proc/loadavg: 2.06 2.04 1.98 3/192 11471
/proc/meminfo: memFree=23675336/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2148724 memory=193424 CPUtime=2262.29 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 245808 0 0 0 224861 1368 0 0 20 0 1 0 246887782 2200293376 48356 33554432000 4194304 5849940 140721540877792 140721540876056 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 537181 48356 778 405 0 534125 0
Current children cumulated CPU time: 2262.29 s
Current children cumulated vsize: 2148724 KiB
Current children cumulated memory: 193424 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.04 1.98 3/193 11473
/proc/meminfo: memFree=23648180/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2144556 memory=189224 CPUtime=2322.29 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 247708 0 0 0 230833 1396 0 0 20 0 1 0 246887782 2196025344 47306 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 536139 47306 778 405 0 533083 0
Current children cumulated CPU time: 2322.29 s
Current children cumulated vsize: 2144556 KiB
Current children cumulated memory: 189224 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.03 1.98 3/193 11474
/proc/meminfo: memFree=23617924/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2155020 memory=201868 CPUtime=2382.3 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 249118 0 0 0 236801 1429 0 0 20 0 1 0 246887782 2206740480 50467 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 538755 50467 778 405 0 535699 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 2155020 KiB
Current children cumulated memory: 201868 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 1.98 3/193 11475
/proc/meminfo: memFree=23638516/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2155020 memory=201868 CPUtime=2442.31 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 258020 0 0 0 242769 1462 0 0 20 0 1 0 246887782 2206740480 50467 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 538755 50467 778 405 0 535699 0
Current children cumulated CPU time: 2442.31 s
Current children cumulated vsize: 2155020 KiB
Current children cumulated memory: 201868 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.02 1.98 3/193 11476
/proc/meminfo: memFree=23649356/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2155020 memory=201868 CPUtime=2502.3 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 258456 0 0 0 248742 1488 0 0 20 0 1 0 246887782 2206740480 50467 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 538755 50467 778 405 0 535699 0
Current children cumulated CPU time: 2502.3 s
Current children cumulated vsize: 2155020 KiB
Current children cumulated memory: 201868 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.02 1.98 3/193 11598
/proc/meminfo: memFree=23776272/32770624 swapFree=67108852/67108860
[pid=11371] ppid=11368 vsize=2155020 memory=201868 CPUtime=2520.01 cores=0,2,4,6
/proc/11371/stat : 11371 (xcsp_picat) R 11368 11371 11116 0 -1 4202496 258456 0 0 0 250502 1499 0 0 20 0 1 0 246887782 2206740480 50467 33554432000 4194304 5849940 140721540877792 140721540876792 140322401562503 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9396308 34287616 140721540879542 140721540879620 140721540879620 140721540882378 0
/proc/11371/statm: 538755 50467 778 405 0 535699 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 2155020 KiB
Current children cumulated memory: 201868 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 11371 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.03 s, system=15.0011 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520.03
CPU user time (s): 2505.03
CPU system time (s): 15.0011
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 2221496
Max. memory (cumulated for all children) (KiB): 268340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.03
system time used= 15.0011
maximum resident set size= 268340
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 258456
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1832


# summary of solver processes directly reported to runsolver:
#   pid: 11371
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2505.03
#   total CPU system time (s): 15.0011

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.3054 second user time and 18.2768 second system time

The end

Launcher Data 

Begin job on node133 at 2018-08-15 02:34:06
IDJOB=4309468
IDBENCH=141047
IDSOLVER=2794
FILE ID=node133/4309468-1534293246
RUNJOBID= node133-1534293186-11147
PBS_JOBID= 21038139
Free space on /tmp= 39380 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/NurseRostering/NurseRostering-09_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309468-1534293246/watcher-4309468-1534293246 -o /tmp/evaluation-result-4309468-1534293246/solver-4309468-1534293246 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node133-1534293186-11147 --watchdog 2580  xcsp_picat HOME/instance-4309468-1534293246.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 01a28a521b9bba3b9351b91d9c8d3e2f
RANDOM SEED=1989727023

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.24
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23967948 kB
MemAvailable:   31817868 kB
Buffers:          145604 kB
Cached:          7936328 kB
SwapCached:            4 kB
Active:          4259228 kB
Inactive:        3965560 kB
Active(anon):      93340 kB
Inactive(anon):   101732 kB
Active(file):    4165888 kB
Inactive(file):  3863828 kB
Unevictable:        7072 kB
Mlocked:            7072 kB
SwapTotal:      67108860 kB
SwapFree:       67108852 kB
Dirty:              3296 kB
Writeback:             0 kB
AnonPages:        148268 kB
Mapped:            57844 kB
Shmem:             49816 kB
Slab:             276608 kB
SReclaimable:     248664 kB
SUnreclaim:        27944 kB
KernelStack:        3472 kB
PageTables:         5580 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2420464 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     73728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116096 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 39376 MiB
End job on node133 at 2018-08-15 03:16:06