Trace number 4305958

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
macht 2018.07.27? (TO) 2519.95 2520.01

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
MD5SUM996bcdf4a135147c7f2ba7242cc18cd5
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables132
Number of constraints23
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":132}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":132}]
Minimum constraint arity11
Maximum constraint arity12
Distribution of constraint arities[{"arity":11,"count":12},{"arity":12,"count":11}]
Number of extensional constraints23
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":23}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10730 MiB free)
  memory of node 1: 16384 MiB (7004 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4305958-1534094152/watcher-4305958-1534094152 -o /tmp/evaluation-result-4305958-1534094152/solver-4305958-1534094152 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1534061174-3822 --watchdog 2580 macht 2520 HOME/instance-4305958-1534094152.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=9130, runsolver pid=9126
Current StackSize limit: 8192 KiB


[startup+0.100392 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18156656/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=37364 memory=6676 CPUtime=0.1 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 2186 0 0 0 10 0 0 0 20 0 1 0 226978484 38260736 1669 33554432000 4194304 36388816 140729500085424 140729500082600 7657110 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 9341 1669 415 7860 0 1446 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 37364 KiB
Current children cumulated memory: 6676 KiB

[startup+0.209673 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18141836/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=55432 memory=22712 CPUtime=0.2 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 6070 0 0 0 20 0 0 0 20 0 1 0 226978484 56762368 5678 33554432000 4194304 36388816 140729500085424 140729500079784 4369644 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 13858 5678 441 7860 0 5963 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 55432 KiB
Current children cumulated memory: 22712 KiB

[startup+0.309661 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18127700/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=70024 memory=36704 CPUtime=0.31 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 9519 0 0 0 30 1 0 0 20 0 1 0 226978484 71704576 9176 33554432000 4194304 36388816 140729500085424 140729500079784 7657110 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 17506 9176 441 7860 0 9611 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 70024 KiB
Current children cumulated memory: 36704 KiB

[startup+0.700386 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18100172/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=105288 memory=70576 CPUtime=0.68 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 18053 0 0 0 67 1 0 0 20 0 1 0 226978484 107814912 17644 33554432000 4194304 36388816 140729500085424 140729500079784 5007664 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 26322 17644 441 7860 0 18427 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 105288 KiB
Current children cumulated memory: 70576 KiB

[startup+1.5004 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18058276/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126428 CPUtime=1.49 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 32576 0 0 0 146 3 0 0 20 0 1 0 226978484 163577856 31607 33554432000 4194304 36388816 140729500085424 140729500079800 4585088 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31607 449 7860 0 32041 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126428 KiB

[startup+3.10977 s]
/proc/loadavg: 2.00 2.02 2.05 3/190 9131
/proc/meminfo: memFree=18036576/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=3.1 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 59434 0 0 0 306 4 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 4585088 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+6.30039 s]
/proc/loadavg: 1.92 2.01 2.04 3/190 9131
/proc/meminfo: memFree=18036300/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=6.28 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 86656 0 0 0 619 9 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+12.7005 s]
/proc/loadavg: 1.93 2.01 2.04 3/190 9131
/proc/meminfo: memFree=18036452/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=12.68 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 114500 0 0 0 1256 12 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+25.5004 s]
/proc/loadavg: 1.95 2.01 2.04 3/190 9131
/proc/meminfo: memFree=18036452/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=25.49 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 168097 0 0 0 2531 18 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 4251152 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+51.1097 s]
/proc/loadavg: 1.96 2.01 2.04 3/189 9131
/proc/meminfo: memFree=18037088/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=51.09 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 195772 0 0 0 5086 23 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.01 2.04 3/190 9133
/proc/meminfo: memFree=18034928/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=126564 CPUtime=102.28 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 223552 0 0 0 10196 32 0 0 20 0 1 0 226978484 163577856 31641 33554432000 4194304 36388816 140729500085424 140729500083368 4585103 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 31641 483 7860 0 32041 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 126564 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/191 9135
/proc/meminfo: memFree=18031336/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=162.25 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 242357 0 0 0 16178 47 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4574975 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/191 9136
/proc/meminfo: memFree=18032068/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=222.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 242639 0 0 0 22167 57 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/192 9145
/proc/meminfo: memFree=18031584/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=282.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 242912 0 0 0 28156 68 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585298 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/192 9146
/proc/meminfo: memFree=18031900/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=342.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 243184 0 0 0 34145 79 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/192 9147
/proc/meminfo: memFree=18031952/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=402.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 243460 0 0 0 40133 91 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585172 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/191 9148
/proc/meminfo: memFree=18031884/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=462.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 243735 0 0 0 46119 105 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4224270 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB


################
# More data... #
################

/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 1722.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+1782.3 s]
/proc/loadavg: 1.00 1.08 1.46 2/184 9237
/proc/meminfo: memFree=18162572/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=1782.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 249476 0 0 0 177802 421 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 1782.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.06 1.43 2/184 9238
/proc/meminfo: memFree=18162544/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=1842.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 249633 0 0 0 183790 434 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.05 1.40 2/184 9239
/proc/meminfo: memFree=18162628/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=1902.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 249791 0 0 0 189774 450 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 6663728 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.04 1.38 2/184 9241
/proc/meminfo: memFree=18162612/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=1962.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 250184 0 0 0 195759 465 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.04 1.35 2/185 9243
/proc/meminfo: memFree=18162708/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2022.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 250458 0 0 0 201743 480 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585095 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2022.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.03 1.33 2/186 9252
/proc/meminfo: memFree=18161916/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2082.24 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 250732 0 0 0 207728 496 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 7667406 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.02 1.31 2/186 9253
/proc/meminfo: memFree=18163076/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2142.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 251008 0 0 0 213714 509 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585103 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2142.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.02 1.29 2/186 9254
/proc/meminfo: memFree=18162956/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2202.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 251164 0 0 0 219698 525 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2202.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.27 2/185 9255
/proc/meminfo: memFree=18162852/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2262.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 251323 0 0 0 225685 538 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4584960 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2262.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.26 2/184 9256
/proc/meminfo: memFree=18162928/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2322.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 251709 0 0 0 231674 549 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.24 2/183 9258
/proc/meminfo: memFree=18162660/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2382.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 251978 0 0 0 237662 561 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585189 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.22 2/183 9259
/proc/meminfo: memFree=18163248/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2442.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 252242 0 0 0 243652 571 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2442.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.21 2/184 9261
/proc/meminfo: memFree=18162988/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2502.23 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 252510 0 0 0 249642 581 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 4585099 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2502.23 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.21 2/184 9262
/proc/meminfo: memFree=18162972/32770624 swapFree=67108688/67108860
[pid=9130] ppid=9126 vsize=159744 memory=129808 CPUtime=2519.94 cores=1,3,5,7
/proc/9130/stat : 9130 (macht) R 9126 9130 3790 0 -1 4202496 252781 0 0 0 251409 585 0 0 20 0 1 0 226978484 163577856 32452 33554432000 4194304 36388816 140729500085424 140729500083368 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 66805760 140729500087483 140729500087561 140729500087561 140729500090319 0
/proc/9130/statm: 39936 32452 483 7860 0 32041 0
Current children cumulated CPU time: 2519.94 s
Current children cumulated vsize: 159744 KiB
Current children cumulated memory: 129808 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 9130 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2514.1 s, system=5.85295 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.95
CPU user time (s): 2514.1
CPU system time (s): 5.85295
CPU usage (%): 99.9976
Max. virtual memory (cumulated for all children) (KiB): 162820
Max. memory (cumulated for all children) (KiB): 129808

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2514.1
system time used= 5.85295
maximum resident set size= 129808
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 252781
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58
involuntary context switches= 652


# summary of solver processes directly reported to runsolver:
#   pid: 9130
#   total CPU time (s): 2519.95
#   total CPU user time (s): 2514.1
#   total CPU system time (s): 5.85295

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1835 second user time and 19.172 second system time

The end

Launcher Data 

Begin job on node134 at 2018-08-12 19:15:53
IDJOB=4305958
IDBENCH=141445
IDSOLVER=2784
FILE ID=node134/4305958-1534094152
RUNJOBID= node134-1534061174-3822
PBS_JOBID= 21036976
Free space on /tmp= 42504 MiB

SOLVER NAME= macht 2018.07.27
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-11-12_c18.xml
COMMAND LINE= macht TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4305958-1534094152/watcher-4305958-1534094152 -o /tmp/evaluation-result-4305958-1534094152/solver-4305958-1534094152 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1534061174-3822 --watchdog 2580  macht 2520 HOME/instance-4305958-1534094152.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 996bcdf4a135147c7f2ba7242cc18cd5
RANDOM SEED=1529452926

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18161340 kB
MemAvailable:   31831136 kB
Buffers:          197976 kB
Cached:         13620164 kB
SwapCached:           52 kB
Active:          4597984 kB
Inactive:        9348236 kB
Active(anon):      77268 kB
Inactive(anon):   103128 kB
Active(file):    4520716 kB
Inactive(file):  9245108 kB
Unevictable:        7392 kB
Mlocked:            7392 kB
SwapTotal:      67108860 kB
SwapFree:       67108688 kB
Dirty:             58104 kB
Writeback:             0 kB
AnonPages:        135476 kB
Mapped:            56636 kB
Shmem:             49652 kB
Slab:             360656 kB
SReclaimable:     332432 kB
SUnreclaim:        28224 kB
KernelStack:        3328 kB
PageTables:         5392 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     449600 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     77824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 42508 MiB
End job on node134 at 2018-08-12 19:57:53