Trace number 4300759

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minimacht 2018.07.27? (TO) 2519.91 2520.01

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v4-20_mini_c18.xml
MD5SUM43d4b24a9d4c7a91506dc3ee81b98d4e
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.05992
Satisfiable
(Un)Satisfiability was proved
Number of variables800
Number of constraints820
Number of domains2
Minimum domain size20
Maximum domain size400
Distribution of domain sizes[{"size":20,"count":400},{"size":400,"count":380}]
Minimum variable degree0
Maximum variable degree384
Distribution of variable degrees[{"degree":0,"count":20},{"degree":2,"count":380},{"degree":383,"count":20},{"degree":384,"count":380}]
Minimum constraint arity1
Maximum constraint arity401
Distribution of constraint arities[{"arity":1,"count":20},{"arity":3,"count":380},{"arity":20,"count":40},{"arity":401,"count":380}]
Number of extensional constraints380
Number of intensional constraints20
Distribution of constraint types[{"type":"extension","count":380},{"type":"intension","count":20},{"type":"allDifferent","count":40},{"type":"element","count":380}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 2018-07-27

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14293 MiB free)
  memory of node 1: 16384 MiB (13208 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4300759-1532852971/watcher-4300759-1532852971 -o /tmp/evaluation-result-4300759-1532852971/solver-4300759-1532852971 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532842880-18201 --watchdog 2580 minimacht 2520 HOME/instance-4300759-1532852971.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19333, runsolver pid=19330
Current StackSize limit: 8192 KiB


[startup+0.100165 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 19334
/proc/meminfo: memFree=28145224/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=43440 memory=19720 CPUtime=0.1 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 5140 0 0 0 10 0 0 0 20 0 1 0 102860320 44482560 4930 33554432000 4194304 5224576 140737082650992 140737082647992 139915806919653 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 10860 4930 604 252 0 4406 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 43440 KiB
Current children cumulated memory: 19720 KiB

[startup+0.209579 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 19334
/proc/meminfo: memFree=28141132/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=47400 memory=23680 CPUtime=0.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 6138 0 0 0 20 0 0 0 20 0 1 0 102860320 48537600 5920 33554432000 4194304 5224576 140737082650992 140737082647992 139915806919653 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 11850 5920 604 252 0 5396 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 47400 KiB
Current children cumulated memory: 23680 KiB

[startup+0.309413 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 19334
/proc/meminfo: memFree=28138156/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=50436 memory=26848 CPUtime=0.31 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 6909 0 0 0 30 1 0 0 20 0 1 0 102860320 51646464 6712 33554432000 4194304 5224576 140737082650992 140737082647992 139915806919653 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 12609 6712 604 252 0 6155 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 50436 KiB
Current children cumulated memory: 26848 KiB

[startup+0.700402 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19334
/proc/meminfo: memFree=28132752/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=58488 memory=34768 CPUtime=0.69 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 8916 0 0 0 68 1 0 0 20 0 1 0 102860320 59891712 8692 33554432000 4194304 5224576 140737082650992 140737082643784 139915806919653 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 14622 8692 606 252 0 8168 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 58488 KiB
Current children cumulated memory: 34768 KiB

[startup+1.50037 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19334
/proc/meminfo: memFree=28124756/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=71200 memory=47704 CPUtime=1.49 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 12091 0 0 0 148 1 0 0 20 0 1 0 102860320 72908800 11926 33554432000 4194304 5224576 140737082650992 140737082645720 139915806919653 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 17800 11926 617 252 0 11346 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 71200 KiB
Current children cumulated memory: 47704 KiB

[startup+3.10939 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 19334
/proc/meminfo: memFree=28037836/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=152428 memory=126340 CPUtime=3.1 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 42617 0 0 0 305 5 0 0 20 0 1 0 102860320 156086272 31585 33554432000 4194304 5224576 140737082650992 140737082645720 4568540 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38107 31585 649 252 0 31653 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 152428 KiB
Current children cumulated memory: 126340 KiB

[startup+6.30036 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 19334
/proc/meminfo: memFree=28036744/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=152956 memory=126944 CPUtime=6.29 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 51484 0 0 0 623 6 0 0 20 0 1 0 102860320 156626944 31736 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38239 31736 649 252 0 31785 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 152956 KiB
Current children cumulated memory: 126944 KiB

[startup+12.7004 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 19334
/proc/meminfo: memFree=28036792/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=153480 memory=127424 CPUtime=12.69 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 61385 0 0 0 1263 6 0 0 20 0 1 0 102860320 157163520 31856 33554432000 4194304 5224576 140737082650992 140737082643736 4471723 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38370 31856 660 252 0 31916 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 153480 KiB
Current children cumulated memory: 127424 KiB

[startup+25.5004 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 19334
/proc/meminfo: memFree=28036048/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=153744 memory=127820 CPUtime=25.49 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 81330 0 0 0 2541 8 0 0 20 0 1 0 102860320 157433856 31955 33554432000 4194304 5224576 140737082650992 140737082643736 4568592 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38436 31955 660 252 0 31982 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 153744 KiB
Current children cumulated memory: 127820 KiB

[startup+51.1096 s]
/proc/loadavg: 1.96 2.00 2.04 3/188 19342
/proc/meminfo: memFree=28035392/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154140 memory=128164 CPUtime=51.09 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 91503 0 0 0 5101 8 0 0 20 0 1 0 102860320 157839360 32041 33554432000 4194304 5224576 140737082650992 140737082643736 4471668 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38535 32041 660 252 0 32081 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 154140 KiB
Current children cumulated memory: 128164 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/188 19343
/proc/meminfo: memFree=28034536/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154404 memory=128408 CPUtime=102.27 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 98807 0 0 0 10217 10 0 0 20 0 1 0 102860320 158109696 32102 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38601 32102 660 252 0 32147 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 154404 KiB
Current children cumulated memory: 128408 KiB

[startup+162.3 s]
/proc/loadavg: 2.10 2.04 2.05 3/188 19344
/proc/meminfo: memFree=28033436/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154536 memory=129480 CPUtime=162.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 99779 0 0 0 16216 10 0 0 20 0 1 0 102860320 158244864 32370 33554432000 4194304 5224576 140737082650992 140737082643736 4566100 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38634 32370 660 252 0 32180 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 154536 KiB
Current children cumulated memory: 129480 KiB

[startup+222.3 s]
/proc/loadavg: 2.07 2.05 2.05 3/188 19345
/proc/meminfo: memFree=28033276/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154536 memory=129576 CPUtime=222.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 100487 0 0 0 22214 12 0 0 20 0 1 0 102860320 158244864 32394 33554432000 4194304 5224576 140737082650992 140737082643736 4471670 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38634 32394 660 252 0 32180 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 154536 KiB
Current children cumulated memory: 129576 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/188 19346
/proc/meminfo: memFree=28033100/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154668 memory=129660 CPUtime=282.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 101220 0 0 0 28213 13 0 0 20 0 1 0 102860320 158380032 32415 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38667 32415 660 252 0 32213 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 154668 KiB
Current children cumulated memory: 129660 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 19347
/proc/meminfo: memFree=28033308/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154668 memory=129748 CPUtime=342.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 101959 0 0 0 34211 15 0 0 20 0 1 0 102860320 158380032 32437 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38667 32437 660 252 0 32213 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 154668 KiB
Current children cumulated memory: 129748 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 19348
/proc/meminfo: memFree=28032884/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154804 memory=129844 CPUtime=402.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 102720 0 0 0 40210 16 0 0 20 0 1 0 102860320 158519296 32461 33554432000 4194304 5224576 140737082650992 140737082643736 4568607 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38701 32461 660 252 0 32247 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 154804 KiB
Current children cumulated memory: 129844 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 19349
/proc/meminfo: memFree=28032144/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=154804 memory=129916 CPUtime=462.26 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 103488 0 0 0 46209 17 0 0 20 0 1 0 102860320 158519296 32479 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38701 32479 660 252 0 32247 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 154804 KiB
Current children cumulated memory: 129916 KiB


################
# More data... #
################

/proc/19333/statm: 38867 32633 660 252 0 32413 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 155468 KiB
Current children cumulated memory: 130532 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19389
/proc/meminfo: memFree=28030836/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155468 memory=130532 CPUtime=1782.21 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 113713 0 0 0 178179 42 0 0 20 0 1 0 102860320 159199232 32633 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38867 32633 660 252 0 32413 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 155468 KiB
Current children cumulated memory: 130532 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19398
/proc/meminfo: memFree=28030228/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155468 memory=130532 CPUtime=1842.21 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 114103 0 0 0 184177 44 0 0 20 0 1 0 102860320 159199232 32633 33554432000 4194304 5224576 140737082650992 140737082643736 4568540 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38867 32633 660 252 0 32413 0
Current children cumulated CPU time: 1842.21 s
Current children cumulated vsize: 155468 KiB
Current children cumulated memory: 130532 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19421
/proc/meminfo: memFree=28029156/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155468 memory=130576 CPUtime=1902.21 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 114423 0 0 0 190176 45 0 0 20 0 1 0 102860320 159199232 32644 33554432000 4194304 5224576 140737082650992 140737082643736 139915807183228 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38867 32644 660 252 0 32413 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 155468 KiB
Current children cumulated memory: 130576 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19422
/proc/meminfo: memFree=28029600/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155468 memory=130580 CPUtime=1962.21 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 114746 0 0 0 196174 47 0 0 20 0 1 0 102860320 159199232 32645 33554432000 4194304 5224576 140737082650992 140737082643736 4566100 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38867 32645 660 252 0 32413 0
Current children cumulated CPU time: 1962.21 s
Current children cumulated vsize: 155468 KiB
Current children cumulated memory: 130580 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19423
/proc/meminfo: memFree=28029668/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130628 CPUtime=2022.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 115145 0 0 0 202172 48 0 0 20 0 1 0 102860320 159334400 32657 33554432000 4194304 5224576 140737082650992 140737082643736 4568622 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32657 660 252 0 32446 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130628 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 19424
/proc/meminfo: memFree=28029376/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130628 CPUtime=2082.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 115468 0 0 0 208171 49 0 0 20 0 1 0 102860320 159334400 32657 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32657 660 252 0 32446 0
Current children cumulated CPU time: 2082.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130628 KiB

[startup+2142.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 19425
/proc/meminfo: memFree=28029500/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130628 CPUtime=2142.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 115799 0 0 0 214170 50 0 0 20 0 1 0 102860320 159334400 32657 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32657 660 252 0 32446 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130628 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 19426
/proc/meminfo: memFree=28029564/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130668 CPUtime=2202.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 116225 0 0 0 220169 51 0 0 20 0 1 0 102860320 159334400 32667 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32667 660 252 0 32446 0
Current children cumulated CPU time: 2202.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130668 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 19427
/proc/meminfo: memFree=28029508/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130672 CPUtime=2262.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 116561 0 0 0 226167 53 0 0 20 0 1 0 102860320 159334400 32668 33554432000 4194304 5224576 140737082650992 140737082643736 4568622 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32668 660 252 0 32446 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130672 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19428
/proc/meminfo: memFree=28029444/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130672 CPUtime=2322.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 116896 0 0 0 232166 54 0 0 20 0 1 0 102860320 159334400 32668 33554432000 4194304 5224576 140737082650992 140737082643736 4471723 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32668 660 252 0 32446 0
Current children cumulated CPU time: 2322.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130672 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19429
/proc/meminfo: memFree=28029512/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130716 CPUtime=2382.2 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 117299 0 0 0 238164 56 0 0 20 0 1 0 102860320 159334400 32679 33554432000 4194304 5224576 140737082650992 140737082643736 4568639 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32679 660 252 0 32446 0
Current children cumulated CPU time: 2382.2 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130716 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19437
/proc/meminfo: memFree=28028724/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130716 CPUtime=2442.19 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 117630 0 0 0 244163 56 0 0 20 0 1 0 102860320 159334400 32679 33554432000 4194304 5224576 140737082650992 140737082643736 4471723 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32679 660 252 0 32446 0
Current children cumulated CPU time: 2442.19 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130716 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 19438
/proc/meminfo: memFree=28028764/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130716 CPUtime=2502.19 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 117959 0 0 0 250161 58 0 0 20 0 1 0 102860320 159334400 32679 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32679 660 252 0 32446 0
Current children cumulated CPU time: 2502.19 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130716 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 19499
/proc/meminfo: memFree=28043488/32770624 swapFree=67108860/67108860
[pid=19333] ppid=19330 vsize=155600 memory=130716 CPUtime=2519.9 cores=1,3,5,7
/proc/19333/stat : 19333 (minimacht) R 19330 19333 18169 0 -1 4202496 118276 0 0 0 251932 58 0 0 20 0 1 0 102860320 159334400 32679 33554432000 4194304 5224576 140737082650992 140737082643736 4568611 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7325440 7329888 34369536 140737082660019 140737082660101 140737082660101 140737082662859 0
/proc/19333/statm: 38900 32679 660 252 0 32446 0
Current children cumulated CPU time: 2519.9 s
Current children cumulated vsize: 155600 KiB
Current children cumulated memory: 130716 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 19333 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.32 s, system=0.587982 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.91
CPU user time (s): 2519.32
CPU system time (s): 0.587982
CPU usage (%): 99.996
Max. virtual memory (cumulated for all children) (KiB): 155600
Max. memory (cumulated for all children) (KiB): 130716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.32
system time used= 0.587982
maximum resident set size= 130716
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 118276
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 32
involuntary context switches= 814


# summary of solver processes directly reported to runsolver:
#   pid: 19333
#   total CPU time (s): 2519.91
#   total CPU user time (s): 2519.32
#   total CPU system time (s): 0.587982

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.7449 second user time and 17.2378 second system time

The end

Launcher Data 

Begin job on node151 at 2018-07-29 10:29:31
IDJOB=4300759
IDBENCH=141299
IDSOLVER=2769
FILE ID=node151/4300759-1532852971
RUNJOBID= node151-1532842880-18201
PBS_JOBID= 21022491
Free space on /tmp= 54908 MiB

SOLVER NAME= minimacht 2018.07.27
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v4-20_mini_c18.xml
COMMAND LINE= minimacht TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4300759-1532852971/watcher-4300759-1532852971 -o /tmp/evaluation-result-4300759-1532852971/solver-4300759-1532852971 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1532842880-18201 --watchdog 2580  minimacht 2520 HOME/instance-4300759-1532852971.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 43d4b24a9d4c7a91506dc3ee81b98d4e
RANDOM SEED=1488138945

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28162064 kB
MemAvailable:   31953956 kB
Buffers:          204436 kB
Cached:          3856444 kB
SwapCached:            0 kB
Active:          1510868 kB
Inactive:        2619136 kB
Active(anon):      19076 kB
Inactive(anon):    78188 kB
Active(file):    1491792 kB
Inactive(file):  2540948 kB
Unevictable:        7804 kB
Mlocked:            7804 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             19948 kB
Writeback:             0 kB
AnonPages:         77008 kB
Mapped:            44788 kB
Shmem:             25224 kB
Slab:             177516 kB
SReclaimable:     149972 kB
SUnreclaim:        27544 kB
KernelStack:        3328 kB
PageTables:         5292 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     367208 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     20480 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 54888 MiB
End job on node151 at 2018-07-29 11:11:31