Trace number 4305879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
macht 2018.07.27? (TO) 2520.05 2520.01

General information on the benchmark

NameQuasigroups/
QuasiGroup-4-14_c18.xml
MD5SUM0e107aeb1163eb9d4573d4ca0ed1edf8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables392
Number of constraints366
Number of domains2
Minimum domain size14
Maximum domain size196
Distribution of domain sizes[{"size":14,"count":196},{"size":196,"count":182}]
Minimum variable degree0
Maximum variable degree185
Distribution of variable degrees[{"degree":0,"count":14},{"degree":2,"count":182},{"degree":184,"count":14},{"degree":185,"count":182}]
Minimum constraint arity3
Maximum constraint arity197
Distribution of constraint arities[{"arity":3,"count":182},{"arity":14,"count":1},{"arity":196,"count":1},{"arity":197,"count":182}]
Number of extensional constraints0
Number of intensional constraints182
Distribution of constraint types[{"type":"intension","count":182},{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":182}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10323 MiB free)
  memory of node 1: 16384 MiB (6549 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4305879-1534131594/watcher-4305879-1534131594 -o /tmp/evaluation-result-4305879-1534131594/solver-4305879-1534131594 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534099320-3289 --watchdog 2580 macht 2520 HOME/instance-4305879-1534131594.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=7721, runsolver pid=7718
Current StackSize limit: 8192 KiB


[startup+0.100158 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 7722
/proc/meminfo: memFree=17269016/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=41344 memory=11064 CPUtime=0.1 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 2929 0 0 0 10 0 0 0 20 0 1 0 230722560 42336256 2766 33554432000 4194304 36388816 140732646219712 140732646213944 7657110 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 10336 2766 436 7860 0 2441 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 41344 KiB
Current children cumulated memory: 11064 KiB

[startup+0.209653 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 7722
/proc/meminfo: memFree=17259740/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=50188 memory=20040 CPUtime=0.21 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 5202 0 0 0 21 0 0 0 20 0 1 0 230722560 51392512 5010 33554432000 4194304 36388816 140732646219712 140732646213944 7657110 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 12547 5010 479 7860 0 4652 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 50188 KiB
Current children cumulated memory: 20040 KiB

[startup+0.309533 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 7722
/proc/meminfo: memFree=17252300/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=57640 memory=27696 CPUtime=0.3 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 7061 0 0 0 30 0 0 0 20 0 1 0 230722560 59023360 6924 33554432000 4194304 36388816 140732646219712 140732646213944 6663735 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14410 6924 490 7860 0 6515 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 57640 KiB
Current children cumulated memory: 27696 KiB

[startup+0.700289 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 7722
/proc/meminfo: memFree=17252300/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58000 memory=27696 CPUtime=0.69 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 7064 0 0 0 69 0 0 0 20 0 1 0 230722560 59392000 6924 33554432000 4194304 36388816 140732646219712 140732646213944 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14500 6924 490 7860 0 6605 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 58000 KiB
Current children cumulated memory: 27696 KiB

[startup+1.50029 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 7722
/proc/meminfo: memFree=17252300/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58132 memory=27696 CPUtime=1.49 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 7089 0 0 0 149 0 0 0 20 0 1 0 230722560 59527168 6924 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14533 6924 490 7860 0 6638 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 58132 KiB
Current children cumulated memory: 27696 KiB

[startup+3.10918 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 7722
/proc/meminfo: memFree=17252100/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58132 memory=27868 CPUtime=3.1 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 9566 0 0 0 309 1 0 0 20 0 1 0 230722560 59527168 6967 33554432000 4194304 36388816 140732646219712 140732646215576 4224746 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14533 6967 505 7860 0 6638 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 58132 KiB
Current children cumulated memory: 27868 KiB

[startup+6.30028 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 7722
/proc/meminfo: memFree=17251428/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58132 memory=27896 CPUtime=6.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 12053 0 0 0 628 1 0 0 20 0 1 0 230722560 59527168 6974 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14533 6974 505 7860 0 6638 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 58132 KiB
Current children cumulated memory: 27896 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.01 2.05 3/188 7730
/proc/meminfo: memFree=17250140/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58264 memory=27924 CPUtime=12.69 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 14555 0 0 0 1268 1 0 0 20 0 1 0 230722560 59662336 6981 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14566 6981 505 7860 0 6671 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 58264 KiB
Current children cumulated memory: 27924 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.01 2.05 3/188 7730
/proc/meminfo: memFree=17250304/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58264 memory=27992 CPUtime=25.49 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 18612 0 0 0 2547 2 0 0 20 0 1 0 230722560 59662336 6998 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14566 6998 505 7860 0 6671 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 58264 KiB
Current children cumulated memory: 27992 KiB

[startup+51.1092 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 7730
/proc/meminfo: memFree=17250292/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58264 memory=28044 CPUtime=51.09 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 18879 0 0 0 5106 3 0 0 20 0 1 0 230722560 59662336 7011 33554432000 4194304 36388816 140732646219712 140732646215576 4462079 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14566 7011 505 7860 0 6671 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 58264 KiB
Current children cumulated memory: 28044 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 7731
/proc/meminfo: memFree=17250768/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58396 memory=28124 CPUtime=102.28 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 19164 0 0 0 10222 6 0 0 20 0 1 0 230722560 59797504 7031 33554432000 4194304 36388816 140732646219712 140732646215576 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14599 7031 505 7860 0 6704 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 58396 KiB
Current children cumulated memory: 28124 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 7732
/proc/meminfo: memFree=17250584/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58396 memory=28196 CPUtime=162.28 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 19456 0 0 0 16218 10 0 0 20 0 1 0 230722560 59797504 7049 33554432000 4194304 36388816 140732646219712 140732646215576 4598779 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14599 7049 505 7860 0 6704 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 58396 KiB
Current children cumulated memory: 28196 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 7733
/proc/meminfo: memFree=17250668/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58528 memory=28236 CPUtime=222.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 19754 0 0 0 22215 14 0 0 20 0 1 0 230722560 59932672 7059 33554432000 4194304 36388816 140732646219712 140732646215576 4230088 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14632 7059 505 7860 0 6737 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 58528 KiB
Current children cumulated memory: 28236 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 7734
/proc/meminfo: memFree=17251172/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58528 memory=28276 CPUtime=282.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 20056 0 0 0 28211 18 0 0 20 0 1 0 230722560 59932672 7069 33554432000 4194304 36388816 140732646219712 140732646215576 4598779 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14632 7069 505 7860 0 6737 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 58528 KiB
Current children cumulated memory: 28276 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 7735
/proc/meminfo: memFree=17251268/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58528 memory=28288 CPUtime=342.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 20358 0 0 0 34206 23 0 0 20 0 1 0 230722560 59932672 7072 33554432000 4194304 36388816 140732646219712 140732646215576 4462032 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14632 7072 505 7860 0 6737 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 58528 KiB
Current children cumulated memory: 28288 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 7736
/proc/meminfo: memFree=17250988/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58528 memory=28304 CPUtime=402.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 20657 0 0 0 40203 26 0 0 20 0 1 0 230722560 59932672 7076 33554432000 4194304 36388816 140732646219712 140732646215576 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14632 7076 505 7860 0 6737 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 58528 KiB
Current children cumulated memory: 28304 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 7737
/proc/meminfo: memFree=17251084/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58528 memory=28308 CPUtime=462.29 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 20956 0 0 0 46199 30 0 0 20 0 1 0 230722560 59932672 7077 33554432000 4194304 36388816 140732646219712 140732646215576 4459553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14632 7077 505 7860 0 6737 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 58528 KiB
Current children cumulated memory: 28308 KiB


################
# More data... #
################

/proc/7721/statm: 14665 7120 505 7860 0 6770 0
Current children cumulated CPU time: 1722.31 s
Current children cumulated vsize: 58660 KiB
Current children cumulated memory: 28480 KiB

[startup+1782.3 s]
/proc/loadavg: 1.00 1.07 1.40 2/180 7844
/proc/meminfo: memFree=17309956/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28492 CPUtime=1782.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 27691 0 0 0 178114 118 0 0 20 0 1 0 230722560 60203008 7123 33554432000 4194304 36388816 140732646219712 140732646215576 4462032 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7123 505 7860 0 6803 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28492 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.06 1.38 2/181 7853
/proc/meminfo: memFree=17308692/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28492 CPUtime=1842.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 27959 0 0 0 184110 122 0 0 20 0 1 0 230722560 60203008 7123 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7123 505 7860 0 6803 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28492 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.05 1.36 2/181 7854
/proc/meminfo: memFree=17309176/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28492 CPUtime=1902.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 28236 0 0 0 190107 125 0 0 20 0 1 0 230722560 60203008 7123 33554432000 4194304 36388816 140732646219712 140732646215576 4462047 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7123 505 7860 0 6803 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28492 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.04 1.33 2/181 7855
/proc/meminfo: memFree=17309268/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28500 CPUtime=1962.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 28553 0 0 0 196103 129 0 0 20 0 1 0 230722560 60203008 7125 33554432000 4194304 36388816 140732646219712 140732646215576 4296798 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7125 505 7860 0 6803 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28500 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.03 1.31 2/181 7856
/proc/meminfo: memFree=17309520/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28500 CPUtime=2022.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 28813 0 0 0 202100 132 0 0 20 0 1 0 230722560 60203008 7125 33554432000 4194304 36388816 140732646219712 140732646215576 4462062 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7125 505 7860 0 6803 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28500 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.03 1.29 2/181 7857
/proc/meminfo: memFree=17309520/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28500 CPUtime=2082.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 29068 0 0 0 208097 135 0 0 20 0 1 0 230722560 60203008 7125 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7125 505 7860 0 6803 0
Current children cumulated CPU time: 2082.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28500 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.02 1.28 2/180 7858
/proc/meminfo: memFree=17309660/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28512 CPUtime=2142.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 29402 0 0 0 214093 139 0 0 20 0 1 0 230722560 60203008 7128 33554432000 4194304 36388816 140732646219712 140732646215576 4462032 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7128 505 7860 0 6803 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28512 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.02 1.26 2/180 7859
/proc/meminfo: memFree=17309520/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28512 CPUtime=2202.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 29689 0 0 0 220091 141 0 0 20 0 1 0 230722560 60203008 7128 33554432000 4194304 36388816 140732646219712 140732646215576 4462047 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7128 505 7860 0 6803 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28512 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.24 2/180 7860
/proc/meminfo: memFree=17309676/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28512 CPUtime=2262.33 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 29969 0 0 0 226087 146 0 0 20 0 1 0 230722560 60203008 7128 33554432000 4194304 36388816 140732646219712 140732646215576 8047687 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7128 505 7860 0 6803 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28512 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.22 2/180 7861
/proc/meminfo: memFree=17309676/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28512 CPUtime=2322.33 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 30238 0 0 0 232084 149 0 0 20 0 1 0 230722560 60203008 7128 33554432000 4194304 36388816 140732646219712 140732646215576 6663760 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7128 505 7860 0 6803 0
Current children cumulated CPU time: 2322.33 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28512 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.21 2/180 7862
/proc/meminfo: memFree=17309676/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28524 CPUtime=2382.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 30597 0 0 0 238081 151 0 0 20 0 1 0 230722560 60203008 7131 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7131 505 7860 0 6803 0
Current children cumulated CPU time: 2382.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28524 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.20 2/181 7871
/proc/meminfo: memFree=17308760/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28524 CPUtime=2442.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 30881 0 0 0 244076 156 0 0 20 0 1 0 230722560 60203008 7131 33554432000 4194304 36388816 140732646219712 140732646215576 4598726 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7131 505 7860 0 6803 0
Current children cumulated CPU time: 2442.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28524 KiB

[startup+2502.3 s]
/proc/loadavg: 1.00 1.01 1.19 2/181 7872
/proc/meminfo: memFree=17309172/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28524 CPUtime=2502.32 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 31161 0 0 0 250072 160 0 0 20 0 1 0 230722560 60203008 7131 33554432000 4194304 36388816 140732646219712 140732646215576 4462051 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7131 505 7860 0 6803 0
Current children cumulated CPU time: 2502.32 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28524 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.00 1.01 1.19 2/181 7873
/proc/meminfo: memFree=17309172/32770624 swapFree=67108844/67108860
[pid=7721] ppid=7718 vsize=58792 memory=28524 CPUtime=2520.04 cores=1,3,5,7
/proc/7721/stat : 7721 (macht) R 7718 7721 3257 0 -1 4202496 31438 0 0 0 251842 162 0 0 20 0 1 0 230722560 60203008 7131 33554432000 4194304 36388816 140732646219712 140732646215576 4462047 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 38489992 38625312 51707904 140732646220987 140732646221065 140732646221065 140732646223823 0
/proc/7721/statm: 14698 7131 505 7860 0 6803 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 28524 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 7721 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2518.42 s, system=1.62203 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2520.05
CPU user time (s): 2518.42
CPU system time (s): 1.62203
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 58792
Max. memory (cumulated for all children) (KiB): 28524

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2518.42
system time used= 1.62202
maximum resident set size= 28524
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31438
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 772


# summary of solver processes directly reported to runsolver:
#   pid: 7721
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2518.42
#   total CPU system time (s): 1.62203

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.66233 second user time and 15.9384 second system time

The end

Launcher Data 

Begin job on node136 at 2018-08-13 05:39:54
IDJOB=4305879
IDBENCH=141612
IDSOLVER=2784
FILE ID=node136/4305879-1534131594
RUNJOBID= node136-1534099320-3289
PBS_JOBID= 21037005
Free space on /tmp= 35488 MiB

SOLVER NAME= macht 2018.07.27
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-4-14_c18.xml
COMMAND LINE= macht TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4305879-1534131594/watcher-4305879-1534131594 -o /tmp/evaluation-result-4305879-1534131594/solver-4305879-1534131594 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534099320-3289 --watchdog 2580  macht 2520 HOME/instance-4305879-1534131594.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0e107aeb1163eb9d4573d4ca0ed1edf8
RANDOM SEED=221966737

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17278744 kB
MemAvailable:   31903116 kB
Buffers:          239116 kB
Cached:         14494476 kB
SwapCached:            8 kB
Active:          7274684 kB
Inactive:        7516324 kB
Active(anon):       7860 kB
Inactive(anon):   101788 kB
Active(file):    7266824 kB
Inactive(file):  7414536 kB
Unevictable:        7296 kB
Mlocked:            7296 kB
SwapTotal:      67108860 kB
SwapFree:       67108844 kB
Dirty:             52388 kB
Writeback:             0 kB
AnonPages:         64584 kB
Mapped:            54752 kB
Shmem:             49788 kB
Slab:             399356 kB
SReclaimable:     371472 kB
SUnreclaim:        27884 kB
KernelStack:        3360 kB
PageTables:         5376 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     380460 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 35488 MiB
End job on node136 at 2018-08-13 06:21:54