Trace number 4305889

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
macht 2018.07.27? (TO) 2519.8 2520.01

General information on the benchmark

NameQuasigroups/
QuasiGroup-7-20_c18.xml
MD5SUM5f66fd9d375fc47cd589a0d8fc089b8f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables800
Number of constraints762
Number of domains1
Minimum domain size20
Maximum domain size20
Distribution of domain sizes[{"size":20,"count":780}]
Minimum variable degree0
Maximum variable degree41
Distribution of variable degrees[{"degree":0,"count":20},{"degree":2,"count":380},{"degree":40,"count":20},{"degree":41,"count":380}]
Minimum constraint arity20
Maximum constraint arity400
Distribution of constraint arities[{"arity":20,"count":1},{"arity":22,"count":760},{"arity":400,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":760}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (8633 MiB free)
  memory of node 1: 16384 MiB (9477 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4305889-1534131203/watcher-4305889-1534131203 -o /tmp/evaluation-result-4305889-1534131203/solver-4305889-1534131203 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1534131203-19677 --watchdog 2580 macht 2520 HOME/instance-4305889-1534131203.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=19711, runsolver pid=19704
Current StackSize limit: 8192 KiB


[startup+0.100521 s]*
/proc/loadavg: 0.77 0.78 0.91 5/193 19712
/proc/meminfo: memFree=18532504/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=42100 memory=11860 CPUtime=0.1 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 3140 0 0 0 10 0 0 0 20 0 1 0 230683563 43110400 2965 33554432000 4194304 36388816 140737032393248 140737032388824 4524080 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 10525 2965 450 7860 0 2630 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 42100 KiB
Current children cumulated memory: 11860 KiB

[startup+0.209631 s]*
/proc/loadavg: 0.77 0.78 0.91 3/191 19712
/proc/meminfo: memFree=18530948/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=45756 memory=15556 CPUtime=0.21 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 4016 0 0 0 21 0 0 0 20 0 1 0 230683563 46854144 3889 33554432000 4194304 36388816 140737032393248 140737032388824 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11439 3889 468 7860 0 3544 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 45756 KiB
Current children cumulated memory: 15556 KiB

[startup+0.309667 s]*
/proc/loadavg: 0.77 0.78 0.91 2/188 19720
/proc/meminfo: memFree=18531740/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=45756 memory=15556 CPUtime=0.31 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 4017 0 0 0 31 0 0 0 20 0 1 0 230683563 46854144 3889 33554432000 4194304 36388816 140737032393248 140737032388824 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11439 3889 468 7860 0 3544 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 45756 KiB
Current children cumulated memory: 15556 KiB

[startup+0.700294 s]
/proc/loadavg: 0.77 0.78 0.91 2/193 19728
/proc/meminfo: memFree=18526880/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=45888 memory=15556 CPUtime=0.69 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 4075 0 0 0 69 0 0 0 20 0 1 0 230683563 46989312 3889 33554432000 4194304 36388816 140737032393248 140737032385848 4528019 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11472 3889 468 7860 0 3577 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 45888 KiB
Current children cumulated memory: 15556 KiB

[startup+1.50029 s]
/proc/loadavg: 1.03 0.84 0.92 2/190 19741
/proc/meminfo: memFree=18530000/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46020 memory=15820 CPUtime=1.49 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 4105 0 0 0 149 0 0 0 20 0 1 0 230683563 47124480 3955 33554432000 4194304 36388816 140737032393248 140737032385848 4528061 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11505 3955 480 7860 0 3610 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 46020 KiB
Current children cumulated memory: 15820 KiB

[startup+3.10966 s]
/proc/loadavg: 1.03 0.84 0.92 3/193 19773
/proc/meminfo: memFree=18527232/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46152 memory=15948 CPUtime=3.09 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 5982 0 0 0 309 0 0 0 20 0 1 0 230683563 47259648 3987 33554432000 4194304 36388816 140737032393248 140737032385848 4528032 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11538 3987 480 7860 0 3643 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 46152 KiB
Current children cumulated memory: 15948 KiB

[startup+6.30026 s]
/proc/loadavg: 1.10 0.86 0.93 3/193 19773
/proc/meminfo: memFree=18528096/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46416 memory=16124 CPUtime=6.29 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 7892 0 0 0 628 1 0 0 20 0 1 0 230683563 47529984 4031 33554432000 4194304 36388816 140737032393248 140737032385848 4251163 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11604 4031 480 7860 0 3709 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 46416 KiB
Current children cumulated memory: 16124 KiB

[startup+12.7003 s]
/proc/loadavg: 1.18 0.87 0.94 3/193 19773
/proc/meminfo: memFree=18528604/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46548 memory=16328 CPUtime=12.68 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 9858 0 0 0 1266 2 0 0 20 0 1 0 230683563 47665152 4082 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11637 4082 480 7860 0 3742 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 46548 KiB
Current children cumulated memory: 16328 KiB

[startup+25.5004 s]
/proc/loadavg: 1.38 0.93 0.95 3/193 19895
/proc/meminfo: memFree=18522240/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46816 memory=16852 CPUtime=25.48 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 12344 0 0 0 2543 5 0 0 20 0 1 0 230683563 47939584 4213 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11704 4213 481 7860 0 3809 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 46816 KiB
Current children cumulated memory: 16852 KiB

[startup+51.1094 s]
/proc/loadavg: 1.73 1.06 1.00 3/193 19895
/proc/meminfo: memFree=18521716/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=46948 memory=17008 CPUtime=51.09 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 12989 0 0 0 5098 11 0 0 20 0 1 0 230683563 48074752 4252 33554432000 4194304 36388816 140737032393248 140737032385848 4420253 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11737 4252 481 7860 0 3842 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 46948 KiB
Current children cumulated memory: 17008 KiB

[startup+102.3 s]
/proc/loadavg: 1.88 1.20 1.05 3/191 19896
/proc/meminfo: memFree=18522460/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47212 memory=17208 CPUtime=102.28 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 13646 0 0 0 10209 19 0 0 20 0 1 0 230683563 48345088 4302 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11803 4302 481 7860 0 3908 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 47212 KiB
Current children cumulated memory: 17208 KiB

[startup+162.3 s]
/proc/loadavg: 1.96 1.35 1.11 3/191 19897
/proc/meminfo: memFree=18522456/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47344 memory=17352 CPUtime=162.27 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 14301 0 0 0 16196 31 0 0 20 0 1 0 230683563 48480256 4338 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11836 4338 481 7860 0 3941 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 47344 KiB
Current children cumulated memory: 17352 KiB

[startup+222.3 s]
/proc/loadavg: 1.98 1.47 1.16 3/191 19898
/proc/meminfo: memFree=18522152/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47476 memory=17476 CPUtime=222.27 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 14958 0 0 0 22182 45 0 0 20 0 1 0 230683563 48615424 4369 33554432000 4194304 36388816 140737032393248 140737032385848 4527824 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11869 4369 481 7860 0 3974 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 47476 KiB
Current children cumulated memory: 17476 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.56 1.22 3/191 19899
/proc/meminfo: memFree=18522460/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47476 memory=17584 CPUtime=282.26 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 15607 0 0 0 28169 57 0 0 20 0 1 0 230683563 48615424 4396 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11869 4396 481 7860 0 3974 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 47476 KiB
Current children cumulated memory: 17584 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.64 1.27 3/187 19900
/proc/meminfo: memFree=18522844/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47608 memory=17652 CPUtime=342.25 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 16255 0 0 0 34154 71 0 0 20 0 1 0 230683563 48750592 4413 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11902 4413 481 7860 0 4007 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 47608 KiB
Current children cumulated memory: 17652 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.71 1.31 3/188 19909
/proc/meminfo: memFree=18521812/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47608 memory=17676 CPUtime=402.25 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 16871 0 0 0 40146 79 0 0 20 0 1 0 230683563 48750592 4419 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11902 4419 481 7860 0 4007 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 47608 KiB
Current children cumulated memory: 17676 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.76 1.35 3/188 19910
/proc/meminfo: memFree=18522248/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=47608 memory=17712 CPUtime=462.25 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 17483 0 0 0 46139 86 0 0 20 0 1 0 230683563 48750592 4428 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 11902 4428 481 7860 0 4007 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 47608 KiB
Current children cumulated memory: 17712 KiB


################
# More data... #
################

/proc/19711/statm: 12001 4531 481 7860 0 4106 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 48004 KiB
Current children cumulated memory: 18124 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.84 3/188 19973
/proc/meminfo: memFree=18520244/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48004 memory=18144 CPUtime=1782.14 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 27872 0 0 0 177908 306 0 0 20 0 1 0 230683563 49156096 4536 33554432000 4194304 36388816 140737032393248 140737032385848 4528050 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12001 4536 481 7860 0 4106 0
Current children cumulated CPU time: 1782.14 s
Current children cumulated vsize: 48004 KiB
Current children cumulated memory: 18144 KiB

[startup+1842.3 s]
/proc/loadavg: 2.47 2.14 1.90 3/188 19974
/proc/meminfo: memFree=18520472/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18160 CPUtime=1842.14 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 28242 0 0 0 183887 327 0 0 20 0 1 0 230683563 49291264 4540 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4540 481 7860 0 4139 0
Current children cumulated CPU time: 1842.14 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18160 KiB

[startup+1902.3 s]
/proc/loadavg: 2.17 2.11 1.91 3/188 19975
/proc/meminfo: memFree=18520760/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18160 CPUtime=1902.14 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 28595 0 0 0 189868 346 0 0 20 0 1 0 230683563 49291264 4540 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4540 481 7860 0 4139 0
Current children cumulated CPU time: 1902.14 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18160 KiB

[startup+1962.3 s]
/proc/loadavg: 2.06 2.09 1.92 3/187 19976
/proc/meminfo: memFree=18520780/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=1962.13 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 28969 0 0 0 195859 354 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 4525153 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 1962.13 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.07 1.92 3/187 19977
/proc/meminfo: memFree=18520852/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2022.12 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 29323 0 0 0 201852 360 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2022.12 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.06 1.93 3/187 19978
/proc/meminfo: memFree=18520796/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2082.12 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 29677 0 0 0 207847 365 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2082.12 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2142.3 s]
/proc/loadavg: 2.07 2.07 1.94 3/187 19979
/proc/meminfo: memFree=18520864/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2142.11 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 30031 0 0 0 213841 370 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 6663740 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2142.11 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2202.3 s]
/proc/loadavg: 2.03 2.06 1.95 3/188 19988
/proc/meminfo: memFree=18519612/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2202.11 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 30385 0 0 0 219836 375 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2202.11 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.04 1.95 3/188 19989
/proc/meminfo: memFree=18519956/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2262.1 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 30739 0 0 0 225830 380 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2262.1 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 1.95 3/188 19990
/proc/meminfo: memFree=18520404/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2322.1 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 31093 0 0 0 231824 386 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 4528019 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2322.1 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.03 1.95 3/188 19991
/proc/meminfo: memFree=18520104/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18172 CPUtime=2382.1 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 31471 0 0 0 237811 399 0 0 20 0 1 0 230683563 49291264 4543 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4543 481 7860 0 4139 0
Current children cumulated CPU time: 2382.1 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18172 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 1.95 3/188 19992
/proc/meminfo: memFree=18520168/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18196 CPUtime=2442.09 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 31840 0 0 0 243796 413 0 0 20 0 1 0 230683563 49291264 4549 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4549 482 7860 0 4139 0
Current children cumulated CPU time: 2442.09 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18196 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.02 1.95 3/187 19993
/proc/meminfo: memFree=18520252/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18196 CPUtime=2502.09 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 32197 0 0 0 249782 427 0 0 20 0 1 0 230683563 49291264 4549 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4549 482 7860 0 4139 0
Current children cumulated CPU time: 2502.09 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18196 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.02 1.95 3/187 19993
/proc/meminfo: memFree=18520252/32770624 swapFree=67108196/67108860
[pid=19711] ppid=19704 vsize=48136 memory=18268 CPUtime=2519.79 cores=0,2,4,6
/proc/19711/stat : 19711 (macht) R 19704 19711 19646 0 -1 4202496 32599 0 0 0 251549 430 0 0 20 0 1 0 230683563 49291264 4567 33554432000 4194304 36388816 140737032393248 140737032385848 8047687 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 38489992 38625312 69779456 140737032402107 140737032402185 140737032402185 140737032404943 0
/proc/19711/statm: 12034 4567 482 7860 0 4139 0
Current children cumulated CPU time: 2519.79 s
Current children cumulated vsize: 48136 KiB
Current children cumulated memory: 18268 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 19711 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2515.49 s, system=4.31067 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.8
CPU user time (s): 2515.49
CPU system time (s): 4.31067
CPU usage (%): 99.9919
Max. virtual memory (cumulated for all children) (KiB): 48136
Max. memory (cumulated for all children) (KiB): 18268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2515.49
system time used= 4.31067
maximum resident set size= 18268
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32599
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 3153


# summary of solver processes directly reported to runsolver:
#   pid: 19711
#   total CPU time (s): 2519.8
#   total CPU user time (s): 2515.49
#   total CPU system time (s): 4.31067

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.22546 second user time and 16.1076 second system time

The end

Launcher Data 

Begin job on node151 at 2018-08-13 05:33:23
IDJOB=4305889
IDBENCH=141608
IDSOLVER=2784
FILE ID=node151/4305889-1534131203
RUNJOBID= node151-1534131203-19677
PBS_JOBID= 21037016
Free space on /tmp= 41256 MiB

SOLVER NAME= macht 2018.07.27
BENCH NAME= XCSP18/Quasigroups/QuasiGroup-7-20_c18.xml
COMMAND LINE= macht TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4305889-1534131203/watcher-4305889-1534131203 -o /tmp/evaluation-result-4305889-1534131203/solver-4305889-1534131203 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1534131203-19677 --watchdog 2580  macht 2520 HOME/instance-4305889-1534131203.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f66fd9d375fc47cd589a0d8fc089b8f
RANDOM SEED=8950578

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        18547264 kB
MemAvailable:   31903088 kB
Buffers:          215128 kB
Cached:         13254572 kB
SwapCached:           16 kB
Active:          5927208 kB
Inactive:        7596064 kB
Active(anon):       3992 kB
Inactive(anon):   102576 kB
Active(file):    5923216 kB
Inactive(file):  7493488 kB
Unevictable:        7836 kB
Mlocked:            7836 kB
SwapTotal:      67108860 kB
SwapFree:       67108196 kB
Dirty:            105032 kB
Writeback:             0 kB
AnonPages:         61312 kB
Mapped:            60020 kB
Shmem:             49524 kB
Slab:             395104 kB
SReclaimable:     367580 kB
SUnreclaim:        27524 kB
KernelStack:        3152 kB
PageTables:         5468 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     351124 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 41152 MiB
End job on node151 at 2018-08-13 06:15:24