Trace number 4299042

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.4 2520.04

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v4-14_mini_c18.xml
MD5SUM51a31a49f0c90aa9d82cc667d8941561
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark1.25793
Satisfiable
(Un)Satisfiability was proved
Number of variables392
Number of constraints406
Number of domains2
Minimum domain size14
Maximum domain size196
Distribution of domain sizes[{"size":14,"count":196},{"size":196,"count":182}]
Minimum variable degree0
Maximum variable degree186
Distribution of variable degrees[{"degree":0,"count":14},{"degree":2,"count":182},{"degree":185,"count":14},{"degree":186,"count":182}]
Minimum constraint arity1
Maximum constraint arity197
Distribution of constraint arities[{"arity":1,"count":14},{"arity":3,"count":182},{"arity":14,"count":28},{"arity":197,"count":182}]
Number of extensional constraints182
Number of intensional constraints14
Distribution of constraint types[{"type":"extension","count":182},{"type":"intension","count":14},{"type":"allDifferent","count":28},{"type":"element","count":182}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.03	c NACRE 1.0.4
2519.37/2520.01	c
2519.37/2520.01	c # time = 2519.37
2519.37/2520.01	c # Dec = 1201631
2519.37/2520.01	c # Propagate Calls = 3826144011
2519.37/2520.01	c # assignAt Calls = 13172174
2519.37/2520.01	c # removeAt Calls = 494586958
2519.37/2520.01	c # Run = 2047
2519.37/2520.01	c # Conflicts = 1104488
2519.37/2520.01	c # Memory used = 3163.62 Mb
2519.37/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10370 MiB free)
  memory of node 1: 16384 MiB (15788 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299042-1532781145/watcher-4299042-1532781145 -o /tmp/evaluation-result-4299042-1532781145/solver-4299042-1532781145 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580 nacre_mini_release HOME/instance-4299042-1532781145.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=30460, runsolver pid=30457


[startup+0.100115 s]*
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26775164/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=37448 memory=12940 CPUtime=0.1 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 4088 0 0 0 10 0 0 0 20 0 1 0 95677666 38346752 3235 33554432000 4194304 4933779 140731238302064 140731238299064 4335587 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 9362 3235 612 181 0 2979 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 37448 KiB
Current children cumulated memory: 12940 KiB

[startup+0.209581 s]*
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26772188/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=38744 memory=13996 CPUtime=0.21 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 4404 0 0 0 21 0 0 0 20 0 1 0 95677666 39673856 3499 33554432000 4194304 4933779 140731238302064 140731238299064 4475920 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 9686 3499 617 181 0 3303 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 38744 KiB
Current children cumulated memory: 13996 KiB

[startup+0.309496 s]*
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26768904/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=39776 memory=15316 CPUtime=0.31 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 4674 0 0 0 31 0 0 0 20 0 1 0 95677666 40730624 3829 33554432000 4194304 4933779 140731238302064 140731238299064 4357408 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 9944 3829 617 181 0 3561 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 39776 KiB
Current children cumulated memory: 15316 KiB

[startup+0.700307 s]
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26764936/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=41696 memory=17164 CPUtime=0.69 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 5159 0 0 0 69 0 0 0 20 0 1 0 95677666 42696704 4291 33554432000 4194304 4933779 140731238302064 140731238299064 4475920 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 10424 4291 617 181 0 4041 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 41696 KiB
Current children cumulated memory: 17164 KiB

[startup+1.50028 s]
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26752828/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=48560 memory=24028 CPUtime=1.49 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 6883 0 0 0 148 1 0 0 20 0 1 0 95677666 49725440 6007 33554432000 4194304 4933779 140731238302064 140731238299832 4357293 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 12140 6007 617 181 0 5757 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48560 KiB
Current children cumulated memory: 24028 KiB

[startup+3.10938 s]
/proc/loadavg: 1.84 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26711256/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=64200 memory=39400 CPUtime=3.09 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 14237 0 0 0 308 1 0 0 20 0 1 0 95677666 65740800 9850 33554432000 4194304 4933779 140731238302064 140731238299816 4357325 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 16050 9850 617 181 0 9667 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 64200 KiB
Current children cumulated memory: 39400 KiB

[startup+6.30025 s]
/proc/loadavg: 1.86 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26662204/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=92480 memory=67968 CPUtime=6.29 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 25792 0 0 0 626 3 0 0 20 0 1 0 95677666 94699520 16992 33554432000 4194304 4933779 140731238302064 140731238299832 4365279 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 23120 16992 617 181 0 16737 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 92480 KiB
Current children cumulated memory: 67968 KiB

[startup+12.7003 s]
/proc/loadavg: 1.87 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26572412/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=149120 memory=124328 CPUtime=12.69 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 46380 0 0 0 1264 5 0 0 20 0 1 0 95677666 152698880 31082 33554432000 4194304 4933779 140731238302064 140731238299816 139631972961963 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 37280 31082 617 181 0 30897 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 149120 KiB
Current children cumulated memory: 124328 KiB

[startup+25.5003 s]
/proc/loadavg: 1.90 1.98 2.02 3/187 30461
/proc/meminfo: memFree=26403260/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=261796 memory=237056 CPUtime=25.49 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 97885 0 0 0 2539 10 0 0 20 0 1 0 95677666 268079104 59264 33554432000 4194304 4933779 140731238302064 140731238299816 4475744 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 65449 59264 617 181 0 59066 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 261796 KiB
Current children cumulated memory: 237056 KiB

[startup+51.1095 s]
/proc/loadavg: 1.93 1.99 2.02 3/187 30461
/proc/meminfo: memFree=26176756/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=398064 memory=373412 CPUtime=51.09 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 171014 0 0 0 5091 18 0 0 20 0 1 0 95677666 407617536 93353 33554432000 4194304 4933779 140731238302064 140731238299768 4475942 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 99516 93353 617 181 0 93133 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 398064 KiB
Current children cumulated memory: 373412 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.99 2.02 3/187 30462
/proc/meminfo: memFree=25874972/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=588516 memory=563624 CPUtime=102.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 283009 0 0 0 10198 29 0 0 20 0 1 0 95677666 602640384 140906 33554432000 4194304 4933779 140731238302064 140731238299816 4357293 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 147129 140906 617 181 0 140746 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 588516 KiB
Current children cumulated memory: 563624 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.02 3/187 30463
/proc/meminfo: memFree=25639652/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=749120 memory=724408 CPUtime=162.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 381030 0 0 0 16188 39 0 0 20 0 1 0 95677666 767098880 181102 33554432000 4194304 4933779 140731238302064 140731238299816 4475942 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 187280 181102 617 181 0 180897 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 749120 KiB
Current children cumulated memory: 724408 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 30464
/proc/meminfo: memFree=25411712/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=900096 memory=875528 CPUtime=222.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 491409 0 0 0 22176 51 0 0 20 0 1 0 95677666 921698304 218882 33554432000 4194304 4933779 140731238302064 140731238299768 4357240 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 225024 218882 617 181 0 218641 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 900096 KiB
Current children cumulated memory: 875528 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 30465
/proc/meminfo: memFree=25239668/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=1023720 memory=999004 CPUtime=282.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 599045 0 0 0 28167 60 0 0 20 0 1 0 95677666 1048289280 249751 33554432000 4194304 4933779 140731238302064 140731238299832 4475942 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 255930 249751 617 181 0 249547 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 1023720 KiB
Current children cumulated memory: 999004 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 30466
/proc/meminfo: memFree=25072532/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=1137424 memory=1112768 CPUtime=342.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 717647 0 0 0 34159 68 0 0 20 0 1 0 95677666 1164722176 278192 33554432000 4194304 4933779 140731238302064 140731238299816 4388702 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 284356 278192 617 181 0 277973 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 1137424 KiB
Current children cumulated memory: 1112768 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 30467
/proc/meminfo: memFree=24919408/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=1227028 memory=1201604 CPUtime=402.27 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 831549 0 0 0 40148 79 0 0 20 0 1 0 95677666 1256476672 300401 33554432000 4194304 4933779 140731238302064 140731238299768 139631979170824 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 306757 300401 617 181 0 300374 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 1227028 KiB
Current children cumulated memory: 1201604 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 30475
/proc/meminfo: memFree=24771328/32770624 swapFree=67028236/67108860
[pid=30460] ppid=30457 vsize=1337124 memory=1311708 CPUtime=462.24 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 986142 0 0 0 46131 93 0 0 20 0 1 0 95677666 1369214976 327927 33554432000 4194304 4933779 140731238302064 140731238299816 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 334281 327927 617 181 0 327898 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 1337124 KiB
Current children cumulated memory: 1311708 KiB


################
# More data... #
################

/proc/30460/statm: 656527 650375 617 181 0 650144 0
Current children cumulated CPU time: 1721.78 s
Current children cumulated vsize: 2626108 KiB
Current children cumulated memory: 2601500 KiB

[startup+1782.3 s]
/proc/loadavg: 2.56 2.14 2.07 3/189 30538
/proc/meminfo: memFree=22956204/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2663404 memory=2638684 CPUtime=1781.77 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 2953734 0 0 0 177917 260 0 0 20 0 1 0 95677666 2727325696 659671 33554432000 4194304 4933779 140731238302064 140731238299768 139631972967562 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 665851 659671 617 181 0 659468 0
Current children cumulated CPU time: 1781.77 s
Current children cumulated vsize: 2663404 KiB
Current children cumulated memory: 2638684 KiB

[startup+1842.3 s]
/proc/loadavg: 2.20 2.12 2.06 3/189 30539
/proc/meminfo: memFree=22902136/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2703908 memory=2679228 CPUtime=1841.75 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 2995015 0 0 0 183911 264 0 0 20 0 1 0 95677666 2768801792 669807 33554432000 4194304 4933779 140731238302064 140731238299768 139631973834228 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 675977 669807 617 181 0 669594 0
Current children cumulated CPU time: 1841.75 s
Current children cumulated vsize: 2703908 KiB
Current children cumulated memory: 2679228 KiB

[startup+1902.3 s]
/proc/loadavg: 2.13 2.11 2.06 3/189 30540
/proc/meminfo: memFree=22838076/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2755492 memory=2730912 CPUtime=1901.74 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3036657 0 0 0 189905 269 0 0 20 0 1 0 95677666 2821623808 682728 33554432000 4194304 4933779 140731238302064 140731238299768 139631973824915 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 688873 682728 617 181 0 682490 0
Current children cumulated CPU time: 1901.74 s
Current children cumulated vsize: 2755492 KiB
Current children cumulated memory: 2730912 KiB

[startup+1962.3 s]
/proc/loadavg: 2.11 2.10 2.06 3/188 30541
/proc/meminfo: memFree=22761708/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2813460 memory=2788876 CPUtime=1961.73 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3075620 0 0 0 195900 273 0 0 20 0 1 0 95677666 2880983040 697219 33554432000 4194304 4933779 140731238302064 140731238299816 4423380 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 703365 697219 617 181 0 696982 0
Current children cumulated CPU time: 1961.73 s
Current children cumulated vsize: 2813460 KiB
Current children cumulated memory: 2788876 KiB

[startup+2022.3 s]
/proc/loadavg: 2.04 2.09 2.06 3/187 30542
/proc/meminfo: memFree=22707728/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2853208 memory=2828668 CPUtime=2021.7 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3104635 0 0 0 201894 276 0 0 20 0 1 0 95677666 2921684992 707167 33554432000 4194304 4933779 140731238302064 140731238299768 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 713302 707167 617 181 0 706919 0
Current children cumulated CPU time: 2021.7 s
Current children cumulated vsize: 2853208 KiB
Current children cumulated memory: 2828668 KiB

[startup+2082.3 s]
/proc/loadavg: 2.08 2.09 2.06 3/187 30543
/proc/meminfo: memFree=22645192/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2901288 memory=2876652 CPUtime=2081.69 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3134640 0 0 0 207889 280 0 0 20 0 1 0 95677666 2970918912 719163 33554432000 4194304 4933779 140731238302064 140731238299816 4357274 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 725322 719163 617 181 0 718939 0
Current children cumulated CPU time: 2081.69 s
Current children cumulated vsize: 2901288 KiB
Current children cumulated memory: 2876652 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.07 2.05 3/187 30544
/proc/meminfo: memFree=22592088/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2937748 memory=2913044 CPUtime=2141.68 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3154242 0 0 0 213886 282 0 0 20 0 1 0 95677666 3008253952 728261 33554432000 4194304 4933779 140731238302064 140731238299816 4437370 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 734437 728261 617 181 0 728054 0
Current children cumulated CPU time: 2141.68 s
Current children cumulated vsize: 2937748 KiB
Current children cumulated memory: 2913044 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.06 2.05 3/187 30545
/proc/meminfo: memFree=22523684/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=2993792 memory=2969292 CPUtime=2201.66 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3173113 0 0 0 219881 285 0 0 20 0 1 0 95677666 3065643008 742323 33554432000 4194304 4933779 140731238302064 140731238299768 139631973824891 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 748448 742323 617 181 0 742065 0
Current children cumulated CPU time: 2201.66 s
Current children cumulated vsize: 2993792 KiB
Current children cumulated memory: 2969292 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/188 30554
/proc/meminfo: memFree=22472908/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3029984 memory=3005956 CPUtime=2261.66 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3185443 0 0 0 225878 288 0 0 20 0 1 0 95677666 3102703616 751489 33554432000 4194304 4933779 140731238302064 140731238299768 4357293 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 757496 751489 617 181 0 751113 0
Current children cumulated CPU time: 2261.66 s
Current children cumulated vsize: 3029984 KiB
Current children cumulated memory: 3005956 KiB

[startup+2322.3 s]
/proc/loadavg: 2.04 2.05 2.05 3/188 30555
/proc/meminfo: memFree=22423060/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3070224 memory=3046104 CPUtime=2321.65 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3200374 0 0 0 231876 289 0 0 20 0 1 0 95677666 3143909376 761526 33554432000 4194304 4933779 140731238302064 140731238299816 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 767556 761526 617 181 0 761173 0
Current children cumulated CPU time: 2321.65 s
Current children cumulated vsize: 3070224 KiB
Current children cumulated memory: 3046104 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/188 30556
/proc/meminfo: memFree=22370980/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3107636 memory=3083672 CPUtime=2381.66 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3218697 0 0 0 237874 292 0 0 20 0 1 0 95677666 3182219264 770918 33554432000 4194304 4933779 140731238302064 140731238299816 4364005 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 776909 770918 617 181 0 770526 0
Current children cumulated CPU time: 2381.66 s
Current children cumulated vsize: 3107636 KiB
Current children cumulated memory: 3083672 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/188 30557
/proc/meminfo: memFree=22326368/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3144044 memory=3120040 CPUtime=2441.66 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3240644 0 0 0 243871 295 0 0 20 0 1 0 95677666 3219501056 780010 33554432000 4194304 4933779 140731238302064 140731238299768 4357434 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 786011 780010 617 181 0 779628 0
Current children cumulated CPU time: 2441.66 s
Current children cumulated vsize: 3144044 KiB
Current children cumulated memory: 3120040 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 30558
/proc/meminfo: memFree=22284212/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3176284 memory=3152340 CPUtime=2501.66 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3262858 0 0 0 249869 297 0 0 20 0 1 0 95677666 3252514816 788085 33554432000 4194304 4933779 140731238302064 140731238299816 4435215 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 794071 788085 617 181 0 787688 0
Current children cumulated CPU time: 2501.66 s
Current children cumulated vsize: 3176284 KiB
Current children cumulated memory: 3152340 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.03 2.05 3/188 30619
/proc/meminfo: memFree=23592136/32770624 swapFree=67028240/67108860
[pid=30460] ppid=30457 vsize=3187556 memory=3163616 CPUtime=2519.37 cores=0,2,4,6
/proc/30460/stat : 30460 (nacre_mini_rele) R 30457 30460 29912 0 -1 4202496 3269767 0 0 0 251639 298 0 0 20 0 1 0 95677666 3264057344 790904 33554432000 4194304 4933779 140731238302064 140731238299768 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 32821248 140731238306968 140731238307068 140731238307068 140731238309826 0
/proc/30460/statm: 796889 790904 617 181 0 790506 0
Current children cumulated CPU time: 2519.37 s
Current children cumulated vsize: 3187556 KiB
Current children cumulated memory: 3163616 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 30460 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2516.39 s, system=3.00592 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.04
CPU time (s): 2519.4
CPU user time (s): 2516.39
CPU system time (s): 3.00592
CPU usage (%): 99.9748
Max. virtual memory (cumulated for all children) (KiB): 3187556
Max. memory (cumulated for all children) (KiB): 3163616

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2516.39
system time used= 3.00592
maximum resident set size= 3163720
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3269811
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 960
involuntary context switches= 2454


# summary of solver processes directly reported to runsolver:
#   pid: 30460
#   total CPU time (s): 2519.4
#   total CPU user time (s): 2516.39
#   total CPU system time (s): 3.00592

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.093 second user time and 18.4338 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 14:32:25
IDJOB=4299042
IDBENCH=141287
IDSOLVER=2764
FILE ID=node102/4299042-1532781145
RUNJOBID= node102-1532776103-29943
PBS_JOBID= 21022470
Free space on /tmp= 52748 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v4-14_mini_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299042-1532781145/watcher-4299042-1532781145 -o /tmp/evaluation-result-4299042-1532781145/solver-4299042-1532781145 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580  nacre_mini_release HOME/instance-4299042-1532781145.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 51a31a49f0c90aa9d82cc667d8941561
RANDOM SEED=1759517476

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26786932 kB
MemAvailable:   31920572 kB
Buffers:          213672 kB
Cached:          5175472 kB
SwapCached:        53464 kB
Active:          1217340 kB
Inactive:        4266792 kB
Active(anon):      20940 kB
Inactive(anon):    99020 kB
Active(file):    1196400 kB
Inactive(file):  4167772 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028236 kB
Dirty:              1012 kB
Writeback:             0 kB
AnonPages:         48888 kB
Mapped:            37024 kB
Shmem:             22012 kB
Slab:             198692 kB
SReclaimable:     170604 kB
SUnreclaim:        28088 kB
KernelStack:        3328 kB
PageTables:         4824 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     365228 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52744 MiB
End job on node102 at 2018-07-28 15:14:25