Trace number 4299114

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.61 2520.01

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v7-12_mini_c18.xml
MD5SUMa1c2562567ad3209fb3991c3158b061f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.880326
Satisfiable
(Un)Satisfiability was proved
Number of variables288
Number of constraints300
Number of domains1
Minimum domain size12
Maximum domain size12
Distribution of domain sizes[{"size":12,"count":276}]
Minimum variable degree0
Maximum variable degree26
Distribution of variable degrees[{"degree":0,"count":12},{"degree":2,"count":132},{"degree":25,"count":12},{"degree":26,"count":132}]
Minimum constraint arity1
Maximum constraint arity14
Distribution of constraint arities[{"arity":1,"count":12},{"arity":12,"count":24},{"arity":14,"count":264}]
Number of extensional constraints0
Number of intensional constraints12
Distribution of constraint types[{"type":"intension","count":12},{"type":"allDifferent","count":24},{"type":"element","count":264}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.4
2519.60/2520.01	c
2519.60/2520.01	c # time = 2519.6
2519.60/2520.01	c # Dec = 4607704
2519.60/2520.01	c # Propagate Calls = 3492509735
2519.60/2520.01	c # assignAt Calls = 7928109
2519.60/2520.01	c # removeAt Calls = 524507167
2519.60/2520.01	c # Run = 8008
2519.60/2520.01	c # Conflicts = 4454667
2519.60/2520.01	c # Memory used = 425.66 Mb
2519.60/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10674 MiB free)
  memory of node 1: 16384 MiB (12491 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299114-1532782400/watcher-4299114-1532782400 -o /tmp/evaluation-result-4299114-1532782400/solver-4299114-1532782400 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1532774055-27429 --watchdog 2580 nacre_mini_release HOME/instance-4299114-1532782400.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28438, runsolver pid=28435
Current StackSize limit: 8192 KiB


[startup+0.100196 s]*
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23719776/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=28140 memory=4884 CPUtime=0.1 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 1400 0 0 0 10 0 0 0 20 0 1 0 95803182 28815360 1221 33554432000 4194304 4933779 140733324694144 140733324691144 4358222 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 7035 1221 614 181 0 652 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28140 KiB
Current children cumulated memory: 4884 KiB

[startup+0.209602 s]*
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23719032/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=29056 memory=5788 CPUtime=0.21 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 1614 0 0 0 21 0 0 0 20 0 1 0 95803182 29753344 1447 33554432000 4194304 4933779 140733324694144 140733324691144 4358719 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 7264 1447 614 181 0 881 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29056 KiB
Current children cumulated memory: 5788 KiB

[startup+0.309384 s]*
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23718288/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=29724 memory=6456 CPUtime=0.31 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 1797 0 0 0 31 0 0 0 20 0 1 0 95803182 30437376 1614 33554432000 4194304 4933779 140733324694144 140733324691896 4358684 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 7431 1614 614 181 0 1048 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 29724 KiB
Current children cumulated memory: 6456 KiB

[startup+0.70035 s]
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23717544/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=32504 memory=9184 CPUtime=0.69 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 2467 0 0 0 69 0 0 0 20 0 1 0 95803182 33284096 2296 33554432000 4194304 4933779 140733324694144 140733324691896 4359669 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 8126 2296 614 181 0 1743 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32504 KiB
Current children cumulated memory: 9184 KiB

[startup+1.50035 s]
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23713420/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=37952 memory=14584 CPUtime=1.49 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 3812 0 0 0 148 1 0 0 20 0 1 0 95803182 38862848 3646 33554432000 4194304 4933779 140733324694144 140733324691896 4363913 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 9488 3646 614 181 0 3105 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 37952 KiB
Current children cumulated memory: 14584 KiB

[startup+3.10956 s]
/proc/loadavg: 2.48 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23700036/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=49112 memory=25620 CPUtime=3.1 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 10477 0 0 0 309 1 0 0 20 0 1 0 95803182 50290688 6405 33554432000 4194304 4933779 140733324694144 140733324691896 4421307 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 12278 6405 614 181 0 5895 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 49112 KiB
Current children cumulated memory: 25620 KiB

[startup+6.30034 s]
/proc/loadavg: 2.44 2.10 2.01 3/188 28439
/proc/meminfo: memFree=23688736/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=60128 memory=36608 CPUtime=6.28 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 19811 0 0 0 626 2 0 0 20 0 1 0 95803182 61571072 9152 33554432000 4194304 4933779 140733324694144 140733324691896 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 15032 9152 614 181 0 8649 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 60128 KiB
Current children cumulated memory: 36608 KiB

[startup+12.7004 s]
/proc/loadavg: 2.40 2.09 2.01 3/188 28439
/proc/meminfo: memFree=23675468/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=74648 memory=50928 CPUtime=12.68 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 28608 0 0 0 1265 3 0 0 20 0 1 0 95803182 76439552 12732 33554432000 4194304 4933779 140733324694144 140733324691848 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 18662 12732 614 181 0 12279 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 74648 KiB
Current children cumulated memory: 50928 KiB

[startup+25.5004 s]
/proc/loadavg: 2.31 2.09 2.01 3/188 28439
/proc/meminfo: memFree=23653340/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=94804 memory=71112 CPUtime=25.46 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 50043 0 0 0 2541 5 0 0 20 0 1 0 95803182 97079296 17778 33554432000 4194304 4933779 140733324694144 140733324691848 4437581 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 23701 17778 614 181 0 17318 0
Current children cumulated CPU time: 25.46 s
Current children cumulated vsize: 94804 KiB
Current children cumulated memory: 71112 KiB

[startup+51.1097 s]
/proc/loadavg: 2.21 2.08 2.01 3/188 28439
/proc/meminfo: memFree=23624664/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=120896 memory=97316 CPUtime=51.06 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 61332 0 0 0 5098 8 0 0 20 0 1 0 95803182 123797504 24329 33554432000 4194304 4933779 140733324694144 140733324691832 139847107589296 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 30224 24329 614 181 0 23841 0
Current children cumulated CPU time: 51.06 s
Current children cumulated vsize: 120896 KiB
Current children cumulated memory: 97316 KiB

[startup+102.3 s]
/proc/loadavg: 2.09 2.07 2.01 3/187 28441
/proc/meminfo: memFree=23592752/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=152712 memory=128184 CPUtime=102.23 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 72674 0 0 0 10214 9 0 0 20 0 1 0 95803182 156377088 32046 33554432000 4194304 4933779 140733324694144 140733324691896 4358557 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 38178 32046 614 181 0 31795 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 152712 KiB
Current children cumulated memory: 128184 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.06 2.01 3/187 28442
/proc/meminfo: memFree=23567488/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=174336 memory=150032 CPUtime=162.23 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 87253 0 0 0 16212 11 0 0 20 0 1 0 95803182 178520064 37508 33554432000 4194304 4933779 140733324694144 140733324691848 4475769 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 43584 37508 614 181 0 37201 0
Current children cumulated CPU time: 162.23 s
Current children cumulated vsize: 174336 KiB
Current children cumulated memory: 150032 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.05 2.01 3/187 28443
/proc/meminfo: memFree=23542736/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=195356 memory=170988 CPUtime=222.23 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 107204 0 0 0 22210 13 0 0 20 0 1 0 95803182 200044544 42747 33554432000 4194304 4933779 140733324694144 140733324691896 4360039 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 48839 42747 614 181 0 42456 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 195356 KiB
Current children cumulated memory: 170988 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.01 3/187 28445
/proc/meminfo: memFree=23517620/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=215484 memory=191320 CPUtime=282.22 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 131792 0 0 0 28206 16 0 0 20 0 1 0 95803182 220655616 47830 33554432000 4194304 4933779 140733324694144 140733324691896 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 53871 47830 614 181 0 47488 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 215484 KiB
Current children cumulated memory: 191320 KiB

[startup+342.3 s]
/proc/loadavg: 2.22 2.08 2.03 3/187 28446
/proc/meminfo: memFree=23496360/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=233244 memory=209400 CPUtime=342.16 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 150764 0 0 0 34199 17 0 0 20 0 1 0 95803182 238841856 52350 33554432000 4194304 4933779 140733324694144 140733324691896 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 58311 52350 614 181 0 51928 0
Current children cumulated CPU time: 342.16 s
Current children cumulated vsize: 233244 KiB
Current children cumulated memory: 209400 KiB

[startup+402.3 s]
/proc/loadavg: 2.32 2.15 2.06 3/187 28454
/proc/meminfo: memFree=23477436/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=248112 memory=224480 CPUtime=402.16 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 156871 0 0 0 40198 18 0 0 20 0 1 0 95803182 254066688 56120 33554432000 4194304 4933779 140733324694144 140733324691656 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 62028 56120 614 181 0 55645 0
Current children cumulated CPU time: 402.16 s
Current children cumulated vsize: 248112 KiB
Current children cumulated memory: 224480 KiB

[startup+462.3 s]
/proc/loadavg: 2.12 2.13 2.05 3/187 28477
/proc/meminfo: memFree=23461480/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=260632 memory=236740 CPUtime=462.16 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 165843 0 0 0 46196 20 0 0 20 0 1 0 95803182 266887168 59185 33554432000 4194304 4933779 140733324694144 140733324691656 4358397 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 65158 59185 614 181 0 58775 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 260632 KiB
Current children cumulated memory: 236740 KiB


################
# More data... #
################

/proc/28438/statm: 99661 93510 614 181 0 93278 0
Current children cumulated CPU time: 1721.99 s
Current children cumulated vsize: 398644 KiB
Current children cumulated memory: 374040 KiB

[startup+1782.3 s]
/proc/loadavg: 1.96 2.02 2.04 3/187 28634
/proc/meminfo: memFree=23443892/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=403664 memory=379160 CPUtime=1781.98 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 338015 0 0 0 178155 43 0 0 20 0 1 0 95803182 413351936 94790 33554432000 4194304 4933779 140733324694144 140733324691896 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 100916 94790 614 181 0 94533 0
Current children cumulated CPU time: 1781.98 s
Current children cumulated vsize: 403664 KiB
Current children cumulated memory: 379160 KiB

[startup+1842.3 s]
/proc/loadavg: 1.99 2.02 2.04 3/187 28635
/proc/meminfo: memFree=23405080/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=408120 memory=383576 CPUtime=1841.97 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 348959 0 0 0 184153 44 0 0 20 0 1 0 95803182 417914880 95894 33554432000 4194304 4933779 140733324694144 140733324691896 4437453 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 102030 95894 614 181 0 95647 0
Current children cumulated CPU time: 1841.97 s
Current children cumulated vsize: 408120 KiB
Current children cumulated memory: 383576 KiB

[startup+1902.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 28637
/proc/meminfo: memFree=23385016/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=412912 memory=388580 CPUtime=1901.95 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 351725 0 0 0 190150 45 0 0 20 0 1 0 95803182 422821888 97145 33554432000 4194304 4933779 140733324694144 140733324691848 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 103228 97145 614 181 0 96845 0
Current children cumulated CPU time: 1901.95 s
Current children cumulated vsize: 412912 KiB
Current children cumulated memory: 388580 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28638
/proc/meminfo: memFree=23359080/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=417492 memory=393240 CPUtime=1961.95 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 355599 0 0 0 196149 46 0 0 20 0 1 0 95803182 427511808 98310 33554432000 4194304 4933779 140733324694144 140733324691832 4358024 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 104373 98310 614 181 0 97990 0
Current children cumulated CPU time: 1961.95 s
Current children cumulated vsize: 417492 KiB
Current children cumulated memory: 393240 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28639
/proc/meminfo: memFree=23339176/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=422032 memory=397608 CPUtime=2021.94 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 360607 0 0 0 202148 46 0 0 20 0 1 0 95803182 432160768 99402 33554432000 4194304 4933779 140733324694144 140733324691848 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 105508 99402 614 181 0 99125 0
Current children cumulated CPU time: 2021.94 s
Current children cumulated vsize: 422032 KiB
Current children cumulated memory: 397608 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28641
/proc/meminfo: memFree=23324676/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=425372 memory=401132 CPUtime=2081.94 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 366317 0 0 0 208147 47 0 0 20 0 1 0 95803182 435580928 100283 33554432000 4194304 4933779 140733324694144 140733324691832 4358936 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 106343 100283 614 181 0 99960 0
Current children cumulated CPU time: 2081.94 s
Current children cumulated vsize: 425372 KiB
Current children cumulated memory: 401132 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28642
/proc/meminfo: memFree=23306688/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=429152 memory=405052 CPUtime=2141.93 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 372953 0 0 0 214146 47 0 0 20 0 1 0 95803182 439451648 101263 33554432000 4194304 4933779 140733324694144 140733324691848 4358405 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 107288 101263 614 181 0 100905 0
Current children cumulated CPU time: 2141.93 s
Current children cumulated vsize: 429152 KiB
Current children cumulated memory: 405052 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28650
/proc/meminfo: memFree=23284964/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=432408 memory=408108 CPUtime=2201.92 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 380332 0 0 0 220144 48 0 0 20 0 1 0 95803182 442785792 102027 33554432000 4194304 4933779 140733324694144 140733324691848 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 108102 102027 614 181 0 101719 0
Current children cumulated CPU time: 2201.92 s
Current children cumulated vsize: 432408 KiB
Current children cumulated memory: 408108 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28651
/proc/meminfo: memFree=23274480/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=435084 memory=410860 CPUtime=2261.91 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 383163 0 0 0 226142 49 0 0 20 0 1 0 95803182 445526016 102715 33554432000 4194304 4933779 140733324694144 140733324691832 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 108771 102715 614 181 0 102388 0
Current children cumulated CPU time: 2261.91 s
Current children cumulated vsize: 435084 KiB
Current children cumulated memory: 410860 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28652
/proc/meminfo: memFree=23266164/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=439276 memory=415028 CPUtime=2321.91 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 386308 0 0 0 232141 50 0 0 20 0 1 0 95803182 449818624 103757 33554432000 4194304 4933779 140733324694144 140733324691656 4437445 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 109819 103757 614 181 0 103436 0
Current children cumulated CPU time: 2321.91 s
Current children cumulated vsize: 439276 KiB
Current children cumulated memory: 415028 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28653
/proc/meminfo: memFree=23252256/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=443060 memory=418772 CPUtime=2381.9 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 390299 0 0 0 238140 50 0 0 20 0 1 0 95803182 453693440 104693 33554432000 4194304 4933779 140733324694144 140733324691848 139847101395568 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 110765 104693 614 181 0 104382 0
Current children cumulated CPU time: 2381.9 s
Current children cumulated vsize: 443060 KiB
Current children cumulated memory: 418772 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28654
/proc/meminfo: memFree=23242956/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=446964 memory=422728 CPUtime=2441.9 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 395133 0 0 0 244139 51 0 0 20 0 1 0 95803182 457691136 105682 33554432000 4194304 4933779 140733324694144 140733324691656 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 111741 105682 614 181 0 105358 0
Current children cumulated CPU time: 2441.9 s
Current children cumulated vsize: 446964 KiB
Current children cumulated memory: 422728 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 28655
/proc/meminfo: memFree=23234772/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=449044 memory=424876 CPUtime=2501.89 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 400012 0 0 0 250138 51 0 0 20 0 1 0 95803182 459821056 106219 33554432000 4194304 4933779 140733324694144 140733324691896 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 112261 106219 614 181 0 105878 0
Current children cumulated CPU time: 2501.89 s
Current children cumulated vsize: 449044 KiB
Current children cumulated memory: 424876 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.04 3/187 28656
/proc/meminfo: memFree=23231816/32770624 swapFree=67108860/67108860
[pid=28438] ppid=28435 vsize=449860 memory=425632 CPUtime=2519.6 cores=0,2,4,6
/proc/28438/stat : 28438 (nacre_mini_rele) R 28435 28438 27398 0 -1 4202496 400666 0 0 0 251908 52 0 0 20 0 1 0 95803182 460656640 106408 33554432000 4194304 4933779 140733324694144 140733324691832 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 22372352 140733324702872 140733324702972 140733324702972 140733324705730 0
/proc/28438/statm: 112465 106408 614 181 0 106082 0
Current children cumulated CPU time: 2519.6 s
Current children cumulated vsize: 449860 KiB
Current children cumulated memory: 425632 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 28438 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.09 s, system=0.524957 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.61
CPU user time (s): 2519.09
CPU system time (s): 0.524957
CPU usage (%): 99.9841
Max. virtual memory (cumulated for all children) (KiB): 449860
Max. memory (cumulated for all children) (KiB): 425632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.09
system time used= 0.524957
maximum resident set size= 425736
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 400709
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 205
involuntary context switches= 3156


# summary of solver processes directly reported to runsolver:
#   pid: 28438
#   total CPU time (s): 2519.61
#   total CPU user time (s): 2519.09
#   total CPU system time (s): 0.524957

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.2799 second user time and 18.0686 second system time

The end

Launcher Data 

Begin job on node139 at 2018-07-28 14:53:20
IDJOB=4299114
IDBENCH=141296
IDSOLVER=2764
FILE ID=node139/4299114-1532782400
RUNJOBID= node139-1532774055-27429
PBS_JOBID= 21022456
Free space on /tmp= 38716 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v7-12_mini_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299114-1532782400/watcher-4299114-1532782400 -o /tmp/evaluation-result-4299114-1532782400/solver-4299114-1532782400 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1532774055-27429 --watchdog 2580  nacre_mini_release HOME/instance-4299114-1532782400.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a1c2562567ad3209fb3991c3158b061f
RANDOM SEED=1937108461

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23722752 kB
MemAvailable:   31769336 kB
Buffers:          236356 kB
Cached:          7909188 kB
SwapCached:            0 kB
Active:          3231608 kB
Inactive:        5125992 kB
Active(anon):     166036 kB
Inactive(anon):    73552 kB
Active(file):    3065572 kB
Inactive(file):  5052440 kB
Unevictable:        7312 kB
Mlocked:            7312 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:               840 kB
Writeback:             4 kB
AnonPages:        279996 kB
Mapped:            44200 kB
Shmem:             25228 kB
Slab:             385800 kB
SReclaimable:     357032 kB
SUnreclaim:        28768 kB
KernelStack:        3520 kB
PageTables:         5056 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     513128 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    219136 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 38716 MiB
End job on node139 at 2018-07-28 15:35:20