Trace number 4299050

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.63 2520.01

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v7-14_mini_c18.xml
MD5SUM95922eaa4febb814ca502892c64f55db
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.976896
Satisfiable
(Un)Satisfiability was proved
Number of variables392
Number of constraints406
Number of domains1
Minimum domain size14
Maximum domain size14
Distribution of domain sizes[{"size":14,"count":378}]
Minimum variable degree0
Maximum variable degree30
Distribution of variable degrees[{"degree":0,"count":14},{"degree":2,"count":182},{"degree":29,"count":14},{"degree":30,"count":182}]
Minimum constraint arity1
Maximum constraint arity16
Distribution of constraint arities[{"arity":1,"count":14},{"arity":14,"count":28},{"arity":16,"count":364}]
Number of extensional constraints0
Number of intensional constraints14
Distribution of constraint types[{"type":"intension","count":14},{"type":"allDifferent","count":28},{"type":"element","count":364}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.62/2520.01	c
2519.62/2520.01	c # time = 2519.62
2519.62/2520.01	c # Dec = 3789685
2519.62/2520.01	c # Propagate Calls = 3566757405
2519.62/2520.01	c # assignAt Calls = 5907990
2519.62/2520.01	c # removeAt Calls = 462258238
2519.62/2520.01	c # Run = 6258
2519.62/2520.01	c # Conflicts = 3619432
2519.62/2520.01	c # Memory used = 633.5 Mb
2519.62/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9089 MiB free)
  memory of node 1: 16384 MiB (11926 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299050-1532781179/watcher-4299050-1532781179 -o /tmp/evaluation-result-4299050-1532781179/solver-4299050-1532781179 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580 nacre_mini_release HOME/instance-4299050-1532781179.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=21283, runsolver pid=21280
Current StackSize limit: 8192 KiB


[startup+0.100195 s]*
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21517100/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=28752 memory=5384 CPUtime=0.1 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1535 0 0 0 10 0 0 0 20 0 1 0 95681078 29442048 1346 33554432000 4194304 4933779 140729587952592 140729587949592 140361555602405 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 7188 1346 614 181 0 805 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28752 KiB
Current children cumulated memory: 5384 KiB

[startup+0.209493 s]*
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21516356/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=29536 memory=6032 CPUtime=0.21 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1708 0 0 0 21 0 0 0 20 0 1 0 95681078 30244864 1508 33554432000 4194304 4933779 140729587952592 140729587949592 4475935 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 7384 1508 614 181 0 1001 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29536 KiB
Current children cumulated memory: 6032 KiB

[startup+0.309022 s]*
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21515612/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=30332 memory=6820 CPUtime=0.31 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1901 0 0 0 31 0 0 0 20 0 1 0 95681078 31059968 1705 33554432000 4194304 4933779 140729587952592 140729587949592 140361555602405 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 7583 1705 614 181 0 1200 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30332 KiB
Current children cumulated memory: 6820 KiB

[startup+0.700347 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21514032/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=33156 memory=9764 CPUtime=0.69 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 2633 0 0 0 69 0 0 0 20 0 1 0 95681078 33951744 2441 33554432000 4194304 4933779 140729587952592 140729587949592 140361556457851 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 8289 2441 614 181 0 1906 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33156 KiB
Current children cumulated memory: 9764 KiB

[startup+1.50035 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21510204/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=39536 memory=16012 CPUtime=1.49 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 4222 0 0 0 149 0 0 0 20 0 1 0 95681078 40484864 4003 33554432000 4194304 4933779 140729587952592 140729587950360 4358725 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 9884 4003 614 181 0 3501 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39536 KiB
Current children cumulated memory: 16012 KiB

[startup+3.10944 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21494384/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=52212 memory=28580 CPUtime=3.1 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 11339 0 0 0 309 1 0 0 20 0 1 0 95681078 53465088 7145 33554432000 4194304 4933779 140729587952592 140729587950360 4358074 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 13053 7145 614 181 0 6670 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 52212 KiB
Current children cumulated memory: 28580 KiB

[startup+6.30034 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21477508/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=67904 memory=44496 CPUtime=6.29 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 22814 0 0 0 627 2 0 0 20 0 1 0 95681078 69533696 11124 33554432000 4194304 4933779 140729587952592 140729587950360 4358315 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 16976 11124 614 181 0 10593 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 67904 KiB
Current children cumulated memory: 44496 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21456800/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=90104 memory=66156 CPUtime=12.69 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 39685 0 0 0 1266 3 0 0 20 0 1 0 95681078 92266496 16539 33554432000 4194304 4933779 140729587952592 140729587950360 4358289 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 22526 16539 614 181 0 16143 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 90104 KiB
Current children cumulated memory: 66156 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 21284
/proc/meminfo: memFree=21425428/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=119452 memory=95508 CPUtime=25.49 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 81969 0 0 0 2543 6 0 0 20 0 1 0 95681078 122318848 23877 33554432000 4194304 4933779 140729587952592 140729587950296 140361561793709 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 29863 23877 614 181 0 23480 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 119452 KiB
Current children cumulated memory: 95508 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 21284
/proc/meminfo: memFree=21381036/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=157788 memory=134220 CPUtime=51.1 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 121323 0 0 0 5099 11 0 0 20 0 1 0 95681078 161574912 33555 33554432000 4194304 4933779 140729587952592 140729587950296 4358302 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 39447 33555 614 181 0 33064 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 157788 KiB
Current children cumulated memory: 134220 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 21285
/proc/meminfo: memFree=21325228/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=208540 memory=183764 CPUtime=102.28 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 172312 0 0 0 10212 16 0 0 20 0 1 0 95681078 213544960 45941 33554432000 4194304 4933779 140729587952592 140729587950296 4358392 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 52135 45941 614 181 0 45752 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 208540 KiB
Current children cumulated memory: 183764 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 21286
/proc/meminfo: memFree=21280872/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=244620 memory=220040 CPUtime=162.29 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 228347 0 0 0 16206 23 0 0 20 0 1 0 95681078 250490880 55010 33554432000 4194304 4933779 140729587952592 140729587950344 4437824 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 61155 55010 614 181 0 54772 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 244620 KiB
Current children cumulated memory: 220040 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 21287
/proc/meminfo: memFree=21245904/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=273184 memory=248772 CPUtime=222.28 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 290044 0 0 0 22200 28 0 0 20 0 1 0 95681078 279740416 62193 33554432000 4194304 4933779 140729587952592 140729587950344 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 68296 62193 614 181 0 61913 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 273184 KiB
Current children cumulated memory: 248772 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 21288
/proc/meminfo: memFree=21211472/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=299160 memory=274796 CPUtime=282.28 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 357029 0 0 0 28195 33 0 0 20 0 1 0 95681078 306339840 68699 33554432000 4194304 4933779 140729587952592 140729587950344 4358000 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 74790 68699 614 181 0 68407 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 299160 KiB
Current children cumulated memory: 274796 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 21289
/proc/meminfo: memFree=21180996/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=320000 memory=295764 CPUtime=342.27 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 425659 0 0 0 34188 39 0 0 20 0 1 0 95681078 327680000 73941 33554432000 4194304 4933779 140729587952592 140729587950280 4337408 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 80000 73941 614 181 0 73617 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 320000 KiB
Current children cumulated memory: 295764 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 21290
/proc/meminfo: memFree=21154008/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=339200 memory=315128 CPUtime=402.27 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 440774 0 0 0 40186 41 0 0 20 0 1 0 95681078 347340800 78782 33554432000 4194304 4933779 140729587952592 140729587950344 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 84800 78782 614 181 0 78417 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 339200 KiB
Current children cumulated memory: 315128 KiB

[startup+462.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/188 21299
/proc/meminfo: memFree=21124312/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=357460 memory=333264 CPUtime=462.27 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 520620 0 0 0 46180 47 0 0 20 0 1 0 95681078 366039040 83316 33554432000 4194304 4933779 140729587952592 140729587950296 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 89365 83316 614 181 0 82982 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 357460 KiB
Current children cumulated memory: 333264 KiB


################
# More data... #
################

/proc/21283/statm: 149607 143297 614 181 0 143224 0
Current children cumulated CPU time: 1722.01 s
Current children cumulated vsize: 598428 KiB
Current children cumulated memory: 573188 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 21445
/proc/meminfo: memFree=20883404/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=605416 memory=580092 CPUtime=1782.01 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 963642 0 0 0 178100 101 0 0 20 0 1 0 95681078 619945984 145023 33554432000 4194304 4933779 140729587952592 140729587950280 4437558 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 151354 145023 614 181 0 144971 0
Current children cumulated CPU time: 1782.01 s
Current children cumulated vsize: 605416 KiB
Current children cumulated memory: 580092 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 21446
/proc/meminfo: memFree=20855256/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=612756 memory=587528 CPUtime=1842 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 976523 0 0 0 184098 102 0 0 20 0 1 0 95681078 627462144 146882 33554432000 4194304 4933779 140729587952592 140729587950296 4388417 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 153189 146882 614 181 0 146806 0
Current children cumulated CPU time: 1842 s
Current children cumulated vsize: 612756 KiB
Current children cumulated memory: 587528 KiB

[startup+1902.3 s]
/proc/loadavg: 2.10 2.04 2.05 3/189 21447
/proc/meminfo: memFree=20831688/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=619224 memory=594080 CPUtime=1902 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 990419 0 0 0 190096 104 0 0 20 0 1 0 95681078 634085376 148520 33554432000 4194304 4933779 140729587952592 140729587950344 4437792 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 154806 148520 614 181 0 148423 0
Current children cumulated CPU time: 1902 s
Current children cumulated vsize: 619224 KiB
Current children cumulated memory: 594080 KiB

[startup+1962.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/187 21448
/proc/meminfo: memFree=20809132/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=625908 memory=600736 CPUtime=1961.99 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1005518 0 0 0 196093 106 0 0 20 0 1 0 95681078 640929792 150184 33554432000 4194304 4933779 140729587952592 140729587950296 4358940 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 156477 150184 614 181 0 150094 0
Current children cumulated CPU time: 1961.99 s
Current children cumulated vsize: 625908 KiB
Current children cumulated memory: 600736 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 21449
/proc/meminfo: memFree=20787368/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=630604 memory=605220 CPUtime=2021.99 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1020905 0 0 0 202090 109 0 0 20 0 1 0 95681078 645738496 151305 33554432000 4194304 4933779 140729587952592 140729587950296 140361556457851 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 157651 151305 614 181 0 151268 0
Current children cumulated CPU time: 2021.99 s
Current children cumulated vsize: 630604 KiB
Current children cumulated memory: 605220 KiB

[startup+2082.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/187 21450
/proc/meminfo: memFree=20769024/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=634052 memory=608684 CPUtime=2081.99 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1036010 0 0 0 208088 111 0 0 20 0 1 0 95681078 649269248 152171 33554432000 4194304 4933779 140729587952592 140729587950104 4437811 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 158513 152171 614 181 0 152130 0
Current children cumulated CPU time: 2081.99 s
Current children cumulated vsize: 634052 KiB
Current children cumulated memory: 608684 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/187 21451
/proc/meminfo: memFree=20749804/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=637380 memory=611848 CPUtime=2141.98 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1053328 0 0 0 214085 113 0 0 20 0 1 0 95681078 652677120 152962 33554432000 4194304 4933779 140729587952592 140729587950280 4437572 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 159345 152962 614 181 0 152962 0
Current children cumulated CPU time: 2141.98 s
Current children cumulated vsize: 637380 KiB
Current children cumulated memory: 611848 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 21452
/proc/meminfo: memFree=20732320/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=639540 memory=614044 CPUtime=2201.98 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1070529 0 0 0 220083 115 0 0 20 0 1 0 95681078 654888960 153511 33554432000 4194304 4933779 140729587952592 140729587950280 4437792 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 159885 153511 614 181 0 153502 0
Current children cumulated CPU time: 2201.98 s
Current children cumulated vsize: 639540 KiB
Current children cumulated memory: 614044 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 21460
/proc/meminfo: memFree=20714844/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=642412 memory=616848 CPUtime=2261.97 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1086668 0 0 0 226081 116 0 0 20 0 1 0 95681078 657829888 154212 33554432000 4194304 4933779 140729587952592 140729587950344 140361556457851 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 160603 154212 614 181 0 154220 0
Current children cumulated CPU time: 2261.97 s
Current children cumulated vsize: 642412 KiB
Current children cumulated memory: 616848 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 21461
/proc/meminfo: memFree=20699012/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=645028 memory=619580 CPUtime=2321.97 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1105574 0 0 0 232078 119 0 0 20 0 1 0 95681078 660508672 154895 33554432000 4194304 4933779 140729587952592 140729587950344 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 161257 154895 614 181 0 154874 0
Current children cumulated CPU time: 2321.97 s
Current children cumulated vsize: 645028 KiB
Current children cumulated memory: 619580 KiB

[startup+2382.3 s]
/proc/loadavg: 2.47 2.16 2.09 3/187 21462
/proc/meminfo: memFree=20680336/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=649216 memory=624752 CPUtime=2381.93 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1117071 0 0 0 238073 120 0 0 20 0 1 0 95681078 664797184 156188 33554432000 4194304 4933779 140729587952592 140729587950344 4437564 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 162304 156188 614 181 0 155921 0
Current children cumulated CPU time: 2381.93 s
Current children cumulated vsize: 649216 KiB
Current children cumulated memory: 624752 KiB

[startup+2442.3 s]
/proc/loadavg: 2.17 2.13 2.09 3/187 21463
/proc/meminfo: memFree=20662468/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=653172 memory=628740 CPUtime=2441.92 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1119249 0 0 0 244072 120 0 0 20 0 1 0 95681078 668848128 157185 33554432000 4194304 4933779 140729587952592 140729587950296 4358201 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 163293 157185 614 181 0 156910 0
Current children cumulated CPU time: 2441.92 s
Current children cumulated vsize: 653172 KiB
Current children cumulated memory: 628740 KiB

[startup+2502.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/187 21464
/proc/meminfo: memFree=20645976/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=657172 memory=632744 CPUtime=2501.92 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1122341 0 0 0 250071 121 0 0 20 0 1 0 95681078 672944128 158186 33554432000 4194304 4933779 140729587952592 140729587950280 4358676 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 164293 158186 614 181 0 157910 0
Current children cumulated CPU time: 2501.92 s
Current children cumulated vsize: 657172 KiB
Current children cumulated memory: 632744 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.05 2.10 2.08 3/187 21464
/proc/meminfo: memFree=20641140/32770624 swapFree=67108796/67108860
[pid=21283] ppid=21280 vsize=657844 memory=633500 CPUtime=2519.62 cores=0,2,4,6
/proc/21283/stat : 21283 (nacre_mini_rele) R 21280 21283 24279 0 -1 4202496 1122730 0 0 0 251841 121 0 0 20 0 1 0 95681078 673632256 158375 33554432000 4194304 4933779 140729587952592 140729587950344 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 39817216 140729587958936 140729587959036 140729587959036 140729587961794 0
/proc/21283/statm: 164461 158375 614 181 0 158078 0
Current children cumulated CPU time: 2519.62 s
Current children cumulated vsize: 657844 KiB
Current children cumulated memory: 633500 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 21283 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2518.42 s, system=1.21492 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.63
CPU user time (s): 2518.42
CPU system time (s): 1.21492
CPU usage (%): 99.985
Max. virtual memory (cumulated for all children) (KiB): 657844
Max. memory (cumulated for all children) (KiB): 633500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2518.42
system time used= 1.21491
maximum resident set size= 633592
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1122771
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 305
involuntary context switches= 3154


# summary of solver processes directly reported to runsolver:
#   pid: 21283
#   total CPU time (s): 2519.63
#   total CPU user time (s): 2518.42
#   total CPU system time (s): 1.21492

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.421 second user time and 17.1823 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 14:32:59
IDJOB=4299050
IDBENCH=141288
IDSOLVER=2764
FILE ID=node138/4299050-1532781179
RUNJOBID= node138-1532773607-19387
PBS_JOBID= 21022455
Free space on /tmp= 53800 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v7-14_mini_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299050-1532781179/watcher-4299050-1532781179 -o /tmp/evaluation-result-4299050-1532781179/solver-4299050-1532781179 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580  nacre_mini_release HOME/instance-4299050-1532781179.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 95922eaa4febb814ca502892c64f55db
RANDOM SEED=1881443064

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21519628 kB
MemAvailable:   31175624 kB
Buffers:          210388 kB
Cached:          9649876 kB
SwapCached:           44 kB
Active:          3292708 kB
Inactive:        7374356 kB
Active(anon):     751308 kB
Inactive(anon):    83488 kB
Active(file):    2541400 kB
Inactive(file):  7290868 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:               792 kB
Writeback:             0 kB
AnonPages:        814096 kB
Mapped:            38556 kB
Shmem:             25164 kB
Slab:             280364 kB
SReclaimable:     252188 kB
SUnreclaim:        28176 kB
KernelStack:        3328 kB
PageTables:         6976 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1104404 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    479232 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53800 MiB
End job on node138 at 2018-07-28 15:14:59