Trace number 4299058

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.79 2520.01

General information on the benchmark

NameQuasigroups_mini/
QuasiGroup-v7-10_mini_c18.xml
MD5SUMba10c53a53c6ac87d986792da34ee429
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.783118
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints210
Number of domains1
Minimum domain size10
Maximum domain size10
Distribution of domain sizes[{"size":10,"count":190}]
Minimum variable degree0
Maximum variable degree22
Distribution of variable degrees[{"degree":0,"count":10},{"degree":2,"count":90},{"degree":21,"count":10},{"degree":22,"count":90}]
Minimum constraint arity1
Maximum constraint arity12
Distribution of constraint arities[{"arity":1,"count":10},{"arity":10,"count":20},{"arity":12,"count":180}]
Number of extensional constraints0
Number of intensional constraints10
Distribution of constraint types[{"type":"intension","count":10},{"type":"allDifferent","count":20},{"type":"element","count":180}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.00	c NACRE 1.0.4
2519.77/2520.00	c
2519.77/2520.01	c # time = 2519.77
2519.77/2520.01	c # Dec = 4503223
2519.77/2520.01	c # Propagate Calls = 2644133237
2519.77/2520.01	c # assignAt Calls = 8059859
2519.77/2520.01	c # removeAt Calls = 528575718
2519.77/2520.01	c # Run = 7895
2519.77/2520.01	c # Conflicts = 4401978
2519.77/2520.01	c # Memory used = 238.58 Mb
2519.77/2520.01	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10440 MiB free)
  memory of node 1: 16384 MiB (12647 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299058-1532781617/watcher-4299058-1532781617 -o /tmp/evaluation-result-4299058-1532781617/solver-4299058-1532781617 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1532774055-27430 --watchdog 2580 nacre_mini_release HOME/instance-4299058-1532781617.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28046, runsolver pid=28043

[startup+0.100128 s]*
/proc/loadavg: 2.00 2.01 1.99 2/189 28063
/proc/meminfo: memFree=23880872/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=27512 memory=4140 CPUtime=0.1 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 1247 0 0 0 10 0 0 0 20 0 1 0 95724863 28172288 1035 33554432000 4194304 4933779 140731182340064 140731182338216 139635250027493 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 6878 1035 614 181 0 495 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27512 KiB
Current children cumulated memory: 4140 KiB

[startup+0.209905 s]*
/proc/loadavg: 2.00 2.01 1.99 3/202 28076
/proc/meminfo: memFree=23862620/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=28308 memory=5056 CPUtime=0.21 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 1439 0 0 0 21 0 0 0 20 0 1 0 95724863 28987392 1264 33554432000 4194304 4933779 140731182340064 140731182338216 139635250025567 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 7077 1264 614 181 0 694 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 28308 KiB
Current children cumulated memory: 5056 KiB

[startup+0.309094 s]*
/proc/loadavg: 2.00 2.01 1.99 2/186 28076
/proc/meminfo: memFree=23880920/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=28960 memory=5576 CPUtime=0.31 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 1608 0 0 0 31 0 0 0 20 0 1 0 95724863 29655040 1394 33554432000 4194304 4933779 140731182340064 140731182338216 4358376 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 7240 1394 614 181 0 857 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 28960 KiB
Current children cumulated memory: 5576 KiB

[startup+0.700183 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28108
/proc/meminfo: memFree=23876432/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=31468 memory=8084 CPUtime=0.69 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 2244 0 0 0 69 0 0 0 20 0 1 0 95724863 32223232 2021 33554432000 4194304 4933779 140731182340064 140731182338216 139635250027493 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 7867 2021 614 181 0 1484 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 31468 KiB
Current children cumulated memory: 8084 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.01 1.99 4/202 28137
/proc/meminfo: memFree=23847168/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=36808 memory=13368 CPUtime=1.48 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 3564 0 0 0 148 0 0 0 20 0 1 0 95724863 37691392 3342 33554432000 4194304 4933779 140731182340064 140731182337832 139635250027493 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 9202 3342 614 181 0 2819 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 36808 KiB
Current children cumulated memory: 13368 KiB

[startup+3.10937 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28172
/proc/meminfo: memFree=23852528/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=44084 memory=20732 CPUtime=3.1 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 8840 0 0 0 309 1 0 0 20 0 1 0 95724863 45142016 5183 33554432000 4194304 4933779 140731182340064 140731182337832 4363972 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 11021 5183 614 181 0 4638 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 44084 KiB
Current children cumulated memory: 20732 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28172
/proc/meminfo: memFree=23828960/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=51236 memory=27348 CPUtime=6.28 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 15732 0 0 0 627 1 0 0 20 0 1 0 95724863 52465664 6837 33554432000 4194304 4933779 140731182340064 140731182337832 139635250027493 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 12809 6837 614 181 0 6426 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 51236 KiB
Current children cumulated memory: 27348 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28172
/proc/meminfo: memFree=23806100/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=59372 memory=35720 CPUtime=12.68 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 20390 0 0 0 1266 2 0 0 20 0 1 0 95724863 60796928 8930 33554432000 4194304 4933779 140731182340064 140731182337576 4437796 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 14843 8930 614 181 0 8460 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 59372 KiB
Current children cumulated memory: 35720 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28172
/proc/meminfo: memFree=23777128/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=70296 memory=46752 CPUtime=25.47 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 29991 0 0 0 2544 3 0 0 20 0 1 0 95724863 71983104 11688 33554432000 4194304 4933779 140731182340064 140731182337816 4358022 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 17574 11688 614 181 0 11191 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 70296 KiB
Current children cumulated memory: 46752 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28172
/proc/meminfo: memFree=23736380/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=87368 memory=62792 CPUtime=51.07 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 37564 0 0 0 5103 4 0 0 20 0 1 0 95724863 89464832 15698 33554432000 4194304 4933779 140731182340064 140731182337752 4388388 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 21842 15698 614 181 0 15459 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 87368 KiB
Current children cumulated memory: 62792 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28173
/proc/meminfo: memFree=23688484/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=104404 memory=79992 CPUtime=102.25 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 48374 0 0 0 10219 6 0 0 20 0 1 0 95724863 106909696 19998 33554432000 4194304 4933779 140731182340064 140731182337752 139635256322445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 26101 19998 614 181 0 19718 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 104404 KiB
Current children cumulated memory: 79992 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/189 28174
/proc/meminfo: memFree=23651532/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=117192 memory=92920 CPUtime=162.24 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 61378 0 0 0 16216 8 0 0 20 0 1 0 95724863 120004608 23230 33554432000 4194304 4933779 140731182340064 140731182337576 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 29298 23230 614 181 0 22915 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 117192 KiB
Current children cumulated memory: 92920 KiB

[startup+222.3 s]
/proc/loadavg: 1.96 2.00 1.98 3/189 28175
/proc/meminfo: memFree=23624664/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=126144 memory=102336 CPUtime=222.22 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 76579 0 0 0 22212 10 0 0 20 0 1 0 95724863 129171456 25584 33554432000 4194304 4933779 140731182340064 140731182337816 4358725 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 31536 25584 614 181 0 25153 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 126144 KiB
Current children cumulated memory: 102336 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 2.00 1.98 3/189 28176
/proc/meminfo: memFree=23599988/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=135356 memory=111644 CPUtime=282.21 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 80770 0 0 0 28210 11 0 0 20 0 1 0 95724863 138604544 27911 33554432000 4194304 4933779 140731182340064 140731182337816 4475951 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 33839 27911 614 181 0 27456 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 135356 KiB
Current children cumulated memory: 111644 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.00 1.98 3/187 28177
/proc/meminfo: memFree=23578936/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=144104 memory=120372 CPUtime=342.21 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 87170 0 0 0 34208 13 0 0 20 0 1 0 95724863 147562496 30093 33554432000 4194304 4933779 140731182340064 140731182337752 4358077 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 36026 30093 614 181 0 29643 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 144104 KiB
Current children cumulated memory: 120372 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/187 28178
/proc/meminfo: memFree=23559700/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=150876 memory=127076 CPUtime=402.21 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 95141 0 0 0 40207 14 0 0 20 0 1 0 95724863 154497024 31769 33554432000 4194304 4933779 140731182340064 140731182337768 4437538 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 37719 31769 614 181 0 31336 0
Current children cumulated CPU time: 402.21 s
Current children cumulated vsize: 150876 KiB
Current children cumulated memory: 127076 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/187 28179
/proc/meminfo: memFree=23544736/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=157116 memory=133552 CPUtime=462.19 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 104580 0 0 0 46204 15 0 0 20 0 1 0 95724863 160886784 33388 33554432000 4194304 4933779 140731182340064 140731182337752 4358077 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 39279 33388 614 181 0 32896 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 157116 KiB
Current children cumulated memory: 133552 KiB


################
# More data... #
################

/proc/28046/statm: 58832 52749 614 181 0 52449 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 235328 KiB
Current children cumulated memory: 210996 KiB

[startup+1782.3 s]
/proc/loadavg: 2.04 2.08 2.05 3/187 28486
/proc/meminfo: memFree=23369888/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=237784 memory=213424 CPUtime=1782.11 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 206313 0 0 0 178180 31 0 0 20 0 1 0 95724863 243490816 53356 33554432000 4194304 4933779 140731182340064 140731182337768 4437389 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 59446 53356 614 181 0 53063 0
Current children cumulated CPU time: 1782.11 s
Current children cumulated vsize: 237784 KiB
Current children cumulated memory: 213424 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.07 2.05 3/187 28494
/proc/meminfo: memFree=23360912/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=240028 memory=215752 CPUtime=1842.11 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 210118 0 0 0 184180 31 0 0 20 0 1 0 95724863 245788672 53938 33554432000 4194304 4933779 140731182340064 140731182337752 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 60007 53938 614 181 0 53624 0
Current children cumulated CPU time: 1842.11 s
Current children cumulated vsize: 240028 KiB
Current children cumulated memory: 215752 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/187 28495
/proc/meminfo: memFree=23353536/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=242008 memory=217800 CPUtime=1902.11 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 214333 0 0 0 190179 32 0 0 20 0 1 0 95724863 247816192 54450 33554432000 4194304 4933779 140731182340064 140731182337752 4359648 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 60502 54450 614 181 0 54119 0
Current children cumulated CPU time: 1902.11 s
Current children cumulated vsize: 242008 KiB
Current children cumulated memory: 217800 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 28496
/proc/meminfo: memFree=23343600/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=244228 memory=219960 CPUtime=1962.11 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 219092 0 0 0 196179 32 0 0 20 0 1 0 95724863 250089472 54990 33554432000 4194304 4933779 140731182340064 140731182337752 4358228 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 61057 54990 614 181 0 54674 0
Current children cumulated CPU time: 1962.11 s
Current children cumulated vsize: 244228 KiB
Current children cumulated memory: 219960 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 28497
/proc/meminfo: memFree=23335328/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=246272 memory=222100 CPUtime=2022.1 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 224319 0 0 0 202177 33 0 0 20 0 1 0 95724863 252182528 55525 33554432000 4194304 4933779 140731182340064 140731182337752 4437824 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 61568 55525 614 181 0 55185 0
Current children cumulated CPU time: 2022.1 s
Current children cumulated vsize: 246272 KiB
Current children cumulated memory: 222100 KiB

[startup+2082.3 s]
/proc/loadavg: 2.29 2.10 2.07 3/187 28498
/proc/meminfo: memFree=23327584/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=248396 memory=224224 CPUtime=2082.09 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 226632 0 0 0 208176 33 0 0 20 0 1 0 95724863 254357504 56056 33554432000 4194304 4933779 140731182340064 140731182337752 4358315 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 62099 56056 614 181 0 55716 0
Current children cumulated CPU time: 2082.09 s
Current children cumulated vsize: 248396 KiB
Current children cumulated memory: 224224 KiB

[startup+2142.3 s]
/proc/loadavg: 2.29 2.15 2.09 3/187 28499
/proc/meminfo: memFree=23320640/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=250008 memory=225916 CPUtime=2142.09 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 229347 0 0 0 214176 33 0 0 20 0 1 0 95724863 256008192 56479 33554432000 4194304 4933779 140731182340064 140731182337816 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 62502 56479 614 181 0 56119 0
Current children cumulated CPU time: 2142.09 s
Current children cumulated vsize: 250008 KiB
Current children cumulated memory: 225916 KiB

[startup+2202.3 s]
/proc/loadavg: 2.11 2.12 2.08 3/187 28500
/proc/meminfo: memFree=23313040/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=251912 memory=227848 CPUtime=2202.09 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 232618 0 0 0 220175 34 0 0 20 0 1 0 95724863 257957888 56962 33554432000 4194304 4933779 140731182340064 140731182337768 4437547 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 62978 56962 614 181 0 56595 0
Current children cumulated CPU time: 2202.09 s
Current children cumulated vsize: 251912 KiB
Current children cumulated memory: 227848 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.10 2.07 3/187 28501
/proc/meminfo: memFree=23306024/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=254008 memory=229852 CPUtime=2262.08 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 236482 0 0 0 226174 34 0 0 20 0 1 0 95724863 260104192 57463 33554432000 4194304 4933779 140731182340064 140731182337768 4437824 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 63502 57463 614 181 0 57119 0
Current children cumulated CPU time: 2262.08 s
Current children cumulated vsize: 254008 KiB
Current children cumulated memory: 229852 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.08 2.07 3/187 28502
/proc/meminfo: memFree=23297716/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=255776 memory=231724 CPUtime=2322.08 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 240675 0 0 0 232173 35 0 0 20 0 1 0 95724863 261914624 57931 33554432000 4194304 4933779 140731182340064 140731182337752 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 63944 57931 614 181 0 57561 0
Current children cumulated CPU time: 2322.08 s
Current children cumulated vsize: 255776 KiB
Current children cumulated memory: 231724 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/187 28503
/proc/meminfo: memFree=23290300/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=258244 memory=234188 CPUtime=2382.09 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 245353 0 0 0 238173 36 0 0 20 0 1 0 95724863 264441856 58547 33554432000 4194304 4933779 140731182340064 140731182337752 4358081 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 64561 58547 614 181 0 58178 0
Current children cumulated CPU time: 2382.09 s
Current children cumulated vsize: 258244 KiB
Current children cumulated memory: 234188 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 28511
/proc/meminfo: memFree=23283588/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=259360 memory=235484 CPUtime=2442.07 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 250318 0 0 0 244171 36 0 0 20 0 1 0 95724863 265584640 58871 33554432000 4194304 4933779 140731182340064 140731182337752 4364088 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 64840 58871 614 181 0 58457 0
Current children cumulated CPU time: 2442.07 s
Current children cumulated vsize: 259360 KiB
Current children cumulated memory: 235484 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 28512
/proc/meminfo: memFree=23276248/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=261448 memory=237664 CPUtime=2502.07 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 252538 0 0 0 250171 36 0 0 20 0 1 0 95724863 267722752 59416 33554432000 4194304 4933779 140731182340064 140731182337768 4359623 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 65362 59416 614 181 0 58979 0
Current children cumulated CPU time: 2502.07 s
Current children cumulated vsize: 261448 KiB
Current children cumulated memory: 237664 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.04 2.05 3/187 28512
/proc/meminfo: memFree=23273772/32770624 swapFree=67108860/67108860
[pid=28046] ppid=28043 vsize=262444 memory=238580 CPUtime=2519.77 cores=1,3,5,7
/proc/28046/stat : 28046 (nacre_mini_rele) R 28043 28046 27398 0 -1 4202496 254751 0 0 0 251941 36 0 0 20 0 1 0 95724863 268742656 59645 33554432000 4194304 4933779 140731182340064 140731182337752 4437393 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 29626368 140731182347416 140731182347516 140731182347516 140731182350274 0
/proc/28046/statm: 65611 59645 614 181 0 59228 0
Current children cumulated CPU time: 2519.77 s
Current children cumulated vsize: 262444 KiB
Current children cumulated memory: 238580 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 28046 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.42 s, system=0.370978 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.79
CPU user time (s): 2519.42
CPU system time (s): 0.370978
CPU usage (%): 99.9913
Max. virtual memory (cumulated for all children) (KiB): 262444
Max. memory (cumulated for all children) (KiB): 238580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.42
system time used= 0.370978
maximum resident set size= 238656
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 254797
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 119
involuntary context switches= 2069


# summary of solver processes directly reported to runsolver:
#   pid: 28046
#   total CPU time (s): 2519.79
#   total CPU user time (s): 2519.42
#   total CPU system time (s): 0.370978

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.62438 second user time and 18.2455 second system time

The end

Launcher Data

Begin job on node139 at 2018-07-28 14:40:17
IDJOB=4299058
IDBENCH=141289
IDSOLVER=2764
FILE ID=node139/4299058-1532781617
RUNJOBID= node139-1532774055-27430
PBS_JOBID= 21022456
Free space on /tmp= 38716 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Quasigroups_mini/QuasiGroup-v7-10_mini_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299058-1532781617/watcher-4299058-1532781617 -o /tmp/evaluation-result-4299058-1532781617/solver-4299058-1532781617 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1532774055-27430 --watchdog 2580  nacre_mini_release HOME/instance-4299058-1532781617.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ba10c53a53c6ac87d986792da34ee429
RANDOM SEED=1587955465

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23393008 kB
MemAvailable:   31440052 kB
Buffers:          236260 kB
Cached:          7909528 kB
SwapCached:            0 kB
Active:          3555948 kB
Inactive:        5126100 kB
Active(anon):     489984 kB
Inactive(anon):    73552 kB
Active(file):    3065964 kB
Inactive(file):  5052548 kB
Unevictable:        7312 kB
Mlocked:            7312 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:               816 kB
Writeback:             0 kB
AnonPages:        672000 kB
Mapped:            43608 kB
Shmem:             25228 kB
Slab:             385492 kB
SReclaimable:     356992 kB
SUnreclaim:        28500 kB
KernelStack:        3392 kB
PageTables:        11180 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3961108 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    151552 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 38716 MiB
End job on node139 at 2018-07-28 15:22:17