Trace number 4299914

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.54 2520.03

General information on the benchmark

NameMagicSquare/
MagicSquare-08-sum_c18.xml
MD5SUMf34b6b0b58aef27f9d15b3acca2bf726
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.45697
Satisfiable
(Un)Satisfiability was proved
Number of variables64
Number of constraints19
Number of domains1
Minimum domain size64
Maximum domain size64
Distribution of domain sizes[{"size":64,"count":64}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":48},{"degree":4,"count":16}]
Minimum constraint arity8
Maximum constraint arity64
Distribution of constraint arities[{"arity":8,"count":18},{"arity":64,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":18}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.4
2519.51/2520.00	c
2519.51/2520.01	c # time = 2519.51
2519.51/2520.01	c # Dec = 4291464
2519.51/2520.01	c # Propagate Calls = 8355522907
2519.51/2520.01	c # assignAt Calls = 7086913
2519.51/2520.01	c # removeAt Calls = 827934132
2519.51/2520.01	c # Run = 7228
2519.51/2520.01	c # Conflicts = 4115827
2519.51/2520.01	c # Memory used = 1163.53 Mb
2519.51/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9087 MiB free)
  memory of node 1: 16384 MiB (12245 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299914-1532791841/watcher-4299914-1532791841 -o /tmp/evaluation-result-4299914-1532791841/solver-4299914-1532791841 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580 nacre_mini_release HOME/instance-4299914-1532791841.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22862, runsolver pid=22859
Current StackSize limit: 8192 KiB


[startup+0.100197 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21841628/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=29312 memory=6100 CPUtime=0.1 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1710 0 0 0 10 0 0 0 20 0 1 0 96747240 30015488 1525 33554432000 4194304 4933779 140724271529808 140724271526808 4476047 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 7328 1525 612 181 0 945 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29312 KiB
Current children cumulated memory: 6100 KiB

[startup+0.209536 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21839396/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=32020 memory=8708 CPUtime=0.2 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 2342 0 0 0 20 0 0 0 20 0 1 0 96747240 32788480 2177 33554432000 4194304 4933779 140724271529808 140724271526808 4442100 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 8005 2177 612 181 0 1622 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32020 KiB
Current children cumulated memory: 8708 KiB

[startup+0.309253 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21836508/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=34784 memory=11520 CPUtime=0.3 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 3068 0 0 0 30 0 0 0 20 0 1 0 96747240 35618816 2880 33554432000 4194304 4933779 140724271529808 140724271527560 139622761286011 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 8696 2880 612 181 0 2313 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 34784 KiB
Current children cumulated memory: 11520 KiB

[startup+0.700364 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21832440/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=42100 memory=18652 CPUtime=0.69 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 4867 0 0 0 68 1 0 0 20 0 1 0 96747240 43110400 4663 33554432000 4194304 4933779 140724271529808 140724271527560 139622760478624 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 10525 4663 612 181 0 4142 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 42100 KiB
Current children cumulated memory: 18652 KiB

[startup+1.50038 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21824628/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=54236 memory=30700 CPUtime=1.49 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 7932 0 0 0 148 1 0 0 20 0 1 0 96747240 55537664 7675 33554432000 4194304 4933779 140724271529808 140724271527560 139622760430565 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 13559 7675 612 181 0 7176 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54236 KiB
Current children cumulated memory: 30700 KiB

[startup+3.10951 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21801812/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=70080 memory=46592 CPUtime=3.09 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 19677 0 0 0 307 2 0 0 20 0 1 0 96747240 71761920 11648 33554432000 4194304 4933779 140724271529808 140724271527560 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 17520 11648 612 181 0 11137 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 70080 KiB
Current children cumulated memory: 46592 KiB

[startup+6.30036 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21785552/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=85896 memory=62492 CPUtime=6.29 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 35834 0 0 0 625 4 0 0 20 0 1 0 96747240 87957504 15623 33554432000 4194304 4933779 140724271529808 140724271527560 4388544 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 21474 15623 612 181 0 15091 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 85896 KiB
Current children cumulated memory: 62492 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 22863
/proc/meminfo: memFree=21729504/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=141492 memory=117748 CPUtime=12.69 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 67493 0 0 0 1261 8 0 0 20 0 1 0 96747240 144887808 29437 33554432000 4194304 4933779 140724271529808 140724271527512 4336224 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 35373 29437 612 181 0 28990 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 141492 KiB
Current children cumulated memory: 117748 KiB

[startup+25.5004 s]
/proc/loadavg: 2.16 2.05 2.06 3/188 22863
/proc/meminfo: memFree=21660436/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=208696 memory=185060 CPUtime=25.49 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 145139 0 0 0 2534 15 0 0 20 0 1 0 96747240 213704704 46265 33554432000 4194304 4933779 140724271529808 140724271527560 139622761286035 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 52174 46265 612 181 0 45791 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 208696 KiB
Current children cumulated memory: 185060 KiB

[startup+51.1095 s]
/proc/loadavg: 2.44 2.12 2.08 3/188 22863
/proc/meminfo: memFree=21565948/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=303200 memory=279760 CPUtime=51.09 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 225164 0 0 0 5086 23 0 0 20 0 1 0 96747240 310476800 69940 33554432000 4194304 4933779 140724271529808 140724271527496 139622761286011 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 75800 69940 612 181 0 69417 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 303200 KiB
Current children cumulated memory: 279760 KiB

[startup+102.3 s]
/proc/loadavg: 2.25 2.13 2.09 3/188 22864
/proc/meminfo: memFree=21492172/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=374052 memory=349504 CPUtime=102.29 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 319554 0 0 0 10196 33 0 0 20 0 1 0 96747240 383029248 87376 33554432000 4194304 4933779 140724271529808 140724271527320 4388352 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 93513 87376 612 181 0 87130 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 374052 KiB
Current children cumulated memory: 349504 KiB

[startup+162.3 s]
/proc/loadavg: 2.09 2.11 2.08 3/188 22865
/proc/meminfo: memFree=21433788/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=419440 memory=394732 CPUtime=162.29 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 407539 0 0 0 16188 41 0 0 20 0 1 0 96747240 429506560 98683 33554432000 4194304 4933779 140724271529808 140724271527320 4437389 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 104860 98683 612 181 0 98477 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 419440 KiB
Current children cumulated memory: 394732 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.09 2.07 3/188 22866
/proc/meminfo: memFree=21403036/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=450384 memory=425268 CPUtime=222.29 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 504274 0 0 0 22179 50 0 0 20 0 1 0 96747240 461193216 106317 33554432000 4194304 4933779 140724271529808 140724271527496 4437547 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 112596 106317 612 181 0 106213 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 450384 KiB
Current children cumulated memory: 425268 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/187 22867
/proc/meminfo: memFree=21331312/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=517204 memory=492164 CPUtime=282.27 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 623593 0 0 0 28167 60 0 0 20 0 1 0 96747240 529616896 123041 33554432000 4194304 4933779 140724271529808 140724271527496 139622761286011 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 129301 123041 612 181 0 122918 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 517204 KiB
Current children cumulated memory: 492164 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 22868
/proc/meminfo: memFree=21279588/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=565064 memory=540104 CPUtime=342.22 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 730341 0 0 0 34152 70 0 0 20 0 1 0 96747240 578625536 135026 33554432000 4194304 4933779 140724271529808 140724271527512 139622761286011 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 141266 135026 612 181 0 134883 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 565064 KiB
Current children cumulated memory: 540104 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/187 22869
/proc/meminfo: memFree=21239996/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=600136 memory=575072 CPUtime=402.18 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 768873 0 0 0 40142 76 0 0 20 0 1 0 96747240 614539264 143768 33554432000 4194304 4933779 140724271529808 140724271527496 4437564 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 150034 143768 612 181 0 143651 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 600136 KiB
Current children cumulated memory: 575072 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 22870
/proc/meminfo: memFree=21217908/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=603424 memory=578084 CPUtime=462.14 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 826155 0 0 0 46133 81 0 0 20 0 1 0 96747240 617906176 144521 33554432000 4194304 4933779 140724271529808 140724271527496 4475939 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 150856 144521 612 181 0 144473 0
Current children cumulated CPU time: 462.14 s
Current children cumulated vsize: 603424 KiB
Current children cumulated memory: 578084 KiB


################
# More data... #
################

/proc/22862/statm: 259504 253218 612 181 0 253121 0
Current children cumulated CPU time: 1721.83 s
Current children cumulated vsize: 1038016 KiB
Current children cumulated memory: 1012872 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22975
/proc/meminfo: memFree=20532792/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1038468 memory=1013372 CPUtime=1781.83 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1390018 0 0 0 178035 148 0 0 20 0 1 0 96747240 1063391232 253343 33554432000 4194304 4933779 140724271529808 140724271527496 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 259617 253343 612 181 0 253234 0
Current children cumulated CPU time: 1781.83 s
Current children cumulated vsize: 1038468 KiB
Current children cumulated memory: 1013372 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22998
/proc/meminfo: memFree=20500544/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1038664 memory=1013724 CPUtime=1841.83 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1393392 0 0 0 184034 149 0 0 20 0 1 0 96747240 1063591936 253431 33554432000 4194304 4933779 140724271529808 140724271527496 4475748 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 259666 253431 612 181 0 253283 0
Current children cumulated CPU time: 1841.83 s
Current children cumulated vsize: 1038664 KiB
Current children cumulated memory: 1013724 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 22999
/proc/meminfo: memFree=20466596/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1049204 memory=1023972 CPUtime=1901.83 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1399964 0 0 0 190034 149 0 0 20 0 1 0 96747240 1074384896 255993 33554432000 4194304 4933779 140724271529808 140724271527560 4437538 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 262301 255993 612 181 0 255918 0
Current children cumulated CPU time: 1901.83 s
Current children cumulated vsize: 1049204 KiB
Current children cumulated memory: 1023972 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23000
/proc/meminfo: memFree=20432604/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1062116 memory=1036712 CPUtime=1961.83 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1408151 0 0 0 196032 151 0 0 20 0 1 0 96747240 1087606784 259178 33554432000 4194304 4933779 140724271529808 140724271527496 4437389 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 265529 259178 612 181 0 259146 0
Current children cumulated CPU time: 1961.83 s
Current children cumulated vsize: 1062116 KiB
Current children cumulated memory: 1036712 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23001
/proc/meminfo: memFree=20417248/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1063560 memory=1037940 CPUtime=2021.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1414778 0 0 0 202031 151 0 0 20 0 1 0 96747240 1089085440 259485 33554432000 4194304 4933779 140724271529808 140724271527496 4437585 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 265890 259485 612 181 0 259507 0
Current children cumulated CPU time: 2021.82 s
Current children cumulated vsize: 1063560 KiB
Current children cumulated memory: 1037940 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23002
/proc/meminfo: memFree=20396148/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1066464 memory=1040160 CPUtime=2081.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1420357 0 0 0 208030 152 0 0 20 0 1 0 96747240 1092059136 260040 33554432000 4194304 4933779 140724271529808 140724271527320 4437839 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 266616 260040 612 181 0 260233 0
Current children cumulated CPU time: 2081.82 s
Current children cumulated vsize: 1066464 KiB
Current children cumulated memory: 1040160 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23003
/proc/meminfo: memFree=20381412/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1068908 memory=1042116 CPUtime=2141.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1428450 0 0 0 214029 153 0 0 20 0 1 0 96747240 1094561792 260529 33554432000 4194304 4933779 140724271529808 140724271527496 4437456 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 267227 260529 612 181 0 260844 0
Current children cumulated CPU time: 2141.82 s
Current children cumulated vsize: 1068908 KiB
Current children cumulated memory: 1042116 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23004
/proc/meminfo: memFree=20365820/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1069300 memory=1042556 CPUtime=2201.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1435250 0 0 0 220028 154 0 0 20 0 1 0 96747240 1094963200 260639 33554432000 4194304 4933779 140724271529808 140724271527496 4475920 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 267325 260639 612 181 0 260942 0
Current children cumulated CPU time: 2201.82 s
Current children cumulated vsize: 1069300 KiB
Current children cumulated memory: 1042556 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23005
/proc/meminfo: memFree=20339904/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1091228 memory=1064464 CPUtime=2261.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1449741 0 0 0 226025 157 0 0 20 0 1 0 96747240 1117417472 266116 33554432000 4194304 4933779 140724271529808 140724271527560 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 272807 266116 612 181 0 266424 0
Current children cumulated CPU time: 2261.82 s
Current children cumulated vsize: 1091228 KiB
Current children cumulated memory: 1064464 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 23006
/proc/meminfo: memFree=20307664/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1122032 memory=1095108 CPUtime=2321.82 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1473126 0 0 0 232022 160 0 0 20 0 1 0 96747240 1148960768 273777 33554432000 4194304 4933779 140724271529808 140724271527512 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 280508 273777 612 181 0 274125 0
Current children cumulated CPU time: 2321.82 s
Current children cumulated vsize: 1122032 KiB
Current children cumulated memory: 1095108 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 23015
/proc/meminfo: memFree=20248848/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1148548 memory=1121688 CPUtime=2381.81 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1500141 0 0 0 238018 163 0 0 20 0 1 0 96747240 1176113152 280422 33554432000 4194304 4933779 140724271529808 140724271527560 4437445 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 287137 280422 612 181 0 280754 0
Current children cumulated CPU time: 2381.81 s
Current children cumulated vsize: 1148548 KiB
Current children cumulated memory: 1121688 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 23016
/proc/meminfo: memFree=20116004/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1170348 memory=1143528 CPUtime=2441.81 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1532432 0 0 0 244013 168 0 0 20 0 1 0 96747240 1198436352 285882 33554432000 4194304 4933779 140724271529808 140724271527512 4437536 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 292587 285882 612 181 0 286204 0
Current children cumulated CPU time: 2441.81 s
Current children cumulated vsize: 1170348 KiB
Current children cumulated memory: 1143528 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 23017
/proc/meminfo: memFree=20072728/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1188908 memory=1161988 CPUtime=2501.8 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1572770 0 0 0 250008 172 0 0 20 0 1 0 96747240 1217441792 290497 33554432000 4194304 4933779 140724271529808 140724271527496 4388436 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 297227 290497 612 181 0 290844 0
Current children cumulated CPU time: 2501.8 s
Current children cumulated vsize: 1188908 KiB
Current children cumulated memory: 1161988 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 23017
/proc/meminfo: memFree=20060700/32770624 swapFree=67108796/67108860
[pid=22862] ppid=22859 vsize=1190388 memory=1163488 CPUtime=2519.51 cores=0,2,4,6
/proc/22862/stat : 22862 (nacre_mini_rele) R 22859 22862 24279 0 -1 4202496 1578295 0 0 0 251778 173 0 0 20 0 1 0 96747240 1218957312 290872 33554432000 4194304 4933779 140724271529808 140724271527560 4437393 0 0 4096 24578 0 0 0 17 4 0 0 0 0 0 7034520 7039168 31776768 140724271531160 140724271531260 140724271531260 140724271534018 0
/proc/22862/statm: 297597 290872 612 181 0 291214 0
Current children cumulated CPU time: 2519.51 s
Current children cumulated vsize: 1190388 KiB
Current children cumulated memory: 1163488 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 22862 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.79 s, system=1.75294 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.03
CPU time (s): 2519.54
CPU user time (s): 2517.79
CPU system time (s): 1.75294
CPU usage (%): 99.9807
Max. virtual memory (cumulated for all children) (KiB): 1190388
Max. memory (cumulated for all children) (KiB): 1163488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.79
system time used= 1.75293
maximum resident set size= 1163604
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1578337
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 488
involuntary context switches= 1174


# summary of solver processes directly reported to runsolver:
#   pid: 22862
#   total CPU time (s): 2519.54
#   total CPU user time (s): 2517.79
#   total CPU system time (s): 1.75294

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.8314 second user time and 17.3647 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-28 17:30:41
IDJOB=4299914
IDBENCH=141507
IDSOLVER=2764
FILE ID=node138/4299914-1532791841
RUNJOBID= node138-1532773607-19387
PBS_JOBID= 21022455
Free space on /tmp= 53800 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/MagicSquare/MagicSquare-08-sum_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299914-1532791841/watcher-4299914-1532791841 -o /tmp/evaluation-result-4299914-1532791841/solver-4299914-1532791841 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532773607-19387 --watchdog 2580  nacre_mini_release HOME/instance-4299914-1532791841.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f34b6b0b58aef27f9d15b3acca2bf726
RANDOM SEED=1155996520

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        21844916 kB
MemAvailable:   31505348 kB
Buffers:          211364 kB
Cached:          9653176 kB
SwapCached:           44 kB
Active:          2965596 kB
Inactive:        7377112 kB
Active(anon):     422544 kB
Inactive(anon):    83488 kB
Active(file):    2543052 kB
Inactive(file):  7293624 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:               988 kB
Writeback:             0 kB
AnonPages:        484752 kB
Mapped:            39008 kB
Shmem:             25164 kB
Slab:             280276 kB
SReclaimable:     252216 kB
SUnreclaim:        28060 kB
KernelStack:        3376 kB
PageTables:         5768 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     770800 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    415744 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53800 MiB
End job on node138 at 2018-07-28 18:12:41