Trace number 4299970

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.75 2520.01

General information on the benchmark

NameMagicSquare/
MagicSquare-15-sum_c18.xml
MD5SUMd64daa3cf1f3eb705836a312580fe3db
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables225
Number of constraints33
Number of domains1
Minimum domain size225
Maximum domain size225
Distribution of domain sizes[{"size":225,"count":225}]
Minimum variable degree3
Maximum variable degree5
Distribution of variable degrees[{"degree":3,"count":196},{"degree":4,"count":28},{"degree":5,"count":1}]
Minimum constraint arity15
Maximum constraint arity225
Distribution of constraint arities[{"arity":15,"count":32},{"arity":225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":32}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.74/2520.01	c
2519.74/2520.01	c # time = 2519.74
2519.74/2520.01	c # Dec = 1704464
2519.74/2520.01	c # Propagate Calls = 25125221984
2519.74/2520.01	c # assignAt Calls = 3218001
2519.74/2520.01	c # removeAt Calls = 660513234
2519.74/2520.01	c # Run = 3195
2519.74/2520.01	c # Conflicts = 1674110
2519.74/2520.01	c # Memory used = 880.836 Mb
2519.74/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9594 MiB free)
  memory of node 1: 16384 MiB (9863 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299970-1532792843/watcher-4299970-1532792843 -o /tmp/evaluation-result-4299970-1532792843/solver-4299970-1532792843 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4299970-1532792843.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29654, runsolver pid=29651

[startup+0.100117 s]*
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19912516/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=40180 memory=16092 CPUtime=0.1 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 4881 0 0 0 10 0 0 0 20 0 1 0 96847492 41144320 4023 33554432000 4194304 4933779 140724671167744 140724671164744 140701666773427 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 10045 4023 612 181 0 3662 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 40180 KiB
Current children cumulated memory: 16092 KiB

[startup+0.209701 s]*
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19911120/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=41272 memory=17148 CPUtime=0.21 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 5171 0 0 0 21 0 0 0 20 0 1 0 96847492 42262528 4287 33554432000 4194304 4933779 140724671167744 140724671164744 4388381 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 10318 4287 612 181 0 3935 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 41272 KiB
Current children cumulated memory: 17148 KiB

[startup+0.309489 s]*
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19910004/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=42500 memory=18468 CPUtime=0.3 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 5480 0 0 0 30 0 0 0 20 0 1 0 96847492 43520000 4617 33554432000 4194304 4933779 140724671167744 140724671164744 4475561 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 10625 4617 612 181 0 4242 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 42500 KiB
Current children cumulated memory: 18468 KiB

[startup+0.700307 s]
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19907212/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=47036 memory=22956 CPUtime=0.69 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 6597 0 0 0 68 1 0 0 20 0 1 0 96847492 48164864 5739 33554432000 4194304 4933779 140724671167744 140724671165496 4388388 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 11759 5739 612 181 0 5376 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 47036 KiB
Current children cumulated memory: 22956 KiB

[startup+1.50033 s]
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19900604/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=56632 memory=32460 CPUtime=1.49 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 8985 0 0 0 147 2 0 0 20 0 1 0 96847492 57991168 8115 33554432000 4194304 4933779 140724671167744 140724671165496 4475748 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 14158 8115 612 181 0 7775 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 56632 KiB
Current children cumulated memory: 32460 KiB

[startup+3.10946 s]
/proc/loadavg: 2.22 2.06 2.06 3/187 29655
/proc/meminfo: memFree=19876796/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=75856 memory=51660 CPUtime=3.1 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 18963 0 0 0 307 3 0 0 20 0 1 0 96847492 77676544 12915 33554432000 4194304 4933779 140724671167744 140724671165496 4472608 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 18964 12915 612 181 0 12581 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75856 KiB
Current children cumulated memory: 51660 KiB

[startup+6.30042 s]
/proc/loadavg: 2.29 2.08 2.07 3/187 29655
/proc/meminfo: memFree=19841460/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=112816 memory=88476 CPUtime=6.29 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 36276 0 0 0 623 6 0 0 20 0 1 0 96847492 115523584 22119 33554432000 4194304 4933779 140724671167744 140724671165496 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 28204 22119 612 181 0 21821 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 112816 KiB
Current children cumulated memory: 88476 KiB

[startup+12.7004 s]
/proc/loadavg: 2.26 2.08 2.06 3/187 29655
/proc/meminfo: memFree=19781428/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=173288 memory=149024 CPUtime=12.69 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 65411 0 0 0 1258 11 0 0 20 0 1 0 96847492 177446912 37256 33554432000 4194304 4933779 140724671167744 140724671165496 4388752 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 43322 37256 612 181 0 36939 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 173288 KiB
Current children cumulated memory: 149024 KiB

[startup+25.5004 s]
/proc/loadavg: 2.43 2.12 2.08 3/187 29655
/proc/meminfo: memFree=19732060/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=215108 memory=190780 CPUtime=25.49 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 129000 0 0 0 2532 17 0 0 20 0 1 0 96847492 220270592 47695 33554432000 4194304 4933779 140724671167744 140724671165448 4475748 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 53777 47695 612 181 0 47394 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 215108 KiB
Current children cumulated memory: 190780 KiB

[startup+51.1097 s]
/proc/loadavg: 2.40 2.14 2.09 3/187 29655
/proc/meminfo: memFree=19675408/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=263108 memory=238972 CPUtime=51.09 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 198079 0 0 0 5086 23 0 0 20 0 1 0 96847492 269422592 59743 33554432000 4194304 4933779 140724671167744 140724671165496 4475923 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 65777 59743 612 181 0 59394 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 263108 KiB
Current children cumulated memory: 238972 KiB

[startup+102.3 s]
/proc/loadavg: 2.17 2.12 2.08 3/187 29656
/proc/meminfo: memFree=19610968/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=309716 memory=284688 CPUtime=102.28 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 278297 0 0 0 10196 32 0 0 20 0 1 0 96847492 317149184 71172 33554432000 4194304 4933779 140724671167744 140724671165496 4388663 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 77429 71172 612 181 0 71046 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 309716 KiB
Current children cumulated memory: 284688 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.10 2.08 3/188 29665
/proc/meminfo: memFree=19555400/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=349884 memory=325012 CPUtime=162.28 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 347691 0 0 0 16189 39 0 0 20 0 1 0 96847492 358281216 81253 33554432000 4194304 4933779 140724671167744 140724671165496 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 87471 81253 612 181 0 81088 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 349884 KiB
Current children cumulated memory: 325012 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.08 2.07 3/188 29666
/proc/meminfo: memFree=19514576/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=378164 memory=353348 CPUtime=222.26 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 370860 0 0 0 22183 43 0 0 20 0 1 0 96847492 387239936 88337 33554432000 4194304 4933779 140724671167744 140724671165496 4388395 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 94541 88337 612 181 0 88158 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 378164 KiB
Current children cumulated memory: 353348 KiB

[startup+282.3 s]
/proc/loadavg: 2.09 2.10 2.08 3/188 29667
/proc/meminfo: memFree=19371632/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=411324 memory=386500 CPUtime=282.23 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 443708 0 0 0 28171 52 0 0 20 0 1 0 96847492 421195776 96625 33554432000 4194304 4933779 140724671167744 140724671165496 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 102831 96625 612 181 0 96448 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 411324 KiB
Current children cumulated memory: 386500 KiB

[startup+342.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/188 29668
/proc/meminfo: memFree=19249452/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=436980 memory=412448 CPUtime=342.2 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 496389 0 0 0 34163 57 0 0 20 0 1 0 96847492 447467520 103112 33554432000 4194304 4933779 140724671167744 140724671165496 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 109245 103112 612 181 0 102862 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 436980 KiB
Current children cumulated memory: 412448 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/188 29669
/proc/meminfo: memFree=19185996/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=450724 memory=426292 CPUtime=402.18 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 526039 0 0 0 40156 62 0 0 20 0 1 0 96847492 461541376 106573 33554432000 4194304 4933779 140724671167744 140724671165496 4393121 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 112681 106573 612 181 0 106298 0
Current children cumulated CPU time: 402.18 s
Current children cumulated vsize: 450724 KiB
Current children cumulated memory: 426292 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 29671
/proc/meminfo: memFree=19135396/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=466816 memory=442980 CPUtime=462.16 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 534923 0 0 0 46152 64 0 0 20 0 1 0 96847492 478019584 110745 33554432000 4194304 4933779 140724671167744 140724671165448 4388738 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 116704 110745 612 181 0 110321 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 466816 KiB
Current children cumulated memory: 442980 KiB


################
# More data... #
################

/proc/29654/statm: 198340 191912 612 181 0 191957 0
Current children cumulated CPU time: 1722.07 s
Current children cumulated vsize: 793360 KiB
Current children cumulated memory: 767648 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/187 29733
/proc/meminfo: memFree=18409404/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=793940 memory=768144 CPUtime=1782.08 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1103721 0 0 0 178061 147 0 0 20 0 1 0 96847492 812994560 192036 33554432000 4194304 4933779 140724671167744 140724671165432 140701666661756 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 198485 192036 612 181 0 192102 0
Current children cumulated CPU time: 1782.08 s
Current children cumulated vsize: 793940 KiB
Current children cumulated memory: 768144 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 29734
/proc/meminfo: memFree=18401004/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=800004 memory=774236 CPUtime=1842.07 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1133015 0 0 0 184056 151 0 0 20 0 1 0 96847492 819204096 193559 33554432000 4194304 4933779 140724671167744 140724671165256 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 200001 193559 612 181 0 193618 0
Current children cumulated CPU time: 1842.07 s
Current children cumulated vsize: 800004 KiB
Current children cumulated memory: 774236 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 29735
/proc/meminfo: memFree=18397308/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=802532 memory=776660 CPUtime=1902.07 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1162679 0 0 0 190053 154 0 0 20 0 1 0 96847492 821792768 194165 33554432000 4194304 4933779 140724671167744 140724671165432 4393136 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 200633 194165 612 181 0 194250 0
Current children cumulated CPU time: 1902.07 s
Current children cumulated vsize: 802532 KiB
Current children cumulated memory: 776660 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 29744
/proc/meminfo: memFree=18387132/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=810552 memory=784716 CPUtime=1962.07 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1195390 0 0 0 196048 159 0 0 20 0 1 0 96847492 830005248 196179 33554432000 4194304 4933779 140724671167744 140724671165496 4388381 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 202638 196179 612 181 0 196255 0
Current children cumulated CPU time: 1962.07 s
Current children cumulated vsize: 810552 KiB
Current children cumulated memory: 784716 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 29745
/proc/meminfo: memFree=18369844/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=827520 memory=801528 CPUtime=2022.06 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1233254 0 0 0 202043 163 0 0 20 0 1 0 96847492 847380480 200382 33554432000 4194304 4933779 140724671167744 140724671165496 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 206880 200382 612 181 0 200497 0
Current children cumulated CPU time: 2022.06 s
Current children cumulated vsize: 827520 KiB
Current children cumulated memory: 801528 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29746
/proc/meminfo: memFree=18359816/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=836500 memory=810396 CPUtime=2082.06 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1260511 0 0 0 208040 166 0 0 20 0 1 0 96847492 856576000 202599 33554432000 4194304 4933779 140724671167744 140724671165432 4388377 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 209125 202599 612 181 0 202742 0
Current children cumulated CPU time: 2082.06 s
Current children cumulated vsize: 836500 KiB
Current children cumulated memory: 810396 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29747
/proc/meminfo: memFree=18356348/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=838140 memory=812152 CPUtime=2142.07 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1297934 0 0 0 214035 172 0 0 20 0 1 0 96847492 858255360 203038 33554432000 4194304 4933779 140724671167744 140724671165496 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 209535 203038 612 181 0 203152 0
Current children cumulated CPU time: 2142.07 s
Current children cumulated vsize: 838140 KiB
Current children cumulated memory: 812152 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 29809
/proc/meminfo: memFree=19264276/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=847220 memory=821168 CPUtime=2202.07 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1341022 0 0 0 220029 178 0 0 20 0 1 0 96847492 867553280 205292 33554432000 4194304 4933779 140724671167744 140724671165496 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 211805 205292 612 181 0 205422 0
Current children cumulated CPU time: 2202.07 s
Current children cumulated vsize: 847220 KiB
Current children cumulated memory: 821168 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 29811
/proc/meminfo: memFree=19227336/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=854220 memory=828228 CPUtime=2262.06 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1378580 0 0 0 226024 182 0 0 20 0 1 0 96847492 874721280 207057 33554432000 4194304 4933779 140724671167744 140724671165448 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 213555 207057 612 181 0 207172 0
Current children cumulated CPU time: 2262.06 s
Current children cumulated vsize: 854220 KiB
Current children cumulated memory: 828228 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29812
/proc/meminfo: memFree=18600776/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=860920 memory=834788 CPUtime=2322.06 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1416518 0 0 0 232018 188 0 0 20 0 1 0 96847492 881582080 208697 33554432000 4194304 4933779 140724671167744 140724671165448 4437538 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 215230 208697 612 181 0 208847 0
Current children cumulated CPU time: 2322.06 s
Current children cumulated vsize: 860920 KiB
Current children cumulated memory: 834788 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29813
/proc/meminfo: memFree=18581916/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=878160 memory=851928 CPUtime=2382.06 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1463456 0 0 0 238011 195 0 0 20 0 1 0 96847492 899235840 212982 33554432000 4194304 4933779 140724671167744 140724671165496 140701672119150 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 219540 212982 612 181 0 213157 0
Current children cumulated CPU time: 2382.06 s
Current children cumulated vsize: 878160 KiB
Current children cumulated memory: 851928 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29815
/proc/meminfo: memFree=18500528/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=897032 memory=871660 CPUtime=2442.05 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1507610 0 0 0 244004 201 0 0 20 0 1 0 96847492 918560768 217915 33554432000 4194304 4933779 140724671167744 140724671165496 140701672119150 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 224258 217915 612 181 0 217875 0
Current children cumulated CPU time: 2442.05 s
Current children cumulated vsize: 897032 KiB
Current children cumulated memory: 871660 KiB

[startup+2502.3 s]
/proc/loadavg: 2.29 2.08 2.07 3/187 29816
/proc/meminfo: memFree=18442528/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=904836 memory=880688 CPUtime=2502.03 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1530129 0 0 0 249999 204 0 0 20 0 1 0 96847492 926552064 220172 33554432000 4194304 4933779 140724671167744 140724671165432 4393121 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 226209 220172 612 181 0 219826 0
Current children cumulated CPU time: 2502.03 s
Current children cumulated vsize: 904836 KiB
Current children cumulated memory: 880688 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.49 2.14 2.08 3/187 29817
/proc/meminfo: memFree=18430760/32770624 swapFree=67108860/67108860
[pid=29654] ppid=29651 vsize=904836 memory=880836 CPUtime=2519.74 cores=0,2,4,6
/proc/29654/stat : 29654 (nacre_mini_rele) R 29651 29654 26996 0 -1 4202496 1533414 0 0 0 251769 205 0 0 20 0 1 0 96847492 926552064 220209 33554432000 4194304 4933779 140724671167744 140724671165432 4388736 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 17575936 140724671173784 140724671173884 140724671173884 140724671176642 0
/proc/29654/statm: 226209 220209 612 181 0 219826 0
Current children cumulated CPU time: 2519.74 s
Current children cumulated vsize: 904836 KiB
Current children cumulated memory: 880836 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 29654 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.69 s, system=2.05493 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.75
CPU user time (s): 2517.69
CPU system time (s): 2.05493
CPU usage (%): 99.9894
Max. virtual memory (cumulated for all children) (KiB): 904836
Max. memory (cumulated for all children) (KiB): 880836

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.69
system time used= 2.05493
maximum resident set size= 880892
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1533462
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 301
involuntary context switches= 3159


# summary of solver processes directly reported to runsolver:
#   pid: 29654
#   total CPU time (s): 2519.75
#   total CPU user time (s): 2517.69
#   total CPU system time (s): 2.05493

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.43283 second user time and 19.4519 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 17:47:23
IDJOB=4299970
IDBENCH=141514
IDSOLVER=2764
FILE ID=node103/4299970-1532792843
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56536 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/MagicSquare/MagicSquare-15-sum_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299970-1532792843/watcher-4299970-1532792843 -o /tmp/evaluation-result-4299970-1532792843/solver-4299970-1532792843 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4299970-1532792843.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d64daa3cf1f3eb705836a312580fe3db
RANDOM SEED=754523815

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        19926388 kB
MemAvailable:   31628256 kB
Buffers:          302920 kB
Cached:         11582628 kB
SwapCached:            0 kB
Active:          4218228 kB
Inactive:        8023876 kB
Active(anon):     359248 kB
Inactive(anon):    25184 kB
Active(file):    3858980 kB
Inactive(file):  7998692 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              1000 kB
Writeback:             0 kB
AnonPages:        380204 kB
Mapped:            44468 kB
Shmem:             25228 kB
Slab:             300868 kB
SReclaimable:     272656 kB
SUnreclaim:        28212 kB
KernelStack:        3568 kB
PageTables:         6092 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     657140 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56536 MiB
End job on node103 at 2018-07-28 18:29:23