Trace number 4299994

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.73 2520.02

General information on the benchmark

NameMagicSquare/
MagicSquare-13-sum_c18.xml
MD5SUM507ff1916128830fd6a67d5c849b681a
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables169
Number of constraints29
Number of domains1
Minimum domain size169
Maximum domain size169
Distribution of domain sizes[{"size":169,"count":169}]
Minimum variable degree3
Maximum variable degree5
Distribution of variable degrees[{"degree":3,"count":144},{"degree":4,"count":24},{"degree":5,"count":1}]
Minimum constraint arity13
Maximum constraint arity169
Distribution of constraint arities[{"arity":13,"count":28},{"arity":169,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":28}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.71/2520.01	c
2519.71/2520.01	c # time = 2519.71
2519.71/2520.01	c # Dec = 2947768
2519.71/2520.01	c # Propagate Calls = 23342920836
2519.71/2520.01	c # assignAt Calls = 5184674
2519.71/2520.01	c # removeAt Calls = 756619611
2519.71/2520.01	c # Run = 5102
2519.71/2520.01	c # Conflicts = 2867620
2519.71/2520.01	c # Memory used = 1178.34 Mb
2519.71/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9905 MiB free)
  memory of node 1: 16384 MiB (15800 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299994-1532793754/watcher-4299994-1532793754 -o /tmp/evaluation-result-4299994-1532793754/solver-4299994-1532793754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580 nacre_mini_release HOME/instance-4299994-1532793754.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Starting watchdog thread
Linux 3.10.0-514.16.1.el7.x86_64
Current StackSize limit: 8192 KiB

solver pid=31993, runsolver pid=31990

[startup+0.100161 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26314128/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=34812 memory=11308 CPUtime=0.1 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 3294 0 0 0 10 0 0 0 20 0 1 0 96938543 35647488 2827 33554432000 4194304 4933779 140723299261472 140723299258472 4393171 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 8703 2827 612 181 0 2320 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 34812 KiB
Current children cumulated memory: 11308 KiB

[startup+0.209778 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26312268/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=36424 memory=12892 CPUtime=0.21 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 3700 0 0 0 21 0 0 0 20 0 1 0 96938543 37298176 3223 33554432000 4194304 4933779 140723299261472 140723299258472 139908908014003 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 9106 3223 612 181 0 2723 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 36424 KiB
Current children cumulated memory: 12892 KiB

[startup+0.309475 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26310516/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=37776 memory=14212 CPUtime=0.31 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 4037 0 0 0 31 0 0 0 20 0 1 0 96938543 38682624 3553 33554432000 4194304 4933779 140723299261472 140723299258472 4393121 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 9444 3553 612 181 0 3061 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 37776 KiB
Current children cumulated memory: 14212 KiB

[startup+0.700334 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26307540/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=43576 memory=20020 CPUtime=0.69 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 5484 0 0 0 68 1 0 0 20 0 1 0 96938543 44621824 5005 33554432000 4194304 4933779 140723299261472 140723299258472 139908908014003 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 10894 5005 612 181 0 4511 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 43576 KiB
Current children cumulated memory: 20020 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26300100/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=55400 memory=31636 CPUtime=1.49 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 8427 0 0 0 148 1 0 0 20 0 1 0 96938543 56729600 7909 33554432000 4194304 4933779 140723299261472 140723299258472 139908908013995 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 13850 7909 612 181 0 7467 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 55400 KiB
Current children cumulated memory: 31636 KiB

[startup+3.1097 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 31994
/proc/meminfo: memFree=26272572/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=76192 memory=52464 CPUtime=3.1 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 19840 0 0 0 308 2 0 0 20 0 1 0 96938543 78020608 13116 33554432000 4194304 4933779 140723299261472 140723299259224 4437567 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 19048 13116 612 181 0 12665 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 76192 KiB
Current children cumulated memory: 52464 KiB

[startup+6.30037 s]
/proc/loadavg: 1.92 1.99 2.03 3/188 31994
/proc/meminfo: memFree=26233352/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=117184 memory=93336 CPUtime=6.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 41015 0 0 0 625 4 0 0 20 0 1 0 96938543 119996416 23334 33554432000 4194304 4933779 140723299261472 140723299259224 139908908013987 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 29296 23334 612 181 0 22913 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 117184 KiB
Current children cumulated memory: 93336 KiB

[startup+12.7004 s]
/proc/loadavg: 1.92 1.99 2.03 3/188 31994
/proc/meminfo: memFree=26202192/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=142648 memory=118912 CPUtime=12.69 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 67867 0 0 0 1262 7 0 0 20 0 1 0 96938543 146071552 29728 33554432000 4194304 4933779 140723299261472 140723299259224 4393104 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 35662 29728 612 181 0 29279 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 142648 KiB
Current children cumulated memory: 118912 KiB

[startup+25.5004 s]
/proc/loadavg: 1.94 1.99 2.03 3/188 31994
/proc/meminfo: memFree=26169664/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=171372 memory=147760 CPUtime=25.49 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 127461 0 0 0 2536 13 0 0 20 0 1 0 96938543 175484928 36940 33554432000 4194304 4933779 140723299261472 140723299259224 139908908013947 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 42843 36940 612 181 0 36460 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 171372 KiB
Current children cumulated memory: 147760 KiB

[startup+51.1097 s]
/proc/loadavg: 1.96 1.99 2.03 3/188 31994
/proc/meminfo: memFree=26128560/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=205396 memory=181260 CPUtime=51.1 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 183288 0 0 0 5091 19 0 0 20 0 1 0 96938543 210325504 45315 33554432000 4194304 4933779 140723299261472 140723299259224 4475589 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 51349 45315 612 181 0 44966 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 205396 KiB
Current children cumulated memory: 181260 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 1.99 2.03 3/188 31995
/proc/meminfo: memFree=26074920/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=246516 memory=222240 CPUtime=102.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 241631 0 0 0 10203 26 0 0 20 0 1 0 96938543 252432384 55560 33554432000 4194304 4933779 140723299261472 140723299259224 4475748 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 61629 55560 612 181 0 55246 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 246516 KiB
Current children cumulated memory: 222240 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/188 31996
/proc/meminfo: memFree=25908628/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=397292 memory=373100 CPUtime=162.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 334116 0 0 0 16194 35 0 0 20 0 1 0 96938543 406827008 93275 33554432000 4194304 4933779 140723299261472 140723299259224 4475748 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 99323 93275 612 181 0 92940 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 397292 KiB
Current children cumulated memory: 373100 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31997
/proc/meminfo: memFree=25855756/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=433332 memory=409520 CPUtime=222.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 398841 0 0 0 22188 41 0 0 20 0 1 0 96938543 443731968 102380 33554432000 4194304 4933779 140723299261472 140723299259160 4388720 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 108333 102380 612 181 0 101950 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 433332 KiB
Current children cumulated memory: 409520 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31998
/proc/meminfo: memFree=25821660/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=452296 memory=428592 CPUtime=282.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 421409 0 0 0 28184 45 0 0 20 0 1 0 96938543 463151104 107148 33554432000 4194304 4933779 140723299261472 140723299259224 139908908014003 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 113074 107148 612 181 0 106691 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 452296 KiB
Current children cumulated memory: 428592 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31999
/proc/meminfo: memFree=25780976/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=477372 memory=452348 CPUtime=342.29 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 506253 0 0 0 34176 53 0 0 20 0 1 0 96938543 488828928 113087 33554432000 4194304 4933779 140723299261472 140723299258984 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 119343 113087 612 181 0 112960 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 477372 KiB
Current children cumulated memory: 452348 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 32000
/proc/meminfo: memFree=25625840/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=618108 memory=592824 CPUtime=402.25 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 617541 0 0 0 40160 65 0 0 20 0 1 0 96938543 632942592 148206 33554432000 4194304 4933779 140723299261472 140723299258984 4365491 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 154527 148206 612 181 0 148144 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 618108 KiB
Current children cumulated memory: 592824 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/189 32010
/proc/meminfo: memFree=25606740/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=619508 memory=594204 CPUtime=462.22 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 646521 0 0 0 46155 67 0 0 20 0 1 0 96938543 634376192 148551 33554432000 4194304 4933779 140723299261472 140723299259160 4437567 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 154877 148551 612 181 0 148494 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 619508 KiB
Current children cumulated memory: 594204 KiB


################
# More data... #
################

/proc/31993/statm: 272512 265670 612 181 0 266129 0
Current children cumulated CPU time: 1722.08 s
Current children cumulated vsize: 1090048 KiB
Current children cumulated memory: 1062680 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32050
/proc/meminfo: memFree=24910940/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1104992 memory=1077212 CPUtime=1782.05 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1587135 0 0 0 178035 170 0 0 20 0 1 0 96938543 1131511808 269303 33554432000 4194304 4933779 140723299261472 140723299258984 4437536 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 276248 269303 612 181 0 269865 0
Current children cumulated CPU time: 1782.05 s
Current children cumulated vsize: 1104992 KiB
Current children cumulated memory: 1077212 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32051
/proc/meminfo: memFree=24889380/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1116520 memory=1088972 CPUtime=1842.04 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1616823 0 0 0 184030 174 0 0 20 0 1 0 96938543 1143316480 272243 33554432000 4194304 4933779 140723299261472 140723299258984 139908908013947 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 279130 272243 612 181 0 272747 0
Current children cumulated CPU time: 1842.04 s
Current children cumulated vsize: 1116520 KiB
Current children cumulated memory: 1088972 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32052
/proc/meminfo: memFree=24863248/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1130416 memory=1104092 CPUtime=1902.01 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1638137 0 0 0 190025 176 0 0 20 0 1 0 96938543 1157545984 276023 33554432000 4194304 4933779 140723299261472 140723299258984 4388417 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 282604 276023 612 181 0 276221 0
Current children cumulated CPU time: 1902.01 s
Current children cumulated vsize: 1130416 KiB
Current children cumulated memory: 1104092 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 32296
/proc/meminfo: memFree=25559516/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1139968 memory=1115040 CPUtime=1962 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1642160 0 0 0 196023 177 0 0 20 0 1 0 96938543 1167327232 278760 33554432000 4194304 4933779 140723299261472 140723299259224 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 284992 278760 612 181 0 278609 0
Current children cumulated CPU time: 1962 s
Current children cumulated vsize: 1139968 KiB
Current children cumulated memory: 1115040 KiB

[startup+2022.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 32297
/proc/meminfo: memFree=25427232/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1146348 memory=1120896 CPUtime=2022 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1646377 0 0 0 202022 178 0 0 20 0 1 0 96938543 1173860352 280224 33554432000 4194304 4933779 140723299261472 140723299259240 4437536 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 286587 280224 612 181 0 280204 0
Current children cumulated CPU time: 2022 s
Current children cumulated vsize: 1146348 KiB
Current children cumulated memory: 1120896 KiB

[startup+2082.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 32298
/proc/meminfo: memFree=25314768/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1150700 memory=1124784 CPUtime=2082 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1651693 0 0 0 208021 179 0 0 20 0 1 0 96938543 1178316800 281196 33554432000 4194304 4933779 140723299261472 140723299258984 4437547 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 287675 281196 612 181 0 281292 0
Current children cumulated CPU time: 2082 s
Current children cumulated vsize: 1150700 KiB
Current children cumulated memory: 1124784 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 32299
/proc/meminfo: memFree=25286940/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1159476 memory=1133420 CPUtime=2142.01 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1658658 0 0 0 214020 181 0 0 20 0 1 0 96938543 1187303424 283355 33554432000 4194304 4933779 140723299261472 140723299259224 4475748 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 289869 283355 612 181 0 283486 0
Current children cumulated CPU time: 2142.01 s
Current children cumulated vsize: 1159476 KiB
Current children cumulated memory: 1133420 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 32300
/proc/meminfo: memFree=25040292/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1168640 memory=1142396 CPUtime=2202.01 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1667988 0 0 0 220019 182 0 0 20 0 1 0 96938543 1196687360 285599 33554432000 4194304 4933779 140723299261472 140723299259160 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 292160 285599 612 181 0 285777 0
Current children cumulated CPU time: 2202.01 s
Current children cumulated vsize: 1168640 KiB
Current children cumulated memory: 1142396 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32309
/proc/meminfo: memFree=24542184/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1178768 memory=1151960 CPUtime=2262 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1678243 0 0 0 226017 183 0 0 20 0 1 0 96938543 1207058432 287990 33554432000 4194304 4933779 140723299261472 140723299258984 4421369 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 294692 287990 612 181 0 288309 0
Current children cumulated CPU time: 2262 s
Current children cumulated vsize: 1178768 KiB
Current children cumulated memory: 1151960 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32310
/proc/meminfo: memFree=24165712/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1186040 memory=1159232 CPUtime=2322.01 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1689895 0 0 0 232016 185 0 0 20 0 1 0 96938543 1214504960 289808 33554432000 4194304 4933779 140723299261472 140723299259224 139908908014003 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 296510 289808 612 181 0 290127 0
Current children cumulated CPU time: 2322.01 s
Current children cumulated vsize: 1186040 KiB
Current children cumulated memory: 1159232 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32311
/proc/meminfo: memFree=24121468/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1191444 memory=1164392 CPUtime=2382 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1705199 0 0 0 238014 186 0 0 20 0 1 0 96938543 1220038656 291098 33554432000 4194304 4933779 140723299261472 140723299259160 139908908013828 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 297861 291098 612 181 0 291478 0
Current children cumulated CPU time: 2382 s
Current children cumulated vsize: 1191444 KiB
Current children cumulated memory: 1164392 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32312
/proc/meminfo: memFree=24114280/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1197928 memory=1170828 CPUtime=2442 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1720431 0 0 0 244012 188 0 0 20 0 1 0 96938543 1226678272 292707 33554432000 4194304 4933779 140723299261472 140723299259224 4437564 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 299482 292707 612 181 0 293099 0
Current children cumulated CPU time: 2442 s
Current children cumulated vsize: 1197928 KiB
Current children cumulated memory: 1170828 KiB

[startup+2502.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/188 32313
/proc/meminfo: memFree=23904476/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1202812 memory=1175648 CPUtime=2502.01 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1735068 0 0 0 250011 190 0 0 20 0 1 0 96938543 1231679488 293912 33554432000 4194304 4933779 140723299261472 140723299259224 4437570 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 300703 293912 612 181 0 294320 0
Current children cumulated CPU time: 2502.01 s
Current children cumulated vsize: 1202812 KiB
Current children cumulated memory: 1175648 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.05 2.03 2.05 3/188 32313
/proc/meminfo: memFree=23772000/32770624 swapFree=67028328/67108860
[pid=31993] ppid=31990 vsize=1205540 memory=1178340 CPUtime=2519.71 cores=1,3,5,7
/proc/31993/stat : 31993 (nacre_mini_rele) R 31990 31993 29912 0 -1 4202496 1737976 0 0 0 251781 190 0 0 20 0 1 0 96938543 1234472960 294585 33554432000 4194304 4933779 140723299261472 140723299259224 4393171 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 31383552 140723299263640 140723299263740 140723299263740 140723299266498 0
/proc/31993/statm: 301385 294585 612 181 0 295002 0
Current children cumulated CPU time: 2519.71 s
Current children cumulated vsize: 1205540 KiB
Current children cumulated memory: 1178340 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 31993 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.82 s, system=1.91797 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.73
CPU user time (s): 2517.82
CPU system time (s): 1.91797
CPU usage (%): 99.9887
Max. virtual memory (cumulated for all children) (KiB): 1205540
Max. memory (cumulated for all children) (KiB): 1178340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.82
system time used= 1.91797
maximum resident set size= 1178420
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1738017
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 419
involuntary context switches= 2438


# summary of solver processes directly reported to runsolver:
#   pid: 31993
#   total CPU time (s): 2519.73
#   total CPU user time (s): 2517.82
#   total CPU system time (s): 1.91797

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.0021 second user time and 17.0275 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 18:02:34
IDJOB=4299994
IDBENCH=141517
IDSOLVER=2764
FILE ID=node102/4299994-1532793754
RUNJOBID= node102-1532776103-29944
PBS_JOBID= 21022470
Free space on /tmp= 52748 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/MagicSquare/MagicSquare-13-sum_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299994-1532793754/watcher-4299994-1532793754 -o /tmp/evaluation-result-4299994-1532793754/solver-4299994-1532793754 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580  nacre_mini_release HOME/instance-4299994-1532793754.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 507ff1916128830fd6a67d5c849b681a
RANDOM SEED=35891506

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26323568 kB
MemAvailable:   31463716 kB
Buffers:          215128 kB
Cached:          5180172 kB
SwapCached:        53436 kB
Active:          1677040 kB
Inactive:        4271076 kB
Active(anon):     478408 kB
Inactive(anon):    99080 kB
Active(file):    1198632 kB
Inactive(file):  4171996 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028328 kB
Dirty:               788 kB
Writeback:             0 kB
AnonPages:        594240 kB
Mapped:            36616 kB
Shmem:             22104 kB
Slab:             198988 kB
SReclaimable:     170708 kB
SUnreclaim:        28280 kB
KernelStack:        3376 kB
PageTables:         6052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     825808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     88064 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52744 MiB
End job on node102 at 2018-07-28 18:44:34