Trace number 4299978

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.96 2520.02

General information on the benchmark

NameMagicSquare/
MagicSquare-14-sum_c18.xml
MD5SUMd2d43b1b882dee15f3aa399c7a9d9ad6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables196
Number of constraints31
Number of domains1
Minimum domain size196
Maximum domain size196
Distribution of domain sizes[{"size":196,"count":196}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":168},{"degree":4,"count":28}]
Minimum constraint arity14
Maximum constraint arity196
Distribution of constraint arities[{"arity":14,"count":30},{"arity":196,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":30}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.94/2520.01	c
2519.94/2520.01	c # time = 2519.94
2519.94/2520.01	c # Dec = 2324125
2519.94/2520.01	c # Propagate Calls = 25877031985
2519.94/2520.01	c # assignAt Calls = 4176576
2519.94/2520.01	c # removeAt Calls = 735519357
2519.94/2520.01	c # Run = 4095
2519.94/2520.01	c # Conflicts = 2284612
2519.94/2520.01	c # Memory used = 827.62 Mb
2519.94/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10366 MiB free)
  memory of node 1: 16384 MiB (14295 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299978-1532793143/watcher-4299978-1532793143 -o /tmp/evaluation-result-4299978-1532793143/solver-4299978-1532793143 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580 nacre_mini_release HOME/instance-4299978-1532793143.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=31829, runsolver pid=31826


[startup+0.100203 s]*
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25243372/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=38212 memory=13528 CPUtime=0.1 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 4231 0 0 0 10 0 0 0 20 0 1 0 96877446 39129088 3382 33554432000 4194304 4933779 140736846581904 140736846578904 140270796544379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 9553 3382 612 181 0 3170 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38212 KiB
Current children cumulated memory: 13528 KiB

[startup+0.209756 s]*
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25241884/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=39728 memory=15112 CPUtime=0.21 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 4621 0 0 0 21 0 0 0 20 0 1 0 96877446 40681472 3778 33554432000 4194304 4933779 140736846581904 140736846578904 4475895 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 9932 3778 612 181 0 3549 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 39728 KiB
Current children cumulated memory: 15112 KiB

[startup+0.309583 s]*
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25239992/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=41236 memory=16432 CPUtime=0.31 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 4990 0 0 0 31 0 0 0 20 0 1 0 96877446 42225664 4108 33554432000 4194304 4933779 140736846581904 140736846578904 4393131 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 10309 4108 612 181 0 3926 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 41236 KiB
Current children cumulated memory: 16432 KiB

[startup+0.700401 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25237264/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=46880 memory=21976 CPUtime=0.69 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 6379 0 0 0 69 0 0 0 20 0 1 0 96877446 48005120 5494 33554432000 4194304 4933779 140736846581904 140736846578904 140270796544403 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 11720 5494 612 181 0 5337 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 46880 KiB
Current children cumulated memory: 21976 KiB

[startup+1.50042 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25230196/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=57916 memory=33064 CPUtime=1.49 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 9141 0 0 0 148 1 0 0 20 0 1 0 96877446 59305984 8266 33554432000 4194304 4933779 140736846581904 140736846579672 4472628 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 14479 8266 612 181 0 8096 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 57916 KiB
Current children cumulated memory: 33064 KiB

[startup+3.10962 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25202648/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=79528 memory=54572 CPUtime=3.1 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 20302 0 0 0 308 2 0 0 20 0 1 0 96877446 81436672 13643 33554432000 4194304 4933779 140736846581904 140736846579672 140270796544403 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 19882 13643 612 181 0 13499 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 79528 KiB
Current children cumulated memory: 54572 KiB

[startup+6.30041 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25166324/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=117804 memory=93064 CPUtime=6.29 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 39169 0 0 0 625 4 0 0 20 0 1 0 96877446 120631296 23266 33554432000 4194304 4933779 140736846581904 140736846579656 140270796544411 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 29451 23266 612 181 0 23068 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 117804 KiB
Current children cumulated memory: 93064 KiB

[startup+12.7004 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25121436/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=159368 memory=134500 CPUtime=12.7 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 68052 0 0 0 1262 8 0 0 20 0 1 0 96877446 163192832 33625 33554432000 4194304 4933779 140736846581904 140736846579656 140270796544379 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 39842 33625 612 181 0 33459 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 159368 KiB
Current children cumulated memory: 134500 KiB

[startup+25.5004 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 31830
/proc/meminfo: memFree=25074068/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=197020 memory=172044 CPUtime=25.49 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 130689 0 0 0 2535 14 0 0 20 0 1 0 96877446 201748480 43011 33554432000 4194304 4933779 140736846581904 140736846579656 4475748 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 49255 43011 612 181 0 42872 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 197020 KiB
Current children cumulated memory: 172044 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31830
/proc/meminfo: memFree=25032280/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=238312 memory=212924 CPUtime=51.1 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 197335 0 0 0 5090 20 0 0 20 0 1 0 96877446 244031488 53231 33554432000 4194304 4933779 140736846581904 140736846579608 140270796544435 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 59578 53231 612 181 0 53195 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 238312 KiB
Current children cumulated memory: 212924 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31831
/proc/meminfo: memFree=24984176/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=285496 memory=260176 CPUtime=102.29 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 267199 0 0 0 10202 27 0 0 20 0 1 0 96877446 292347904 65044 33554432000 4194304 4933779 140736846581904 140736846579656 4388395 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 71374 65044 612 181 0 64991 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 285496 KiB
Current children cumulated memory: 260176 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31833
/proc/meminfo: memFree=24943464/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=319792 memory=294336 CPUtime=162.29 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 335912 0 0 0 16196 33 0 0 20 0 1 0 96877446 327467008 73584 33554432000 4194304 4933779 140736846581904 140736846579608 4437570 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 79948 73584 612 181 0 73565 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 319792 KiB
Current children cumulated memory: 294336 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/187 31834
/proc/meminfo: memFree=24865080/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=379768 memory=354424 CPUtime=222.29 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 359607 0 0 0 22191 38 0 0 20 0 1 0 96877446 388882432 88606 33554432000 4194304 4933779 140736846581904 140736846579656 4393121 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 94942 88606 612 181 0 88559 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 379768 KiB
Current children cumulated memory: 354424 KiB

[startup+282.3 s]
/proc/loadavg: 1.96 2.01 2.04 3/187 31835
/proc/meminfo: memFree=24818192/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=397604 memory=372220 CPUtime=282.3 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 441528 0 0 0 28181 49 0 0 20 0 1 0 96877446 407146496 93055 33554432000 4194304 4933779 140736846581904 140736846579592 4475748 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 99401 93055 612 181 0 93018 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 397604 KiB
Current children cumulated memory: 372220 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31837
/proc/meminfo: memFree=24756228/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=417844 memory=392568 CPUtime=342.3 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 528777 0 0 0 34174 56 0 0 20 0 1 0 96877446 427872256 98142 33554432000 4194304 4933779 140736846581904 140736846579656 4423391 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 104461 98142 612 181 0 98078 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 417844 KiB
Current children cumulated memory: 392568 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31838
/proc/meminfo: memFree=24713692/32770624 swapFree=67028324/67108860
[pid=31829] ppid=31826 vsize=438588 memory=412488 CPUtime=402.31 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 619823 0 0 0 40166 65 0 0 20 0 1 0 96877446 449114112 103122 33554432000 4194304 4933779 140736846581904 140736846579608 140270796544252 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 109647 103122 612 181 0 103264 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 438588 KiB
Current children cumulated memory: 412488 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31846
/proc/meminfo: memFree=24652256/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=463316 memory=437024 CPUtime=462.31 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 717394 0 0 0 46157 74 0 0 20 0 1 0 96877446 474435584 109256 33554432000 4194304 4933779 140736846581904 140736846579656 4472608 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 115829 109256 612 181 0 109446 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 463316 KiB
Current children cumulated memory: 437024 KiB


################
# More data... #
################

/proc/31829/statm: 183438 176796 612 181 0 177055 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 733752 KiB
Current children cumulated memory: 707184 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32030
/proc/meminfo: memFree=25101108/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=746008 memory=720132 CPUtime=1782.25 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1587410 0 0 0 178052 173 0 0 20 0 1 0 96877446 763912192 180033 33554432000 4194304 4933779 140736846581904 140736846579656 4388619 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 186502 180033 612 181 0 180119 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 746008 KiB
Current children cumulated memory: 720132 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32031
/proc/meminfo: memFree=25082740/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=752564 memory=727876 CPUtime=1842.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1605841 0 0 0 184048 175 0 0 20 0 1 0 96877446 770625536 181969 33554432000 4194304 4933779 140736846581904 140736846579592 4437796 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 188141 181969 612 181 0 181758 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 752564 KiB
Current children cumulated memory: 727876 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32032
/proc/meminfo: memFree=25064332/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=760572 memory=736112 CPUtime=1902.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1609999 0 0 0 190047 176 0 0 20 0 1 0 96877446 778825728 184028 33554432000 4194304 4933779 140736846581904 140736846579656 4437536 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 190143 184028 612 181 0 183760 0
Current children cumulated CPU time: 1902.23 s
Current children cumulated vsize: 760572 KiB
Current children cumulated memory: 736112 KiB

[startup+1962.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 32034
/proc/meminfo: memFree=25040408/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=769400 memory=745072 CPUtime=1962.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1615373 0 0 0 196046 177 0 0 20 0 1 0 96877446 787865600 186268 33554432000 4194304 4933779 140736846581904 140736846579656 4393080 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 192350 186268 612 181 0 185967 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 769400 KiB
Current children cumulated memory: 745072 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 32035
/proc/meminfo: memFree=25025372/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=777096 memory=752644 CPUtime=2022.22 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1622432 0 0 0 202044 178 0 0 20 0 1 0 96877446 795746304 188161 33554432000 4194304 4933779 140736846581904 140736846579656 4437581 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 194274 188161 612 181 0 187891 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 777096 KiB
Current children cumulated memory: 752644 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 32036
/proc/meminfo: memFree=25007224/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=786732 memory=762308 CPUtime=2082.22 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1632912 0 0 0 208042 180 0 0 20 0 1 0 96877446 805613568 190577 33554432000 4194304 4933779 140736846581904 140736846579656 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 196683 190577 612 181 0 190300 0
Current children cumulated CPU time: 2082.22 s
Current children cumulated vsize: 786732 KiB
Current children cumulated memory: 762308 KiB

[startup+2142.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/187 32038
/proc/meminfo: memFree=24987724/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=795288 memory=770748 CPUtime=2142.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1644996 0 0 0 214041 182 0 0 20 0 1 0 96877446 814374912 192687 33554432000 4194304 4933779 140736846581904 140736846579608 4437538 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 198822 192687 612 181 0 192439 0
Current children cumulated CPU time: 2142.23 s
Current children cumulated vsize: 795288 KiB
Current children cumulated memory: 770748 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 32039
/proc/meminfo: memFree=24967540/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=806744 memory=780996 CPUtime=2202.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1658405 0 0 0 220038 185 0 0 20 0 1 0 96877446 826105856 195249 33554432000 4194304 4933779 140736846581904 140736846579656 4437547 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 201686 195249 612 181 0 195303 0
Current children cumulated CPU time: 2202.23 s
Current children cumulated vsize: 806744 KiB
Current children cumulated memory: 780996 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 32048
/proc/meminfo: memFree=24950488/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=815104 memory=789276 CPUtime=2262.22 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1675468 0 0 0 226035 187 0 0 20 0 1 0 96877446 834666496 197319 33554432000 4194304 4933779 140736846581904 140736846579608 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 203776 197319 612 181 0 197393 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 815104 KiB
Current children cumulated memory: 789276 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32049
/proc/meminfo: memFree=24935980/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=821760 memory=795876 CPUtime=2322.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1692333 0 0 0 232032 191 0 0 20 0 1 0 96877446 841482240 198969 33554432000 4194304 4933779 140736846581904 140736846579608 4437567 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 205440 198969 612 181 0 199057 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 821760 KiB
Current children cumulated memory: 795876 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32050
/proc/meminfo: memFree=24915696/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=830380 memory=804276 CPUtime=2382.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1706777 0 0 0 238031 192 0 0 20 0 1 0 96877446 850309120 201069 33554432000 4194304 4933779 140736846581904 140736846579656 4437581 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 207595 201069 612 181 0 201212 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 830380 KiB
Current children cumulated memory: 804276 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32051
/proc/meminfo: memFree=24894728/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=839364 memory=813036 CPUtime=2442.23 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1729305 0 0 0 244028 195 0 0 20 0 1 0 96877446 859508736 203259 33554432000 4194304 4933779 140736846581904 140736846579592 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 209841 203259 612 181 0 203458 0
Current children cumulated CPU time: 2442.23 s
Current children cumulated vsize: 839364 KiB
Current children cumulated memory: 813036 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 32052
/proc/meminfo: memFree=24867228/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=851480 memory=824712 CPUtime=2502.22 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1748789 0 0 0 250025 197 0 0 20 0 1 0 96877446 871915520 206178 33554432000 4194304 4933779 140736846581904 140736846579656 140270796436208 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 212870 206178 612 181 0 206487 0
Current children cumulated CPU time: 2502.22 s
Current children cumulated vsize: 851480 KiB
Current children cumulated memory: 824712 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 32052
/proc/meminfo: memFree=24861000/32770624 swapFree=67028328/67108860
[pid=31829] ppid=31826 vsize=854400 memory=827568 CPUtime=2519.94 cores=0,2,4,6
/proc/31829/stat : 31829 (nacre_mini_rele) R 31826 31829 29912 0 -1 4202496 1759263 0 0 0 251795 199 0 0 20 0 1 0 96877446 874905600 206892 33554432000 4194304 4933779 140736846581904 140736846579656 140270796544387 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 29995008 140736846587032 140736846587132 140736846587132 140736846589890 0
/proc/31829/statm: 213600 206892 612 181 0 207217 0
Current children cumulated CPU time: 2519.94 s
Current children cumulated vsize: 854400 KiB
Current children cumulated memory: 827568 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 31829 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.96 s, system=2.00404 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.96
CPU user time (s): 2517.96
CPU system time (s): 2.00404
CPU usage (%): 99.9975
Max. virtual memory (cumulated for all children) (KiB): 854400
Max. memory (cumulated for all children) (KiB): 827568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.95
system time used= 2.00404
maximum resident set size= 827644
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1759317
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 234
involuntary context switches= 1417


# summary of solver processes directly reported to runsolver:
#   pid: 31829
#   total CPU time (s): 2519.96
#   total CPU user time (s): 2517.96
#   total CPU system time (s): 2.00404

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.6745 second user time and 17.9026 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 17:52:23
IDJOB=4299978
IDBENCH=141515
IDSOLVER=2764
FILE ID=node102/4299978-1532793143
RUNJOBID= node102-1532776103-29943
PBS_JOBID= 21022470
Free space on /tmp= 52748 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/MagicSquare/MagicSquare-14-sum_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299978-1532793143/watcher-4299978-1532793143 -o /tmp/evaluation-result-4299978-1532793143/solver-4299978-1532793143 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29943 --watchdog 2580  nacre_mini_release HOME/instance-4299978-1532793143.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2d43b1b882dee15f3aa399c7a9d9ad6
RANDOM SEED=125958168

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25254572 kB
MemAvailable:   30394712 kB
Buffers:          215024 kB
Cached:          5180396 kB
SwapCached:        53440 kB
Active:          2743884 kB
Inactive:        4270900 kB
Active(anon):    1545084 kB
Inactive(anon):    99080 kB
Active(file):    1198800 kB
Inactive(file):  4171820 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028324 kB
Dirty:               808 kB
Writeback:             0 kB
AnonPages:       1573304 kB
Mapped:            37228 kB
Shmem:             22100 kB
Slab:             198668 kB
SReclaimable:     170708 kB
SUnreclaim:        27960 kB
KernelStack:        3344 kB
PageTables:         8196 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1891732 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1280000 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52744 MiB
End job on node102 at 2018-07-28 18:34:23