Trace number 4299600

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.96 2520.01

General information on the benchmark

NameHaystacks/
Haystacks-ext-12_c18.xml
MD5SUM9b1722167e694dc70b944145256e05c5
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2367.8
Satisfiable
(Un)Satisfiability was proved
Number of variables144
Number of constraints803
Number of domains1
Minimum domain size12
Maximum domain size12
Distribution of domain sizes[{"size":12,"count":144}]
Minimum variable degree11
Maximum variable degree12
Distribution of variable degrees[{"degree":11,"count":122},{"degree":12,"count":22}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":803}]
Number of extensional constraints803
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":803}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c NACRE 1.0.4
2519.95/2520.00	c
2519.95/2520.00	c # time = 2519.95
2519.95/2520.00	c # Dec = 11534196
2519.95/2520.00	c # Propagate Calls = 961183588
2519.95/2520.00	c # assignAt Calls = 35110269
2519.95/2520.00	c # removeAt Calls = 91588972
2519.95/2520.00	c # Run = 16381
2519.95/2520.00	c # Conflicts = 10064705
2519.95/2520.01	c # Memory used = 215.924 Mb
2519.95/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10347 MiB free)
  memory of node 1: 16384 MiB (15801 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299600-1532786191/watcher-4299600-1532786191 -o /tmp/evaluation-result-4299600-1532786191/solver-4299600-1532786191 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580 nacre_mini_release HOME/instance-4299600-1532786191.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=31265, runsolver pid=31262

[startup+0.100389 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26772092/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=30284 memory=6896 CPUtime=0.1 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 1890 0 0 0 10 0 0 0 20 0 1 0 96182296 31010816 1724 33554432000 4194304 4933779 140728106200000 140728106197688 139943714962405 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 7571 1724 603 181 0 1188 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30284 KiB
Current children cumulated memory: 6896 KiB

[startup+0.20949 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26769672/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=32180 memory=8500 CPUtime=0.2 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 2363 0 0 0 20 0 0 0 20 0 1 0 96182296 32952320 2125 33554432000 4194304 4933779 140728106200000 140728106197688 4437466 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 8045 2125 603 181 0 1662 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32180 KiB
Current children cumulated memory: 8500 KiB

[startup+0.309181 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26768184/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=33368 memory=9816 CPUtime=0.3 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 2705 0 0 0 30 0 0 0 20 0 1 0 96182296 34168832 2454 33554432000 4194304 4933779 140728106200000 140728106197688 4437536 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 8342 2454 603 181 0 1959 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33368 KiB
Current children cumulated memory: 9816 KiB

[startup+0.700243 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26766696/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=35640 memory=12192 CPUtime=0.69 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 3294 0 0 0 69 0 0 0 20 0 1 0 96182296 36495360 3048 33554432000 4194304 4933779 140728106200000 140728106197688 4439640 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 8910 3048 603 181 0 2527 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35640 KiB
Current children cumulated memory: 12192 KiB

[startup+1.50026 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26763720/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=39312 memory=15364 CPUtime=1.49 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 4247 0 0 0 149 0 0 0 20 0 1 0 96182296 40255488 3841 33554432000 4194304 4933779 140728106200000 140728106197752 139943714962405 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 9828 3841 603 181 0 3445 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39312 KiB
Current children cumulated memory: 15364 KiB

[startup+3.10944 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31266
/proc/meminfo: memFree=26755292/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=43336 memory=19768 CPUtime=3.09 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 8871 0 0 0 309 0 0 0 20 0 1 0 96182296 44376064 4942 33554432000 4194304 4933779 140728106200000 140728106197512 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 10834 4942 603 181 0 4451 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 43336 KiB
Current children cumulated memory: 19768 KiB

[startup+6.30023 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31266
/proc/meminfo: memFree=26747624/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=47392 memory=23856 CPUtime=6.28 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 14578 0 0 0 628 0 0 0 20 0 1 0 96182296 48529408 5964 33554432000 4194304 4933779 140728106200000 140728106197512 4437538 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 11848 5964 603 181 0 5465 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 47392 KiB
Current children cumulated memory: 23856 KiB

[startup+12.7003 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31266
/proc/meminfo: memFree=26736076/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=55284 memory=30664 CPUtime=12.68 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 22169 0 0 0 1268 0 0 0 20 0 1 0 96182296 56610816 7666 33554432000 4194304 4933779 140728106200000 140728106197512 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 13821 7666 603 181 0 7438 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 55284 KiB
Current children cumulated memory: 30664 KiB

[startup+25.5003 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 31266
/proc/meminfo: memFree=26719936/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=62748 memory=38164 CPUtime=25.48 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 38427 0 0 0 2547 1 0 0 20 0 1 0 96182296 64253952 9541 33554432000 4194304 4933779 140728106200000 140728106197688 4437445 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 15687 9541 603 181 0 9304 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 62748 KiB
Current children cumulated memory: 38164 KiB

[startup+51.1094 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 31266
/proc/meminfo: memFree=26695308/32770624 swapFree=67028268/67108860
[pid=31265] ppid=31262 vsize=75992 memory=51792 CPUtime=51.07 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 44032 0 0 0 5105 2 0 0 20 0 1 0 96182296 77815808 12948 33554432000 4194304 4933779 140728106200000 140728106197512 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 18998 12948 603 181 0 12615 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 75992 KiB
Current children cumulated memory: 51792 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 31268
/proc/meminfo: memFree=26668592/32770624 swapFree=67028276/67108860
[pid=31265] ppid=31262 vsize=89776 memory=65712 CPUtime=102.27 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 50275 0 0 0 10224 3 0 0 20 0 1 0 96182296 91930624 16428 33554432000 4194304 4933779 140728106200000 140728106197688 4437389 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 22444 16428 603 181 0 16061 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 89776 KiB
Current children cumulated memory: 65712 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 31269
/proc/meminfo: memFree=26644804/32770624 swapFree=67028276/67108860
[pid=31265] ppid=31262 vsize=102100 memory=75712 CPUtime=162.27 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 57602 0 0 0 16223 4 0 0 20 0 1 0 96182296 104550400 18928 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 25525 18928 603 181 0 19142 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 102100 KiB
Current children cumulated memory: 75712 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 31277
/proc/meminfo: memFree=26619588/32770624 swapFree=67028276/67108860
[pid=31265] ppid=31262 vsize=112488 memory=88060 CPUtime=222.26 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 66727 0 0 0 22220 6 0 0 20 0 1 0 96182296 115187712 22015 33554432000 4194304 4933779 140728106200000 140728106197688 4437678 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 28122 22015 603 181 0 21739 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 112488 KiB
Current children cumulated memory: 88060 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.01 2.04 3/187 31300
/proc/meminfo: memFree=26605364/32770624 swapFree=67028280/67108860
[pid=31265] ppid=31262 vsize=120236 memory=95496 CPUtime=282.25 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 70753 0 0 0 28219 6 0 0 20 0 1 0 96182296 123121664 23874 33554432000 4194304 4933779 140728106200000 140728106197688 4380451 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 30059 23874 603 181 0 23676 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 120236 KiB
Current children cumulated memory: 95496 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.01 2.04 3/187 31301
/proc/meminfo: memFree=26589768/32770624 swapFree=67028280/67108860
[pid=31265] ppid=31262 vsize=127660 memory=101980 CPUtime=342.26 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 75888 0 0 0 34219 7 0 0 20 0 1 0 96182296 130723840 25495 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 31915 25495 603 181 0 25532 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 127660 KiB
Current children cumulated memory: 101980 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.04 3/187 31302
/proc/meminfo: memFree=26579588/32770624 swapFree=67028280/67108860
[pid=31265] ppid=31262 vsize=133304 memory=107884 CPUtime=402.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 81299 0 0 0 40217 7 0 0 20 0 1 0 96182296 136503296 26971 33554432000 4194304 4933779 140728106200000 140728106197512 4437419 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 33326 26971 603 181 0 26943 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 133304 KiB
Current children cumulated memory: 107884 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31303
/proc/meminfo: memFree=26569696/32770624 swapFree=67028280/67108860
[pid=31265] ppid=31262 vsize=137156 memory=112508 CPUtime=462.25 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 83223 0 0 0 46217 8 0 0 20 0 1 0 96182296 140447744 28127 33554432000 4194304 4933779 140728106200000 140728106197688 139943714960522 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 34289 28127 603 181 0 27906 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 137156 KiB
Current children cumulated memory: 112508 KiB


################
# More data... #
################

/proc/31265/statm: 52827 46734 603 181 0 46444 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 211308 KiB
Current children cumulated memory: 186936 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31342
/proc/meminfo: memFree=26406868/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=213220 memory=188576 CPUtime=1782.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 145462 0 0 0 178207 17 0 0 20 0 1 0 96182296 218337280 47144 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 53305 47144 603 181 0 46922 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 213220 KiB
Current children cumulated memory: 188576 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 31343
/proc/meminfo: memFree=26402760/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=217316 memory=191880 CPUtime=1842.23 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 148076 0 0 0 184206 17 0 0 20 0 1 0 96182296 222531584 47970 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 54329 47970 603 181 0 47946 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 217316 KiB
Current children cumulated memory: 191880 KiB

[startup+1902.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 31345
/proc/meminfo: memFree=26397276/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=219312 memory=193556 CPUtime=1902.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 150361 0 0 0 190206 18 0 0 20 0 1 0 96182296 224575488 48389 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 54828 48389 603 181 0 48445 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 219312 KiB
Current children cumulated memory: 193556 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/187 31346
/proc/meminfo: memFree=26392804/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=221028 memory=195384 CPUtime=1962.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 153115 0 0 0 196206 18 0 0 20 0 1 0 96182296 226332672 48846 33554432000 4194304 4933779 140728106200000 140728106197688 4437564 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 55257 48846 603 181 0 48874 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 221028 KiB
Current children cumulated memory: 195384 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/188 31355
/proc/meminfo: memFree=26385204/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=224048 memory=199788 CPUtime=2022.23 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 156185 0 0 0 202205 18 0 0 20 0 1 0 96182296 229425152 49947 33554432000 4194304 4933779 140728106200000 140728106197512 4380315 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 56012 49947 603 181 0 49629 0
Current children cumulated CPU time: 2022.23 s
Current children cumulated vsize: 224048 KiB
Current children cumulated memory: 199788 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/188 31356
/proc/meminfo: memFree=26379296/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=225704 memory=201332 CPUtime=2082.23 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 158397 0 0 0 208205 18 0 0 20 0 1 0 96182296 231120896 50333 33554432000 4194304 4933779 140728106200000 140728106197688 4437572 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 56426 50333 603 181 0 50043 0
Current children cumulated CPU time: 2082.23 s
Current children cumulated vsize: 225704 KiB
Current children cumulated memory: 201332 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 31357
/proc/meminfo: memFree=26375312/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=228380 memory=203828 CPUtime=2142.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 161086 0 0 0 214205 19 0 0 20 0 1 0 96182296 233861120 50957 33554432000 4194304 4933779 140728106200000 140728106197688 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 57095 50957 603 181 0 50712 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 228380 KiB
Current children cumulated memory: 203828 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 31358
/proc/meminfo: memFree=26367164/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=230208 memory=205132 CPUtime=2202.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 163355 0 0 0 220205 19 0 0 20 0 1 0 96182296 235732992 51283 33554432000 4194304 4933779 140728106200000 140728106197512 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 57552 51283 603 181 0 51169 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 230208 KiB
Current children cumulated memory: 205132 KiB

[startup+2262.3 s]
/proc/loadavg: 2.11 2.06 2.06 3/188 31359
/proc/meminfo: memFree=26363316/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=233448 memory=208416 CPUtime=2262.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 166943 0 0 0 226205 19 0 0 20 0 1 0 96182296 239050752 52104 33554432000 4194304 4933779 140728106200000 140728106197688 4437572 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 58362 52104 603 181 0 51979 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 233448 KiB
Current children cumulated memory: 208416 KiB

[startup+2322.3 s]
/proc/loadavg: 2.04 2.05 2.05 3/187 31360
/proc/meminfo: memFree=26360672/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=234960 memory=209880 CPUtime=2322.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 170393 0 0 0 232204 20 0 0 20 0 1 0 96182296 240599040 52470 33554432000 4194304 4933779 140728106200000 140728106197688 4437432 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 58740 52470 603 181 0 52357 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 234960 KiB
Current children cumulated memory: 209880 KiB

[startup+2382.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/187 31361
/proc/meminfo: memFree=26357512/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=237180 memory=212596 CPUtime=2382.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 172227 0 0 0 238204 20 0 0 20 0 1 0 96182296 242872320 53149 33554432000 4194304 4933779 140728106200000 140728106197688 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 59295 53149 603 181 0 52912 0
Current children cumulated CPU time: 2382.24 s
Current children cumulated vsize: 237180 KiB
Current children cumulated memory: 212596 KiB

[startup+2442.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 31362
/proc/meminfo: memFree=26353952/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=238616 memory=214092 CPUtime=2442.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 174328 0 0 0 244204 20 0 0 20 0 1 0 96182296 244342784 53523 33554432000 4194304 4933779 140728106200000 140728106197688 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 59654 53523 603 181 0 53271 0
Current children cumulated CPU time: 2442.24 s
Current children cumulated vsize: 238616 KiB
Current children cumulated memory: 214092 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/187 31363
/proc/meminfo: memFree=26350864/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=239700 memory=215088 CPUtime=2502.24 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 176530 0 0 0 250204 20 0 0 20 0 1 0 96182296 245452800 53772 33554432000 4194304 4933779 140728106200000 140728106197688 4437581 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 59925 53772 603 181 0 53542 0
Current children cumulated CPU time: 2502.24 s
Current children cumulated vsize: 239700 KiB
Current children cumulated memory: 215088 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.92 2.01 2.04 3/187 31424
/proc/meminfo: memFree=26483852/32770624 swapFree=67028300/67108860
[pid=31265] ppid=31262 vsize=240404 memory=215920 CPUtime=2519.95 cores=1,3,5,7
/proc/31265/stat : 31265 (nacre_mini_rele) R 31262 31265 29912 0 -1 4202496 178471 0 0 0 251975 20 0 0 20 0 1 0 96182296 246173696 53980 33554432000 4194304 4933779 140728106200000 140728106197688 4437453 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 29519872 140728106206360 140728106206460 140728106206460 140728106209218 0
/proc/31265/statm: 60101 53980 603 181 0 53718 0
Current children cumulated CPU time: 2519.95 s
Current children cumulated vsize: 240404 KiB
Current children cumulated memory: 215920 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 31265 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.75 s, system=0.209002 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.96
CPU user time (s): 2519.75
CPU system time (s): 0.209002
CPU usage (%): 99.998
Max. virtual memory (cumulated for all children) (KiB): 240404
Max. memory (cumulated for all children) (KiB): 215920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.75
system time used= 0.209002
maximum resident set size= 216000
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 178515
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 100
involuntary context switches= 1449


# summary of solver processes directly reported to runsolver:
#   pid: 31265
#   total CPU time (s): 2519.96
#   total CPU user time (s): 2519.75
#   total CPU system time (s): 0.209002

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.5428 second user time and 16.9071 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 15:56:31
IDJOB=4299600
IDBENCH=141419
IDSOLVER=2764
FILE ID=node102/4299600-1532786191
RUNJOBID= node102-1532776103-29944
PBS_JOBID= 21022470
Free space on /tmp= 52748 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Haystacks/Haystacks-ext-12_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299600-1532786191/watcher-4299600-1532786191 -o /tmp/evaluation-result-4299600-1532786191/solver-4299600-1532786191 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580  nacre_mini_release HOME/instance-4299600-1532786191.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9b1722167e694dc70b944145256e05c5
RANDOM SEED=263701052

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26776496 kB
MemAvailable:   31912672 kB
Buffers:          214244 kB
Cached:          5177240 kB
SwapCached:        53464 kB
Active:          1226768 kB
Inactive:        4268184 kB
Active(anon):      29160 kB
Inactive(anon):    99048 kB
Active(file):    1197608 kB
Inactive(file):  4169136 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028268 kB
Dirty:              1480 kB
Writeback:             0 kB
AnonPages:         63100 kB
Mapped:            36764 kB
Shmem:             22044 kB
Slab:             198408 kB
SReclaimable:     170532 kB
SUnreclaim:        27876 kB
KernelStack:        3568 kB
PageTables:         4780 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     373332 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52744 MiB
End job on node102 at 2018-07-28 16:38:31