Trace number 4299341

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.8 2520.01

General information on the benchmark

NameLangford/
LangfordBin-09_c18.xml
MD5SUMaf6539439e5a66b9d4cb5cb754e7ed18
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.557709
Satisfiable
(Un)Satisfiability was proved
Number of variables36
Number of constraints27
Number of domains2
Minimum domain size9
Maximum domain size18
Distribution of domain sizes[{"size":9,"count":18},{"size":18,"count":18}]
Minimum variable degree2
Maximum variable degree18
Distribution of variable degrees[{"degree":2,"count":18},{"degree":18,"count":18}]
Minimum constraint arity2
Maximum constraint arity19
Distribution of constraint arities[{"arity":2,"count":9},{"arity":19,"count":18}]
Number of extensional constraints0
Number of intensional constraints9
Distribution of constraint types[{"type":"intension","count":9},{"type":"element","count":18}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c NACRE 1.0.4
2519.78/2520.00	c
2519.78/2520.01	c # time = 2519.78
2519.78/2520.01	c # Dec = 28553767
2519.78/2520.01	c # Propagate Calls = 1661844902
2519.78/2520.01	c # assignAt Calls = 140731487
2519.78/2520.01	c # removeAt Calls = 604300265
2519.78/2520.01	c # Run = 39165
2519.78/2520.01	c # Conflicts = 28271476
2519.78/2520.01	c # Memory used = 308.92 Mb
2519.78/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9594 MiB free)
  memory of node 1: 16384 MiB (9173 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299341-1532785251/watcher-4299341-1532785251 -o /tmp/evaluation-result-4299341-1532785251/solver-4299341-1532785251 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580 nacre_mini_release HOME/instance-4299341-1532785251.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=28047, runsolver pid=28044
Current StackSize limit: 8192 KiB


[startup+0.100107 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19217440/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=27432 memory=4256 CPUtime=0.1 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 1230 0 0 0 10 0 0 0 20 0 1 0 96088307 28090368 1064 33554432000 4194304 4933779 140724059387152 140724059384152 140546934524901 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 6858 1064 610 181 0 475 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27432 KiB
Current children cumulated memory: 4256 KiB

[startup+0.209319 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19215952/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=28776 memory=5504 CPUtime=0.21 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 1552 0 0 0 21 0 0 0 20 0 1 0 96088307 29466624 1376 33554432000 4194304 4933779 140724059387152 140724059384152 140546934524901 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 7194 1376 610 181 0 811 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 28776 KiB
Current children cumulated memory: 5504 KiB

[startup+0.308799 s]*
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19214836/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=30032 memory=6560 CPUtime=0.31 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 1832 0 0 0 31 0 0 0 20 0 1 0 96088307 30752768 1640 33554432000 4194304 4933779 140724059387152 140724059384152 140546934524901 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 7508 1640 610 181 0 1125 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30032 KiB
Current children cumulated memory: 6560 KiB

[startup+0.700251 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19212728/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=34296 memory=10696 CPUtime=0.69 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 2937 0 0 0 69 0 0 0 20 0 1 0 96088307 35119104 2674 33554432000 4194304 4933779 140724059387152 140724059384920 4364107 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 8574 2674 610 181 0 2191 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 34296 KiB
Current children cumulated memory: 10696 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19208204/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=39788 memory=16240 CPUtime=1.49 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 4327 0 0 0 149 0 0 0 20 0 1 0 96088307 40742912 4060 33554432000 4194304 4933779 140724059387152 140724059384840 140546934524901 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 9947 4060 610 181 0 3564 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 39788 KiB
Current children cumulated memory: 16240 KiB

[startup+3.10934 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19200584/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=44904 memory=21052 CPUtime=3.1 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 9340 0 0 0 309 1 0 0 20 0 1 0 96088307 45981696 5263 33554432000 4194304 4933779 140724059387152 140724059384840 4475748 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 11226 5263 610 181 0 4843 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 44904 KiB
Current children cumulated memory: 21052 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19194712/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=50592 memory=26640 CPUtime=6.28 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 15646 0 0 0 627 1 0 0 20 0 1 0 96088307 51806208 6660 33554432000 4194304 4933779 140724059387152 140724059384840 4437370 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 12648 6660 610 181 0 6265 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 50592 KiB
Current children cumulated memory: 26640 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19186528/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=58792 memory=34016 CPUtime=12.69 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 24087 0 0 0 1267 2 0 0 20 0 1 0 96088307 60203008 8504 33554432000 4194304 4933779 140724059387152 140724059384840 4437393 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 14698 8504 610 181 0 8315 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 58792 KiB
Current children cumulated memory: 34016 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 28048
/proc/meminfo: memFree=19174748/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=67616 memory=42792 CPUtime=25.48 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 43679 0 0 0 2546 2 0 0 20 0 1 0 96088307 69238784 10698 33554432000 4194304 4933779 140724059387152 140724059384664 4365264 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 16904 10698 610 181 0 10521 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 67616 KiB
Current children cumulated memory: 42792 KiB

[startup+51.1095 s]
/proc/loadavg: 2.34 2.09 2.07 3/188 28048
/proc/meminfo: memFree=19153048/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=84872 memory=59900 CPUtime=51.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 60371 0 0 0 5105 4 0 0 20 0 1 0 96088307 86908928 14975 33554432000 4194304 4933779 140724059387152 140724059384664 4437567 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 21218 14975 610 181 0 14835 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 84872 KiB
Current children cumulated memory: 59900 KiB

[startup+102.3 s]
/proc/loadavg: 2.37 2.15 2.09 3/188 28049
/proc/meminfo: memFree=19125780/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=106624 memory=79368 CPUtime=102.26 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 81766 0 0 0 10220 6 0 0 20 0 1 0 96088307 109182976 19842 33554432000 4194304 4933779 140724059387152 140724059384840 4437393 0 0 4096 24578 0 0 0 17 0 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 26656 19842 610 181 0 20273 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 106624 KiB
Current children cumulated memory: 79368 KiB

[startup+162.3 s]
/proc/loadavg: 2.14 2.13 2.08 3/188 28050
/proc/meminfo: memFree=19102848/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=121740 memory=95348 CPUtime=162.26 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 105774 0 0 0 16218 8 0 0 20 0 1 0 96088307 124661760 23837 33554432000 4194304 4933779 140724059387152 140724059384840 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 30435 23837 610 181 0 24052 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 121740 KiB
Current children cumulated memory: 95348 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.09 2.07 3/188 28844
/proc/meminfo: memFree=20087680/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=134988 memory=108928 CPUtime=222.23 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 132615 0 0 0 22213 10 0 0 20 0 1 0 96088307 138227712 27232 33554432000 4194304 4933779 140724059387152 140724059384840 4437839 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 33747 27232 610 181 0 27364 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 134988 KiB
Current children cumulated memory: 108928 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.07 2.06 3/187 28845
/proc/meminfo: memFree=20058336/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=147356 memory=123128 CPUtime=282.21 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 142391 0 0 0 28210 11 0 0 20 0 1 0 96088307 150892544 30782 33554432000 4194304 4933779 140724059387152 140724059384840 140546940726280 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 36839 30782 610 181 0 30456 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 147356 KiB
Current children cumulated memory: 123128 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 28846
/proc/meminfo: memFree=20037512/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=159060 memory=134392 CPUtime=342.21 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 148802 0 0 0 34209 12 0 0 20 0 1 0 96088307 162877440 33598 33554432000 4194304 4933779 140724059387152 140724059384840 4436144 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 39765 33598 610 181 0 33382 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 159060 KiB
Current children cumulated memory: 134392 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/187 28847
/proc/meminfo: memFree=20018852/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=167604 memory=143100 CPUtime=402.2 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 156721 0 0 0 40207 13 0 0 20 0 1 0 96088307 171626496 35775 33554432000 4194304 4933779 140724059387152 140724059384840 4357325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 41901 35775 610 181 0 35518 0
Current children cumulated CPU time: 402.2 s
Current children cumulated vsize: 167604 KiB
Current children cumulated memory: 143100 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 28848
/proc/meminfo: memFree=20000372/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=181728 memory=153544 CPUtime=462.19 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 161138 0 0 0 46206 13 0 0 20 0 1 0 96088307 186089472 38386 33554432000 4194304 4933779 140724059387152 140724059384840 4365286 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 45432 38386 610 181 0 39049 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 181728 KiB
Current children cumulated memory: 153544 KiB


################
# More data... #
################

/proc/28047/statm: 72058 66124 610 181 0 65675 0
Current children cumulated CPU time: 1722.11 s
Current children cumulated vsize: 288232 KiB
Current children cumulated memory: 264496 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/187 28916
/proc/meminfo: memFree=19791516/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=291976 memory=268288 CPUtime=1782.11 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 258289 0 0 0 178191 20 0 0 20 0 1 0 96088307 298983424 67072 33554432000 4194304 4933779 140724059387152 140724059384840 4436080 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 72994 67072 610 181 0 66611 0
Current children cumulated CPU time: 1782.11 s
Current children cumulated vsize: 291976 KiB
Current children cumulated memory: 268288 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 28917
/proc/meminfo: memFree=19786132/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=295736 memory=272092 CPUtime=1842.11 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 259341 0 0 0 184191 20 0 0 20 0 1 0 96088307 302833664 68023 33554432000 4194304 4933779 140724059387152 140724059384840 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 73934 68023 610 181 0 67551 0
Current children cumulated CPU time: 1842.11 s
Current children cumulated vsize: 295736 KiB
Current children cumulated memory: 272092 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28918
/proc/meminfo: memFree=19780636/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=299396 memory=275628 CPUtime=1902.1 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 264592 0 0 0 190190 20 0 0 20 0 1 0 96088307 306581504 68907 33554432000 4194304 4933779 140724059387152 140724059384840 140546940726245 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 74849 68907 610 181 0 68466 0
Current children cumulated CPU time: 1902.1 s
Current children cumulated vsize: 299396 KiB
Current children cumulated memory: 275628 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28919
/proc/meminfo: memFree=19775104/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=303308 memory=279736 CPUtime=1962.1 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 270704 0 0 0 196189 21 0 0 20 0 1 0 96088307 310587392 69934 33554432000 4194304 4933779 140724059387152 140724059384840 140546935381643 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 75827 69934 610 181 0 69444 0
Current children cumulated CPU time: 1962.1 s
Current children cumulated vsize: 303308 KiB
Current children cumulated memory: 279736 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28920
/proc/meminfo: memFree=19770688/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=307880 memory=283852 CPUtime=2022.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 273060 0 0 0 202188 21 0 0 20 0 1 0 96088307 315269120 70963 33554432000 4194304 4933779 140724059387152 140724059384840 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 76970 70963 610 181 0 70587 0
Current children cumulated CPU time: 2022.09 s
Current children cumulated vsize: 307880 KiB
Current children cumulated memory: 283852 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28921
/proc/meminfo: memFree=19764452/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=311832 memory=287636 CPUtime=2082.1 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 276276 0 0 0 208188 22 0 0 20 0 1 0 96088307 319315968 71909 33554432000 4194304 4933779 140724059387152 140724059384840 4436080 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 77958 71909 610 181 0 71575 0
Current children cumulated CPU time: 2082.1 s
Current children cumulated vsize: 311832 KiB
Current children cumulated memory: 287636 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28922
/proc/meminfo: memFree=19759060/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=314764 memory=290620 CPUtime=2142.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 279766 0 0 0 214187 22 0 0 20 0 1 0 96088307 322318336 72655 33554432000 4194304 4933779 140724059387152 140724059384840 4421792 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 78691 72655 610 181 0 72308 0
Current children cumulated CPU time: 2142.09 s
Current children cumulated vsize: 314764 KiB
Current children cumulated memory: 290620 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28923
/proc/meminfo: memFree=19754572/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=319368 memory=294624 CPUtime=2202.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 284277 0 0 0 220187 22 0 0 20 0 1 0 96088307 327032832 73656 33554432000 4194304 4933779 140724059387152 140724059384840 140546935381647 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 79842 73656 610 181 0 73459 0
Current children cumulated CPU time: 2202.09 s
Current children cumulated vsize: 319368 KiB
Current children cumulated memory: 294624 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28924
/proc/meminfo: memFree=19748248/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=321692 memory=296840 CPUtime=2262.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 288886 0 0 0 226186 23 0 0 20 0 1 0 96088307 329412608 74210 33554432000 4194304 4933779 140724059387152 140724059384840 4335849 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 80423 74210 610 181 0 74040 0
Current children cumulated CPU time: 2262.09 s
Current children cumulated vsize: 321692 KiB
Current children cumulated memory: 296840 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28925
/proc/meminfo: memFree=19740972/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=323872 memory=300300 CPUtime=2322.09 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 290865 0 0 0 232185 24 0 0 20 0 1 0 96088307 331644928 75075 33554432000 4194304 4933779 140724059387152 140724059384840 4437393 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 80968 75075 610 181 0 74585 0
Current children cumulated CPU time: 2322.09 s
Current children cumulated vsize: 323872 KiB
Current children cumulated memory: 300300 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28933
/proc/meminfo: memFree=19736208/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=326232 memory=302924 CPUtime=2382.08 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 293282 0 0 0 238184 24 0 0 20 0 1 0 96088307 334061568 75731 33554432000 4194304 4933779 140724059387152 140724059384840 4437416 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 81558 75731 610 181 0 75175 0
Current children cumulated CPU time: 2382.08 s
Current children cumulated vsize: 326232 KiB
Current children cumulated memory: 302924 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28934
/proc/meminfo: memFree=19731048/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=329580 memory=305928 CPUtime=2442.08 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 296782 0 0 0 244184 24 0 0 20 0 1 0 96088307 337489920 76482 33554432000 4194304 4933779 140724059387152 140724059384840 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 82395 76482 610 181 0 76012 0
Current children cumulated CPU time: 2442.08 s
Current children cumulated vsize: 329580 KiB
Current children cumulated memory: 305928 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 28935
/proc/meminfo: memFree=19726876/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=331912 memory=308240 CPUtime=2502.08 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 300315 0 0 0 250184 24 0 0 20 0 1 0 96088307 339877888 77060 33554432000 4194304 4933779 140724059387152 140724059384840 4436080 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 82978 77060 610 181 0 76595 0
Current children cumulated CPU time: 2502.08 s
Current children cumulated vsize: 331912 KiB
Current children cumulated memory: 308240 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 28935
/proc/meminfo: memFree=19725884/32770624 swapFree=67108860/67108860
[pid=28047] ppid=28044 vsize=332540 memory=308860 CPUtime=2519.78 cores=0,2,4,6
/proc/28047/stat : 28047 (nacre_mini_rele) R 28044 28047 26996 0 -1 4202496 300755 0 0 0 251954 24 0 0 20 0 1 0 96088307 340520960 77215 33554432000 4194304 4933779 140724059387152 140724059384840 4437389 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 7680000 140724059395224 140724059395324 140724059395324 140724059398082 0
/proc/28047/statm: 83135 77215 610 181 0 76752 0
Current children cumulated CPU time: 2519.78 s
Current children cumulated vsize: 332540 KiB
Current children cumulated memory: 308860 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 28047 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.55 s, system=0.249991 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.01
CPU time (s): 2519.8
CPU user time (s): 2519.55
CPU system time (s): 0.249991
CPU usage (%): 99.9916
Max. virtual memory (cumulated for all children) (KiB): 332540
Max. memory (cumulated for all children) (KiB): 308860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.55
system time used= 0.249991
maximum resident set size= 308980
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 300798
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 149
involuntary context switches= 3229


# summary of solver processes directly reported to runsolver:
#   pid: 28047
#   total CPU time (s): 2519.8
#   total CPU user time (s): 2519.55
#   total CPU system time (s): 0.249991

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.069 second user time and 17.5133 second system time

The end

Launcher Data 

Begin job on node103 at 2018-07-28 15:40:51
IDJOB=4299341
IDBENCH=141348
IDSOLVER=2764
FILE ID=node103/4299341-1532785251
RUNJOBID= node103-1532775163-27027
PBS_JOBID= 21022463
Free space on /tmp= 56536 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Langford/LangfordBin-09_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299341-1532785251/watcher-4299341-1532785251 -o /tmp/evaluation-result-4299341-1532785251/solver-4299341-1532785251 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1532775163-27027 --watchdog 2580  nacre_mini_release HOME/instance-4299341-1532785251.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= af6539439e5a66b9d4cb5cb754e7ed18
RANDOM SEED=2103150043

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        19219288 kB
MemAvailable:   30917260 kB
Buffers:          302512 kB
Cached:         11579212 kB
SwapCached:            0 kB
Active:          4925628 kB
Inactive:        8021636 kB
Active(anon):    1068136 kB
Inactive(anon):    25184 kB
Active(file):    3857492 kB
Inactive(file):  7996452 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:               820 kB
Writeback:             0 kB
AnonPages:       1071708 kB
Mapped:            44092 kB
Shmem:             25228 kB
Slab:             300072 kB
SReclaimable:     272488 kB
SUnreclaim:        27584 kB
KernelStack:        3296 kB
PageTables:         7124 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1363016 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    892928 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56536 MiB
End job on node103 at 2018-07-28 16:22:51