Trace number 4299794

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.4? (TO) 2519.94 2520.02

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-11-12_c18.xml
MD5SUM996bcdf4a135147c7f2ba7242cc18cd5
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables132
Number of constraints23
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":132}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":132}]
Minimum constraint arity11
Maximum constraint arity12
Distribution of constraint arities[{"arity":11,"count":12},{"arity":12,"count":11}]
Number of extensional constraints23
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":23}]
Optimization problemNO
Type of objective

Solver Data 

1.39/1.45	c NACRE 1.0.4
2519.92/2520.01	c
2519.92/2520.01	c # time = 2519.92
2519.92/2520.01	c # Dec = 210113
2519.92/2520.01	c # Propagate Calls = 12103867
2519.92/2520.01	c # assignAt Calls = 261009
2519.92/2520.01	c # removeAt Calls = 197008027
2519.92/2520.01	c # Run = 510
2519.92/2520.01	c # Conflicts = 203350
2519.92/2520.01	c # Memory used = 446.744 Mb
2519.92/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10269 MiB free)
  memory of node 1: 16384 MiB (15796 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299794-1532788712/watcher-4299794-1532788712 -o /tmp/evaluation-result-4299794-1532788712/solver-4299794-1532788712 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580 nacre_mini_release HOME/instance-4299794-1532788712.xml -ca -l100 -cm 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=31484, runsolver pid=31481
Current StackSize limit: 8192 KiB


[startup+0.100715 s]*
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26685660/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=31400 memory=7468 CPUtime=0.1 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 2429 0 0 0 10 0 0 0 20 0 1 0 96434357 32153600 1867 33554432000 4194304 4933779 140724076654160 140724076651736 139714287856613 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 7850 1867 558 181 0 1467 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 31400 KiB
Current children cumulated memory: 7468 KiB

[startup+0.209537 s]*
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26669888/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=58612 memory=33516 CPUtime=0.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 9311 0 0 0 20 1 0 0 20 0 1 0 96434357 60018688 8379 33554432000 4194304 4933779 140724076654160 140724076651736 4375509 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 14653 8379 568 181 0 8270 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 58612 KiB
Current children cumulated memory: 33516 KiB

[startup+0.30968 s]*
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26644608/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=75112 memory=49412 CPUtime=0.31 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 13750 0 0 0 29 2 0 0 20 0 1 0 96434357 76914688 12353 33554432000 4194304 4933779 140724076654160 140724076651736 4273636 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 18778 12353 571 181 0 12395 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 75112 KiB
Current children cumulated memory: 49412 KiB

[startup+0.700371 s]
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26612988/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=138036 memory=110600 CPUtime=0.69 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 29522 0 0 0 65 4 0 0 20 0 1 0 96434357 141348864 27650 33554432000 4194304 4933779 140724076654160 140724076648760 139714288294912 0 0 4096 0 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 34509 27650 571 181 0 28126 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 138036 KiB
Current children cumulated memory: 110600 KiB

[startup+1.50035 s]
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26548756/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229096 CPUtime=1.48 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 59647 0 0 0 141 7 0 0 20 0 1 0 96434357 265650176 57274 33554432000 4194304 4933779 140724076654160 140724076648760 139714287854397 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57274 581 181 0 58473 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229096 KiB

[startup+3.10939 s]
/proc/loadavg: 1.92 2.01 2.04 3/187 31485
/proc/meminfo: memFree=26463700/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229148 CPUtime=3.09 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 109531 0 0 0 300 9 0 0 20 0 1 0 96434357 265650176 57287 33554432000 4194304 4933779 140724076654160 140724076652680 4377379 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57287 593 181 0 58473 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229148 KiB

[startup+6.30036 s]
/proc/loadavg: 1.85 1.99 2.03 3/187 31485
/proc/meminfo: memFree=26459428/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229192 CPUtime=6.29 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 155048 0 0 0 617 12 0 0 20 0 1 0 96434357 265650176 57298 33554432000 4194304 4933779 140724076654160 140724076652680 4377382 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57298 604 181 0 58473 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229192 KiB

[startup+12.7004 s]
/proc/loadavg: 1.86 1.99 2.03 3/187 31485
/proc/meminfo: memFree=26450252/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229192 CPUtime=12.69 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 210201 0 0 0 1255 14 0 0 20 0 1 0 96434357 265650176 57298 33554432000 4194304 4933779 140724076654160 140724076652680 4377379 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57298 604 181 0 58473 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229192 KiB

[startup+25.5004 s]
/proc/loadavg: 1.89 1.99 2.03 3/187 31485
/proc/meminfo: memFree=26431884/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229192 CPUtime=25.48 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 285369 0 0 0 2530 18 0 0 20 0 1 0 96434357 265650176 57298 33554432000 4194304 4933779 140724076654160 140724076652680 139714288719399 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57298 604 181 0 58473 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229192 KiB

[startup+51.1095 s]
/proc/loadavg: 1.93 1.99 2.03 3/187 31485
/proc/meminfo: memFree=26411252/32770624 swapFree=67028300/67108860
[pid=31484] ppid=31481 vsize=259424 memory=229192 CPUtime=51.09 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 364836 0 0 0 5087 22 0 0 20 0 1 0 96434357 265650176 57298 33554432000 4194304 4933779 140724076654160 140724076652680 4377514 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 64856 57298 604 181 0 58473 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 259424 KiB
Current children cumulated memory: 229192 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/188 31494
/proc/meminfo: memFree=26379484/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=264964 memory=234492 CPUtime=102.27 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 421181 0 0 0 10202 25 0 0 20 0 1 0 96434357 271323136 58623 33554432000 4194304 4933779 140724076654160 140724076651912 139714288718855 0 0 4096 24578 0 0 0 17 5 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 66241 58623 604 181 0 59858 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 264964 KiB
Current children cumulated memory: 234492 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/188 31495
/proc/meminfo: memFree=26338664/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=287132 memory=259804 CPUtime=162.25 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 478851 0 0 0 16196 29 0 0 20 0 1 0 96434357 294023168 64951 33554432000 4194304 4933779 140724076654160 140724076651928 139714287855705 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 71783 64951 604 181 0 65400 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 287132 KiB
Current children cumulated memory: 259804 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 31496
/proc/meminfo: memFree=26301244/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=302976 memory=278284 CPUtime=222.25 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 515545 0 0 0 22193 32 0 0 20 0 1 0 96434357 310247424 69571 33554432000 4194304 4933779 140724076654160 140724076651912 139714288719399 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 75744 69571 604 181 0 69361 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 302976 KiB
Current children cumulated memory: 278284 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 31497
/proc/meminfo: memFree=26278228/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=314356 memory=290996 CPUtime=282.24 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 521534 0 0 0 28191 33 0 0 20 0 1 0 96434357 321900544 72749 33554432000 4194304 4933779 140724076654160 140724076651912 139714288721361 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 78589 72749 604 181 0 72206 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 314356 KiB
Current children cumulated memory: 290996 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 31498
/proc/meminfo: memFree=26260372/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=322924 memory=299640 CPUtime=342.23 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 526272 0 0 0 34189 34 0 0 20 0 1 0 96434357 330674176 74910 33554432000 4194304 4933779 140724076654160 140724076651928 139714294028448 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 80731 74910 604 181 0 74348 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 322924 KiB
Current children cumulated memory: 299640 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31499
/proc/meminfo: memFree=26240424/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=331384 memory=308156 CPUtime=402.23 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 532538 0 0 0 40189 34 0 0 20 0 1 0 96434357 339337216 77039 33554432000 4194304 4933779 140724076654160 140724076651864 139714288719409 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 82846 77039 604 181 0 76463 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 331384 KiB
Current children cumulated memory: 308156 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31500
/proc/meminfo: memFree=26224224/32770624 swapFree=67028304/67108860
[pid=31484] ppid=31481 vsize=338276 memory=314420 CPUtime=462.23 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 539314 0 0 0 46187 36 0 0 20 0 1 0 96434357 346394624 78605 33554432000 4194304 4933779 140724076654160 140724076651912 139714287849165 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 84569 78605 604 181 0 78186 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 338276 KiB
Current children cumulated memory: 314420 KiB


################
# More data... #
################

/proc/31484/statm: 109097 103294 604 181 0 102714 0
Current children cumulated CPU time: 1722.21 s
Current children cumulated vsize: 436388 KiB
Current children cumulated memory: 413176 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31561
/proc/meminfo: memFree=26009788/32770624 swapFree=67028312/67108860
[pid=31484] ppid=31481 vsize=440204 memory=416928 CPUtime=1782.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 675483 0 0 0 178166 54 0 0 20 0 1 0 96434357 450768896 104232 33554432000 4194304 4933779 140724076654160 140724076651864 139714288721361 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 110051 104232 604 181 0 103668 0
Current children cumulated CPU time: 1782.2 s
Current children cumulated vsize: 440204 KiB
Current children cumulated memory: 416928 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 31562
/proc/meminfo: memFree=26002720/32770624 swapFree=67028312/67108860
[pid=31484] ppid=31481 vsize=442868 memory=419568 CPUtime=1842.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 678948 0 0 0 184165 55 0 0 20 0 1 0 96434357 453496832 104892 33554432000 4194304 4933779 140724076654160 140724076651912 4377388 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 110717 104892 604 181 0 104334 0
Current children cumulated CPU time: 1842.2 s
Current children cumulated vsize: 442868 KiB
Current children cumulated memory: 419568 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 31571
/proc/meminfo: memFree=25994740/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=447312 memory=424096 CPUtime=1902.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 683603 0 0 0 190165 56 0 0 20 0 1 0 96434357 458047488 106024 33554432000 4194304 4933779 140724076654160 140724076651864 4377382 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 111828 106024 604 181 0 105445 0
Current children cumulated CPU time: 1902.21 s
Current children cumulated vsize: 447312 KiB
Current children cumulated memory: 424096 KiB

[startup+1962.3 s]
/proc/loadavg: 2.06 2.02 2.04 3/188 31635
/proc/meminfo: memFree=26187780/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=451196 memory=427004 CPUtime=1962.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 687971 0 0 0 196164 56 0 0 20 0 1 0 96434357 462024704 106751 33554432000 4194304 4933779 140724076654160 140724076651848 4377379 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 112799 106751 604 181 0 106416 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 451196 KiB
Current children cumulated memory: 427004 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.01 2.04 3/188 31636
/proc/meminfo: memFree=26117752/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=453192 memory=428916 CPUtime=2022.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 692001 0 0 0 202164 57 0 0 20 0 1 0 96434357 464068608 107229 33554432000 4194304 4933779 140724076654160 140724076651928 139714287849238 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 113298 107229 604 181 0 106915 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 453192 KiB
Current children cumulated memory: 428916 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.01 2.04 3/188 31637
/proc/meminfo: memFree=26054268/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=454492 memory=430236 CPUtime=2082.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 697522 0 0 0 208163 58 0 0 20 0 1 0 96434357 465399808 107559 33554432000 4194304 4933779 140724076654160 140724076651864 4377598 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 113623 107559 604 181 0 107240 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 454492 KiB
Current children cumulated memory: 430236 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/188 31638
/proc/meminfo: memFree=26004160/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=456888 memory=432596 CPUtime=2142.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 703457 0 0 0 214161 59 0 0 20 0 1 0 96434357 467853312 108149 33554432000 4194304 4933779 140724076654160 140724076651848 4377960 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 114222 108149 604 181 0 107839 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 456888 KiB
Current children cumulated memory: 432596 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31639
/proc/meminfo: memFree=25961932/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=458228 memory=434756 CPUtime=2202.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 705185 0 0 0 220161 59 0 0 20 0 1 0 96434357 469225472 108689 33554432000 4194304 4933779 140724076654160 140724076651912 139714288720935 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 114557 108689 604 181 0 108174 0
Current children cumulated CPU time: 2202.2 s
Current children cumulated vsize: 458228 KiB
Current children cumulated memory: 434756 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31640
/proc/meminfo: memFree=25934188/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=460120 memory=436820 CPUtime=2262.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 706888 0 0 0 226161 59 0 0 20 0 1 0 96434357 471162880 109205 33554432000 4194304 4933779 140724076654160 140724076651848 4377360 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 115030 109205 604 181 0 108647 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 460120 KiB
Current children cumulated memory: 436820 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31641
/proc/meminfo: memFree=25899500/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=461452 memory=438136 CPUtime=2322.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 708845 0 0 0 232161 60 0 0 20 0 1 0 96434357 472526848 109534 33554432000 4194304 4933779 140724076654160 140724076651864 4437393 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 115363 109534 604 181 0 108980 0
Current children cumulated CPU time: 2322.21 s
Current children cumulated vsize: 461452 KiB
Current children cumulated memory: 438136 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/186 31642
/proc/meminfo: memFree=25859000/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=464716 memory=441300 CPUtime=2382.2 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 711821 0 0 0 238160 60 0 0 20 0 1 0 96434357 475869184 110325 33554432000 4194304 4933779 140724076654160 140724076651864 4377591 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 116179 110325 604 181 0 109796 0
Current children cumulated CPU time: 2382.2 s
Current children cumulated vsize: 464716 KiB
Current children cumulated memory: 441300 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31644
/proc/meminfo: memFree=25832464/32770624 swapFree=67028320/67108860
[pid=31484] ppid=31481 vsize=466852 memory=443580 CPUtime=2442.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 714184 0 0 0 244160 61 0 0 20 0 1 0 96434357 478056448 110895 33554432000 4194304 4933779 140724076654160 140724076651912 4377382 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 116713 110895 604 181 0 110330 0
Current children cumulated CPU time: 2442.21 s
Current children cumulated vsize: 466852 KiB
Current children cumulated memory: 443580 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 31652
/proc/meminfo: memFree=25798108/32770624 swapFree=67028324/67108860
[pid=31484] ppid=31481 vsize=469876 memory=446620 CPUtime=2502.21 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 717495 0 0 0 250160 61 0 0 20 0 1 0 96434357 481153024 111655 33554432000 4194304 4933779 140724076654160 140724076651864 139714287854397 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 117469 111655 604 181 0 111086 0
Current children cumulated CPU time: 2502.21 s
Current children cumulated vsize: 469876 KiB
Current children cumulated memory: 446620 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.04 3/187 31653
/proc/meminfo: memFree=25786288/32770624 swapFree=67028324/67108860
[pid=31484] ppid=31481 vsize=470008 memory=446744 CPUtime=2519.92 cores=1,3,5,7
/proc/31484/stat : 31484 (nacre_mini_rele) R 31481 31484 29912 0 -1 4202496 717808 0 0 0 251931 61 0 0 20 0 1 0 96434357 481288192 111686 33554432000 4194304 4933779 140724076654160 140724076651864 4377379 0 0 4096 24578 0 0 0 17 1 0 0 0 0 0 7034520 7039168 35004416 140724076655768 140724076655868 140724076655868 140724076658626 0
/proc/31484/statm: 117502 111686 604 181 0 111119 0
Current children cumulated CPU time: 2519.92 s
Current children cumulated vsize: 470008 KiB
Current children cumulated memory: 446744 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.02 s]
# the end of solver process 31484 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.31 s, system=0.621994 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 2520.02
CPU time (s): 2519.94
CPU user time (s): 2519.31
CPU system time (s): 0.621994
CPU usage (%): 99.9968
Max. virtual memory (cumulated for all children) (KiB): 470008
Max. memory (cumulated for all children) (KiB): 446744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.31
system time used= 0.621994
maximum resident set size= 446828
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 717853
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 72
involuntary context switches= 2462


# summary of solver processes directly reported to runsolver:
#   pid: 31484
#   total CPU time (s): 2519.94
#   total CPU user time (s): 2519.31
#   total CPU system time (s): 0.621994

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0602 second user time and 18.2456 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-28 16:38:32
IDJOB=4299794
IDBENCH=141445
IDSOLVER=2764
FILE ID=node102/4299794-1532788712
RUNJOBID= node102-1532776103-29944
PBS_JOBID= 21022470
Free space on /tmp= 52740 MiB

SOLVER NAME= NACRE 1.0.4
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-11-12_c18.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299794-1532788712/watcher-4299794-1532788712 -o /tmp/evaluation-result-4299794-1532788712/solver-4299794-1532788712 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532776103-29944 --watchdog 2580  nacre_mini_release HOME/instance-4299794-1532788712.xml -ca -l100 -cm

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 996bcdf4a135147c7f2ba7242cc18cd5
RANDOM SEED=488928208

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26691380 kB
MemAvailable:   31837376 kB
Buffers:          214444 kB
Cached:          5186976 kB
SwapCached:        53432 kB
Active:          1309576 kB
Inactive:        4269640 kB
Active(anon):     103624 kB
Inactive(anon):    99048 kB
Active(file):    1205952 kB
Inactive(file):  4170592 kB
Unevictable:        6644 kB
Mlocked:            6644 kB
SwapTotal:      67108860 kB
SwapFree:       67028300 kB
Dirty:              6596 kB
Writeback:             0 kB
AnonPages:        131624 kB
Mapped:            36760 kB
Shmem:             22076 kB
Slab:             198948 kB
SReclaimable:     170572 kB
SUnreclaim:        28376 kB
KernelStack:        3360 kB
PageTables:         5796 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     451176 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52740 MiB
End job on node102 at 2018-07-28 17:20:32