Trace number 4294892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.77 2520.09

General information on the benchmark

NameCrossword/
Crossword-m18-ogd2008-vg-13-14_c18.xml
MD5SUM1e3f313ec943efeca8787f022e591dae
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables182
Number of constraints27
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":182}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":182}]
Minimum constraint arity13
Maximum constraint arity14
Distribution of constraint arities[{"arity":13,"count":14},{"arity":14,"count":13}]
Number of extensional constraints27
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":27}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (7022 MiB free)
  memory of node 1: 16384 MiB (7964 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4294892-1532455994/watcher-4294892-1532455994 -o /tmp/evaluation-result-4294892-1532455994/solver-4294892-1532455994 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580 xcsp_picat HOME/instance-4294892-1532455994.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1236, runsolver pid=1233

[startup+0.100213 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 1237
/proc/meminfo: memFree=15330660/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=111688 memory=17744 CPUtime=0.1 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 1566 0 0 0 10 0 0 0 20 0 1 0 63162596 114368512 4436 33554432000 4194304 5849740 140730192872768 140730192872768 140228498263040 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 27922 4436 591 405 0 24866 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 17744 KiB

[startup+0.209808 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 1237
/proc/meminfo: memFree=15324516/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=111688 memory=23888 CPUtime=0.21 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 1569 0 0 0 21 0 0 0 20 0 1 0 63162596 114368512 5972 33554432000 4194304 5849740 140730192872768 140730192872768 4553008 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 27922 5972 591 405 0 24866 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 23888 KiB

[startup+0.309773 s]*
/proc/loadavg: 2.00 2.02 2.05 3/190 1237
/proc/meminfo: memFree=15318108/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=139240 memory=36340 CPUtime=0.3 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 2591 0 0 0 30 0 0 0 20 0 1 0 63162596 142581760 9085 33554432000 4194304 5849740 140730192872768 140730192872768 5251112 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 34810 9085 595 405 0 31754 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 139240 KiB
Current children cumulated memory: 36340 KiB

[startup+0.700385 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=15307996/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=139240 memory=48628 CPUtime=0.69 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 2603 0 0 0 69 0 0 0 20 0 1 0 63162596 142581760 12157 33554432000 4194304 5849740 140730192872768 140730192872768 4488915 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 34810 12157 595 405 0 31754 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 139240 KiB
Current children cumulated memory: 48628 KiB

[startup+1.50045 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=15271344/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=221256 memory=139256 CPUtime=1.49 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 5104 0 0 0 146 3 0 0 20 0 1 0 63162596 226566144 34814 33554432000 4194304 5849740 140730192872768 140730192872072 4491931 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 55314 34814 623 405 0 52258 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 221256 KiB
Current children cumulated memory: 139256 KiB

[startup+3.10993 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=15148908/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=252596 memory=201284 CPUtime=3.1 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 8083 0 0 0 305 5 0 0 20 0 1 0 63162596 258658304 50321 33554432000 4194304 5849740 140730192872768 140730192872088 5249600 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 63149 50321 627 405 0 60093 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 252596 KiB
Current children cumulated memory: 201284 KiB

[startup+6.30046 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=14948592/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=531712 memory=402068 CPUtime=6.29 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 12052 0 0 0 618 11 0 0 20 0 1 0 63162596 544473088 100517 33554432000 4194304 5849740 140730192872768 140730192872088 4515937 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 132928 100517 628 405 0 129872 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 531712 KiB
Current children cumulated memory: 402068 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=14430400/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=1504612 memory=1024296 CPUtime=12.69 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 20014 0 0 0 1242 27 0 0 20 0 1 0 63162596 1540722688 256074 33554432000 4194304 5849740 140730192872768 140730192871944 140228497872800 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 376153 256074 673 405 0 373097 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 1504612 KiB
Current children cumulated memory: 1024296 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=12132076/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=3470692 memory=3211036 CPUtime=25.49 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23559 0 0 0 2486 63 0 0 20 0 1 0 63162596 3553988608 802759 33554432000 4194304 5849740 140730192872768 140730192871944 5406003 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 867673 802759 673 405 0 864617 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 3470692 KiB
Current children cumulated memory: 3211036 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1237
/proc/meminfo: memFree=9871976/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=5725288 memory=5465676 CPUtime=51.1 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 246465 0 0 0 4994 116 0 0 20 0 1 0 63162596 5862694912 1366419 33554432000 4194304 5849740 140730192872768 140730192871640 5391836 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1431322 1366419 684 405 0 1428266 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 5725288 KiB
Current children cumulated memory: 5465676 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1238
/proc/meminfo: memFree=8821396/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514308 CPUtime=102.28 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 805095 0 0 0 10072 156 0 0 20 0 1 0 63162596 6936436736 1628577 33554432000 4194304 5849740 140730192872768 140730192871768 5438164 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628577 698 405 0 1690410 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514308 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1239
/proc/meminfo: memFree=8821616/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=162.28 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 1491209 0 0 0 16036 192 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871640 5312596 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 1240
/proc/meminfo: memFree=8821460/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=222.27 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 2236854 0 0 0 22003 224 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 140228498284423 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 1242
/proc/meminfo: memFree=8821712/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=282.27 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 3083112 0 0 0 27963 264 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 1243
/proc/meminfo: memFree=8821800/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=342.27 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 3861872 0 0 0 33928 299 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437560 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/191 1245
/proc/meminfo: memFree=8821644/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=402.26 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 4646353 0 0 0 39890 336 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871640 5391995 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/191 1253
/proc/meminfo: memFree=8821956/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=462.26 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 5500499 0 0 0 45852 374 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871928 5437695 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB


################
# More data... #
################

/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/193 1355
/proc/meminfo: memFree=11383992/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=1782.13 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 19497643 0 0 0 177110 1103 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 1782.13 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/193 1356
/proc/meminfo: memFree=11383904/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=1842.11 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 19916867 0 0 0 183081 1130 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 1842.11 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/193 1357
/proc/meminfo: memFree=11384184/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=1902.09 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 20310235 0 0 0 189055 1154 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5335519 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 1902.09 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+1962.3 s]
/proc/loadavg: 2.07 2.04 2.05 3/191 1358
/proc/meminfo: memFree=11383952/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=1962.08 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 20657023 0 0 0 195034 1174 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5438192 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 1962.08 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2022.3 s]
/proc/loadavg: 2.09 2.05 2.05 3/191 1359
/proc/meminfo: memFree=10334260/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2022.06 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 21109443 0 0 0 201008 1198 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871480 5322673 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2022.06 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2082.3 s]
/proc/loadavg: 2.15 2.07 2.05 3/190 1360
/proc/meminfo: memFree=10333872/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2082.05 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 21550010 0 0 0 206982 1223 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2082.05 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2142.3 s]
/proc/loadavg: 2.05 2.06 2.05 3/190 1361
/proc/meminfo: memFree=10333640/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2142.03 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 22038160 0 0 0 212955 1248 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437644 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2142.03 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2202.3 s]
/proc/loadavg: 2.10 2.08 2.05 3/190 1362
/proc/meminfo: memFree=10334656/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2202.02 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 22394946 0 0 0 218933 1269 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437560 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2202.02 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2262.3 s]
/proc/loadavg: 2.04 2.06 2.05 3/190 1370
/proc/meminfo: memFree=10333236/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2262.01 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 22808451 0 0 0 224905 1296 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2262.01 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/190 1371
/proc/meminfo: memFree=10334824/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2322 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23036757 0 0 0 230886 1314 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 140228498284423 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2322 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2382.3 s]
/proc/loadavg: 2.07 2.06 2.05 3/190 1372
/proc/meminfo: memFree=10334908/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2381.99 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23356027 0 0 0 236866 1333 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437607 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2381.99 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2442.3 s]
/proc/loadavg: 2.03 2.05 2.05 3/190 1373
/proc/meminfo: memFree=10334960/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2441.97 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23495688 0 0 0 242851 1346 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437821 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2441.97 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

[startup+2502.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/190 1374
/proc/meminfo: memFree=11385656/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2501.97 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23733952 0 0 0 248831 1366 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871768 5437698 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2501.97 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.01 2.04 2.05 3/190 1376
/proc/meminfo: memFree=11385220/32770624 swapFree=67108860/67108860
[pid=1236] ppid=1233 vsize=6773864 memory=6514316 CPUtime=2519.67 cores=0,2,4,6
/proc/1236/stat : 1236 (xcsp_picat) R 1233 1236 27337 0 -1 4202496 23741936 0 0 0 250598 1369 0 0 20 0 1 0 63162596 6936436736 1628579 33554432000 4194304 5849740 140730192872768 140730192871480 140228498284423 0 0 4096 8389634 0 0 0 17 4 0 0 0 0 0 7949816 9399828 46870528 140730192880822 140730192880900 140730192880900 140730192883658 0
/proc/1236/statm: 1693466 1628579 700 405 0 1690410 0
Current children cumulated CPU time: 2519.67 s
Current children cumulated vsize: 6773864 KiB
Current children cumulated memory: 6514316 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.09 s]
# the end of solver process 1236 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.99 s, system=13.7809 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.09
CPU time (s): 2519.77
CPU user time (s): 2505.99
CPU system time (s): 13.7809
CPU usage (%): 99.9871
Max. virtual memory (cumulated for all children) (KiB): 6923748
Max. memory (cumulated for all children) (KiB): 6664152

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.99
system time used= 13.7809
maximum resident set size= 6664152
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23741936
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 221
involuntary context switches= 3874


# summary of solver processes directly reported to runsolver:
#   pid: 1236
#   total CPU time (s): 2519.77
#   total CPU user time (s): 2505.99
#   total CPU system time (s): 13.7809

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.10791 second user time and 19.7325 second system time

The end

Launcher Data 

Begin job on node132 at 2018-07-24 20:13:14
IDJOB=4294892
IDBENCH=141441
IDSOLVER=2754
FILE ID=node132/4294892-1532455994
RUNJOBID= node132-1532432860-27368
PBS_JOBID= 21021577
Free space on /tmp= 52468 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/Crossword/Crossword-m18-ogd2008-vg-13-14_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4294892-1532455994/watcher-4294892-1532455994 -o /tmp/evaluation-result-4294892-1532455994/solver-4294892-1532455994 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580  xcsp_picat HOME/instance-4294892-1532455994.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1e3f313ec943efeca8787f022e591dae
RANDOM SEED=1606275340

node132.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        15346520 kB
MemAvailable:   25911292 kB
Buffers:          186424 kB
Cached:         10542256 kB
SwapCached:            0 kB
Active:          8579348 kB
Inactive:        8221360 kB
Active(anon):    6020452 kB
Inactive(anon):    70696 kB
Active(file):    2558896 kB
Inactive(file):  8150664 kB
Unevictable:        7020 kB
Mlocked:            7020 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              6936 kB
Writeback:             0 kB
AnonPages:       6018364 kB
Mapped:            40992 kB
Shmem:             17056 kB
Slab:             311296 kB
SReclaimable:     283672 kB
SUnreclaim:        27624 kB
KernelStack:        3392 kB
PageTables:        17212 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    6665388 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2791424 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 52460 MiB
End job on node132 at 2018-07-24 20:55:14