Trace number 4407856

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.09 2400.11

General information on the benchmark

NameCrossword/Crossword-m1c-uk-vg/
Crossword-m1c-uk-vg-8-9.xml
MD5SUMd0b0eed1d6d204767f77a0623277ccee
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables72
Number of constraints17
Number of domains1
Minimum domain size26
Maximum domain size26
Distribution of domain sizes[{"size":26,"count":72}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":72}]
Minimum constraint arity8
Maximum constraint arity9
Distribution of constraint arities[{"arity":8,"count":9},{"arity":9,"count":8}]
Number of extensional constraints17
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":17}]
Optimization problemNO
Type of objective

Solver Data 

237.69/237.70	c xcsp_picat version 2.7b12 (9/12/2019)

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11340 MiB free)
  memory of node 1: 16384 MiB (12586 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407856-1569513917/watcher-4407856-1569513917 -o /var/tmp/evaluation-result-4407856-1569513917/solver-4407856-1569513917 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node124-1569509600-16880 --watchdog 2560 xcsp_picat HOME/instance-4407856-1569513917.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=18092, runsolver pid=18089

[startup+0.100163 s]*
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=24485980/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2031716 memory=18092 CPUtime=0.1 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1654 0 0 0 10 0 0 0 20 0 1 0 527331709 2080477184 4523 33554432000 4194304 5870510 140731944612336 140731944609480 140263414664192 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 507929 4523 827 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 18092 KiB

[startup+0.209753 s]*
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=24475740/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2031716 memory=26284 CPUtime=0.21 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1664 0 0 0 21 0 0 0 20 0 1 0 527331709 2080477184 6571 33554432000 4194304 5870510 140731944612336 140731944609480 4515292 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 507929 6571 827 410 0 503402 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 26284 KiB

[startup+0.309662 s]*
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=24465500/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2031716 memory=36524 CPUtime=0.31 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1669 0 0 0 31 0 0 0 20 0 1 0 527331709 2080477184 9131 33554432000 4194304 5870510 140731944612336 140731944609480 4459041 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 507929 9131 827 410 0 503402 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 36524 KiB

[startup+0.700373 s]
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=24451040/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2031716 memory=67440 CPUtime=0.69 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1684 0 0 0 68 1 0 0 20 0 1 0 527331709 2080477184 16860 33554432000 4194304 5870510 140731944612336 140731944611640 4695044 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 507929 16860 840 410 0 503402 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 67440 KiB

[startup+1.50037 s]
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=24391532/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2031716 memory=206792 CPUtime=1.49 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1774 0 0 0 146 3 0 0 20 0 1 0 527331709 2080477184 51698 33554432000 4194304 5870510 140731944612336 140731944611640 4529714 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 507929 51698 861 410 0 503402 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 206792 KiB

[startup+3.11009 s]
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=23868476/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2389840 memory=620040 CPUtime=3.1 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 3963 0 0 0 300 10 0 0 20 0 1 0 527331709 2447196160 155010 33554432000 4194304 5870510 140731944612336 140731944611176 4459041 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 597460 155010 866 410 0 592933 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2389840 KiB
Current children cumulated memory: 620040 KiB

[startup+6.30034 s]
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=23645812/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2589024 memory=870408 CPUtime=6.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 18157 0 0 0 612 17 0 0 20 0 1 0 527331709 2651160576 217602 33554432000 4194304 5870510 140731944612336 140731944611176 5307553 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 647256 217602 876 410 0 642729 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2589024 KiB
Current children cumulated memory: 870408 KiB

[startup+12.7004 s]
/proc/loadavg: 2.03 2.00 2.00 3/201 18093
/proc/meminfo: memFree=23526768/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2674564 memory=958700 CPUtime=12.68 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 28578 0 0 0 1250 18 0 0 20 0 1 0 527331709 2738753536 239675 33554432000 4194304 5870510 140731944612336 140731944611224 5321680 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 668641 239675 882 410 0 664114 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 2674564 KiB
Current children cumulated memory: 958700 KiB

[startup+25.5004 s]
/proc/loadavg: 2.02 2.00 2.00 3/201 18093
/proc/meminfo: memFree=23533180/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2674564 memory=958720 CPUtime=25.49 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 44499 0 0 0 2530 19 0 0 20 0 1 0 527331709 2738753536 239680 33554432000 4194304 5870510 140731944612336 140731944611224 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 668641 239680 882 410 0 664114 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2674564 KiB
Current children cumulated memory: 958720 KiB

[startup+51.1097 s]
/proc/loadavg: 2.01 2.00 2.00 3/200 18096
/proc/meminfo: memFree=23540092/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2674564 memory=959760 CPUtime=51.1 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 65091 0 0 0 5090 20 0 0 20 0 1 0 527331709 2738753536 239940 33554432000 4194304 5870510 140731944612336 140731944611224 5337297 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 668641 239940 882 410 0 664114 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2674564 KiB
Current children cumulated memory: 959760 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/199 18100
/proc/meminfo: memFree=23519356/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2676104 memory=962752 CPUtime=102.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 92254 0 0 0 10207 21 0 0 20 0 1 0 527331709 2740330496 240688 33554432000 4194304 5870510 140731944612336 140731944610664 5261210 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 669026 240688 882 410 0 664499 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2676104 KiB
Current children cumulated memory: 962752 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/200 18106
/proc/meminfo: memFree=23522996/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2676244 memory=963000 CPUtime=162.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 119577 0 0 0 16206 23 0 0 20 0 1 0 527331709 2740473856 240750 33554432000 4194304 5870510 140731944612336 140731944610664 5337336 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 669061 240750 882 410 0 664534 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 2676244 KiB
Current children cumulated memory: 963000 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/199 18110
/proc/meminfo: memFree=23558984/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2667172 memory=954248 CPUtime=222.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 130612 0 0 0 22202 26 0 0 20 0 1 0 527331709 2731184128 238562 33554432000 4194304 5870510 140731944612336 140731944611352 5282588 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 666793 238562 909 410 0 662266 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 2667172 KiB
Current children cumulated memory: 954248 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/199 18114
/proc/meminfo: memFree=23550516/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2717260 memory=959032 CPUtime=282.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 155330 0 0 0 28198 31 0 0 20 0 1 0 527331709 2782474240 239758 33554432000 4194304 5870510 140731944612336 140731944611288 5272443 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 679315 239758 909 410 0 674788 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 2717260 KiB
Current children cumulated memory: 959032 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/201 18128
/proc/meminfo: memFree=23500624/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2677188 memory=958652 CPUtime=342.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 162251 0 0 0 34193 36 0 0 20 0 1 0 527331709 2741440512 239663 33554432000 4194304 5870510 140731944612336 140731944611352 5282394 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 669297 239663 909 410 0 664770 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 2677188 KiB
Current children cumulated memory: 958652 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/200 18132
/proc/meminfo: memFree=23489592/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2727276 memory=973696 CPUtime=402.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 168169 0 0 0 40190 39 0 0 20 0 1 0 527331709 2792730624 243424 33554432000 4194304 5870510 140731944612336 140731944611288 5272427 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 681819 243424 909 410 0 677292 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 2727276 KiB
Current children cumulated memory: 973696 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/200 18136
/proc/meminfo: memFree=23494228/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2684088 memory=976292 CPUtime=462.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 179730 0 0 0 46183 45 0 0 20 0 1 0 527331709 2748506112 244073 33554432000 4194304 5870510 140731944612336 140731944610904 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 671022 244073 909 410 0 666495 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 2684088 KiB
Current children cumulated memory: 976292 KiB


################
# More data... #
################

/proc/18092/statm: 689057 253596 909 410 0 684530 0
Current children cumulated CPU time: 1662.29 s
Current children cumulated vsize: 2756228 KiB
Current children cumulated memory: 1014384 KiB

[startup+1722.3 s]
/proc/loadavg: 1.00 1.06 1.38 2/193 18301
/proc/meminfo: memFree=23707920/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2708708 memory=1003288 CPUtime=1722.29 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 858759 0 0 0 172063 166 0 0 20 0 1 0 527331709 2773716992 250822 33554432000 4194304 5870510 140731944612336 140731944610904 5283135 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 677177 250822 909 410 0 672650 0
Current children cumulated CPU time: 1722.29 s
Current children cumulated vsize: 2708708 KiB
Current children cumulated memory: 1003288 KiB

[startup+1782.3 s]
/proc/loadavg: 1.00 1.05 1.36 2/194 18307
/proc/meminfo: memFree=23697052/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2762052 memory=1014104 CPUtime=1782.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 913370 0 0 0 178055 173 0 0 20 0 1 0 527331709 2828341248 253526 33554432000 4194304 5870510 140731944612336 140731944611288 5282721 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 690513 253526 909 410 0 685986 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 2762052 KiB
Current children cumulated memory: 1014104 KiB

[startup+1842.3 s]
/proc/loadavg: 1.00 1.04 1.34 2/192 18311
/proc/meminfo: memFree=23694944/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2762052 memory=1016124 CPUtime=1842.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 915599 0 0 0 184052 176 0 0 20 0 1 0 527331709 2828341248 254031 33554432000 4194304 5870510 140731944612336 140731944611288 5272433 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 690513 254031 909 410 0 685986 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 2762052 KiB
Current children cumulated memory: 1016124 KiB

[startup+1902.3 s]
/proc/loadavg: 1.00 1.03 1.31 2/192 18315
/proc/meminfo: memFree=23692848/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2762052 memory=1018308 CPUtime=1902.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 957619 0 0 0 190048 180 0 0 20 0 1 0 527331709 2828341248 254577 33554432000 4194304 5870510 140731944612336 140731944611288 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 690513 254577 909 410 0 685986 0
Current children cumulated CPU time: 1902.28 s
Current children cumulated vsize: 2762052 KiB
Current children cumulated memory: 1018308 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.03 1.30 2/193 18321
/proc/meminfo: memFree=23690596/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2762052 memory=1020356 CPUtime=1962.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 979880 0 0 0 196044 184 0 0 20 0 1 0 527331709 2828341248 255089 33554432000 4194304 5870510 140731944612336 140731944611288 5282606 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 690513 255089 909 410 0 685986 0
Current children cumulated CPU time: 1962.28 s
Current children cumulated vsize: 2762052 KiB
Current children cumulated memory: 1020356 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.02 1.28 2/192 18325
/proc/meminfo: memFree=23688616/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2762052 memory=1022404 CPUtime=2022.28 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1001859 0 0 0 202041 187 0 0 20 0 1 0 527331709 2828341248 255601 33554432000 4194304 5870510 140731944612336 140731944611288 5307152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 690513 255601 909 410 0 685986 0
Current children cumulated CPU time: 2022.28 s
Current children cumulated vsize: 2762052 KiB
Current children cumulated memory: 1022404 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.02 1.26 2/192 18329
/proc/meminfo: memFree=23698228/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2716984 memory=1013236 CPUtime=2082.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1027541 0 0 0 208035 192 0 0 20 0 1 0 527331709 2782191616 253309 33554432000 4194304 5870510 140731944612336 140731944610904 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 679246 253309 909 410 0 674719 0
Current children cumulated CPU time: 2082.27 s
Current children cumulated vsize: 2716984 KiB
Current children cumulated memory: 1013236 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.24 2/194 18343
/proc/meminfo: memFree=23690768/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2768812 memory=1020416 CPUtime=2142.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1056497 0 0 0 214028 199 0 0 20 0 1 0 527331709 2835263488 255104 33554432000 4194304 5870510 140731944612336 140731944611288 5283135 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 692203 255104 909 410 0 687676 0
Current children cumulated CPU time: 2142.27 s
Current children cumulated vsize: 2768812 KiB
Current children cumulated memory: 1020416 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.23 2/193 18346
/proc/meminfo: memFree=23685148/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2768812 memory=1026596 CPUtime=2202.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1078982 0 0 0 220025 202 0 0 20 0 1 0 527331709 2835263488 256649 33554432000 4194304 5870510 140731944612336 140731944611288 5282531 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 692203 256649 909 410 0 687676 0
Current children cumulated CPU time: 2202.27 s
Current children cumulated vsize: 2768812 KiB
Current children cumulated memory: 1026596 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.21 2/193 18350
/proc/meminfo: memFree=23678828/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2768812 memory=1034808 CPUtime=2262.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1121746 0 0 0 226020 207 0 0 20 0 1 0 527331709 2835263488 258702 33554432000 4194304 5870510 140731944612336 140731944611288 5307152 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 692203 258702 909 410 0 687676 0
Current children cumulated CPU time: 2262.27 s
Current children cumulated vsize: 2768812 KiB
Current children cumulated memory: 1034808 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.20 2/194 18356
/proc/meminfo: memFree=23684548/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2768812 memory=1026636 CPUtime=2322.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1146112 0 0 0 232014 213 0 0 20 0 1 0 527331709 2835263488 256659 33554432000 4194304 5870510 140731944612336 140731944611288 5282684 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 692203 256659 909 410 0 687676 0
Current children cumulated CPU time: 2322.27 s
Current children cumulated vsize: 2768812 KiB
Current children cumulated memory: 1026636 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.19 2/193 18360
/proc/meminfo: memFree=23682540/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2768812 memory=1028704 CPUtime=2382.27 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1171822 0 0 0 238010 217 0 0 20 0 1 0 527331709 2835263488 257176 33554432000 4194304 5870510 140731944612336 140731944611288 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 692203 257176 909 410 0 687676 0
Current children cumulated CPU time: 2382.27 s
Current children cumulated vsize: 2768812 KiB
Current children cumulated memory: 1028704 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 1.00 1.01 1.19 2/193 18361
/proc/meminfo: memFree=23691496/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2720832 memory=1019112 CPUtime=2400.07 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1174032 0 0 0 239788 219 0 0 20 0 1 0 527331709 2786131968 254778 33554432000 4194304 5870510 140731944612336 140731944610696 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 680208 254778 909 410 0 675681 0
Current children cumulated CPU time: 2400.07 s
Current children cumulated vsize: 2720832 KiB
Current children cumulated memory: 1019112 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 18092 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2397.89 s, system=2.205 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 1.00 1.01 1.19 2/193 18361
/proc/meminfo: memFree=23691496/32770624 swapFree=66976804/67108860
[pid=18092] ppid=18089 vsize=2720832 memory=1019112 CPUtime=2400.07 cores=1,3,5,7
/proc/18092/stat : 18092 (xcsp_picat) R 18089 18092 16848 0 -1 4202496 1174032 0 0 0 239788 219 0 0 20 0 1 0 527331709 2786131968 254778 33554432000 4194304 5870510 140731944612336 140731944610696 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 19640320 140731944616967 140731944617049 140731944617049 140731944619974 0
/proc/18092/statm: 680208 254778 909 410 0 675681 0
Current children cumulated CPU time: 2400.07 s
Current children cumulated vsize: 2720832 KiB
Current children cumulated memory: 1019112 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.11
CPU time (s): 2400.09
CPU user time (s): 2397.89
CPU system time (s): 2.205
CPU usage (%): 99.999
Max. virtual memory (cumulated for all children) (KiB): 2850668
Max. memory (cumulated for all children) (KiB): 1116456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2397.89
system time used= 2.205
maximum resident set size= 1116456
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1174032
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 51
involuntary context switches= 1834


# summary of solver processes directly reported to runsolver:
#   pid: 18092
#   total CPU time (s): 2400.09
#   total CPU user time (s): 2397.89
#   total CPU system time (s): 2.205

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.49815 second user time and 17.7856 second system time

The end

Launcher Data 

Begin job on node124 at 2019-09-26 18:04:35
IDJOB=4407856
IDBENCH=140313
IDSOLVER=2873
FILE ID=node124/4407856-1569513917
RUNJOBID= node124-1569509600-16880
PBS_JOBID= 21705791
Free space on /var/tmp= 13512 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/Crossword/Crossword-m1c-uk-vg/Crossword-m1c-uk-vg-8-9.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407856-1569513917/watcher-4407856-1569513917 -o /var/tmp/evaluation-result-4407856-1569513917/solver-4407856-1569513917 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node124-1569509600-16880 --watchdog 2560  xcsp_picat HOME/instance-4407856-1569513917.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d0b0eed1d6d204767f77a0623277ccee
RANDOM SEED=436761794

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24500576 kB
MemAvailable:   31594624 kB
Buffers:          179768 kB
Cached:          7019688 kB
SwapCached:        29076 kB
Active:          3738500 kB
Inactive:        3700324 kB
Active(anon):     229588 kB
Inactive(anon):    83880 kB
Active(file):    3508912 kB
Inactive(file):  3616444 kB
Unevictable:      108340 kB
Mlocked:          108340 kB
SwapTotal:      67108860 kB
SwapFree:       66976804 kB
Dirty:              4736 kB
Writeback:             0 kB
AnonPages:        412096 kB
Mapped:            24504 kB
Shmem:             65488 kB
Slab:             425900 kB
SReclaimable:     397152 kB
SUnreclaim:        28748 kB
KernelStack:        3840 kB
PageTables:         5700 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2771036 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    354304 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /var/tmp at the end= 13512 MiB
End job on node124 at 2019-09-26 18:44:36