Trace number 4295344

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2520.08 2520.04

General information on the benchmark

NameMario/
Mario-t-hard-5_c18.xml
MD5SUM4de37f7087aa8e77bde3fd457ed5d54a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark4482
Best CPU time to get the best result obtained on this benchmark3.6868
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints201
Number of domains166
Minimum domain size1
Maximum domain size100
Distribution of domain sizes[{"size":1,"count":5},{"size":2,"count":95},{"size":83,"count":1},{"size":85,"count":1},{"size":86,"count":3},{"size":87,"count":3},{"size":88,"count":8},{"size":89,"count":19},{"size":90,"count":19},{"size":91,"count":8},{"size":92,"count":17},{"size":93,"count":12},{"size":94,"count":3},{"size":95,"count":3},{"size":96,"count":1},{"size":97,"count":2},{"size":100,"count":100}]
Minimum variable degree1
Maximum variable degree3
Distribution of variable degrees[{"degree":1,"count":2},{"degree":2,"count":199},{"degree":3,"count":99}]
Minimum constraint arity1
Maximum constraint arity100
Distribution of constraint arities[{"arity":1,"count":1},{"arity":2,"count":198},{"arity":100,"count":2}]
Number of extensional constraints100
Number of intensional constraints99
Distribution of constraint types[{"type":"extension","count":100},{"type":"intension","count":99},{"type":"sum","count":1},{"type":"circuit","count":1}]
Optimization problemYES
Type of objectivemax SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (2345 MiB free)
  memory of node 1: 16384 MiB (7903 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295344-1532519048/watcher-4295344-1532519048 -o /tmp/evaluation-result-4295344-1532519048/solver-4295344-1532519048 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node107-1532498874-27091 --watchdog 2580 xcsp_picat HOME/instance-4295344-1532519048.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=29199, runsolver pid=29196
Current StackSize limit: 8192 KiB


[startup+0.100182 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10464768/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=111688 memory=33860 CPUtime=0.1 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 1463 0 0 0 10 0 0 0 20 0 1 0 69467985 114368512 8465 33554432000 4194304 5849740 140729006986160 140729006986160 4465955 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 27922 8465 616 405 0 24866 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 33860 KiB

[startup+0.210144 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10447272/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=139840 memory=49340 CPUtime=0.2 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2783 0 0 0 20 0 0 0 20 0 1 0 69467985 143196160 12335 33554432000 4194304 5849740 140729006986160 140729006986160 5251173 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 34960 12335 625 405 0 31904 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 139840 KiB
Current children cumulated memory: 49340 KiB

[startup+0.310067 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10445224/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=139840 memory=51388 CPUtime=0.31 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2784 0 0 0 30 1 0 0 20 0 1 0 69467985 143196160 12847 33554432000 4194304 5849740 140729006986160 140729006985480 5251230 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 34960 12847 625 405 0 31904 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 139840 KiB
Current children cumulated memory: 51388 KiB

[startup+0.700408 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10443176/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=139840 memory=55484 CPUtime=0.69 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2786 0 0 0 68 1 0 0 20 0 1 0 69467985 143196160 13871 33554432000 4194304 5849740 140729006986160 140729006985480 5249600 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 34960 13871 625 405 0 31904 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 139840 KiB
Current children cumulated memory: 55484 KiB

[startup+1.50042 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10454080/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=144408 memory=55920 CPUtime=1.49 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 6563 0 0 0 145 4 0 0 20 0 1 0 69467985 147873792 13980 33554432000 4194304 5849740 140729006986160 140729006985128 5251230 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 36102 13980 625 405 0 33046 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 144408 KiB
Current children cumulated memory: 55920 KiB

[startup+3.10963 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10423424/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=151884 memory=78244 CPUtime=3.1 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 15753 0 0 0 298 12 0 0 20 0 1 0 69467985 155529216 19561 33554432000 4194304 5849740 140729006986160 140729006985128 4454802 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 37971 19561 625 405 0 34915 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 151884 KiB
Current children cumulated memory: 78244 KiB

[startup+6.30037 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10404072/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=161460 memory=85224 CPUtime=6.29 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 30171 0 0 0 601 28 0 0 20 0 1 0 69467985 165335040 21306 33554432000 4194304 5849740 140729006986160 140729006985128 5251173 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 40365 21306 625 405 0 37309 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 161460 KiB
Current children cumulated memory: 85224 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10395756/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=171836 memory=105800 CPUtime=12.69 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 52655 0 0 0 1209 60 0 0 20 0 1 0 69467985 175960064 26450 33554432000 4194304 5849740 140729006986160 140729006985128 5251230 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 42959 26450 625 405 0 39903 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 171836 KiB
Current children cumulated memory: 105800 KiB

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10399868/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=181776 memory=99508 CPUtime=25.5 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 93798 0 0 0 2424 126 0 0 20 0 1 0 69467985 186138624 24877 33554432000 4194304 5849740 140729006986160 140729006985128 5250352 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 45444 24877 625 405 0 42388 0
Current children cumulated CPU time: 25.5 s
Current children cumulated vsize: 181776 KiB
Current children cumulated memory: 99508 KiB

[startup+51.1096 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29200
/proc/meminfo: memFree=10352024/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=290612 memory=183780 CPUtime=51.1 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 134843 0 0 0 4857 253 0 0 20 0 1 0 69467985 297586688 45945 33554432000 4194304 5849740 140729006986160 140729006985128 5250387 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 72653 45945 626 405 0 69597 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 290612 KiB
Current children cumulated memory: 183780 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29201
/proc/meminfo: memFree=10141412/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=564836 memory=375604 CPUtime=102.3 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 187135 0 0 0 9722 508 0 0 20 0 1 0 69467985 578392064 93901 33554432000 4194304 5849740 140729006986160 140729006985128 5260513 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 141209 93901 626 405 0 138153 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 564836 KiB
Current children cumulated memory: 375604 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29326
/proc/meminfo: memFree=12252972/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=916960 memory=855780 CPUtime=162.3 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 204633 0 0 0 15626 604 0 0 20 0 1 0 69467985 938967040 213945 33554432000 4194304 5849740 140729006986160 140729006985160 5437467 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 229240 213945 754 405 0 226184 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 916960 KiB
Current children cumulated memory: 855780 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29327
/proc/meminfo: memFree=12207568/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=971376 memory=910064 CPUtime=222.3 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 209332 0 0 0 21594 636 0 0 20 0 1 0 69467985 994689024 227516 33554432000 4194304 5849740 140729006986160 140729006985160 5387638 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 242844 227516 754 405 0 239788 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 971376 KiB
Current children cumulated memory: 910064 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29328
/proc/meminfo: memFree=12135100/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1031568 memory=970512 CPUtime=282.31 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 220561 0 0 0 27566 665 0 0 20 0 1 0 69467985 1056325632 242628 33554432000 4194304 5849740 140729006986160 140729006985160 5362017 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 257892 242628 754 405 0 254836 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 1031568 KiB
Current children cumulated memory: 970512 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29329
/proc/meminfo: memFree=12079960/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1103604 memory=1042200 CPUtime=342.31 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 224588 0 0 0 33531 700 0 0 20 0 1 0 69467985 1130090496 260550 33554432000 4194304 5849740 140729006986160 140729006985160 5395623 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 275901 260550 754 405 0 272845 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 1103604 KiB
Current children cumulated memory: 1042200 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29337
/proc/meminfo: memFree=12031652/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1095716 memory=1034488 CPUtime=402.31 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 232366 0 0 0 39500 731 0 0 20 0 1 0 69467985 1122013184 258622 33554432000 4194304 5849740 140729006986160 140729006985160 140590168170375 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 273929 258622 754 405 0 270873 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 1095716 KiB
Current children cumulated memory: 1034488 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29338
/proc/meminfo: memFree=12077308/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1127748 memory=1066588 CPUtime=462.31 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 270008 0 0 0 45465 766 0 0 20 0 1 0 69467985 1154813952 266647 33554432000 4194304 5849740 140729006986160 140729006985160 5313240 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 281937 266647 754 405 0 278881 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 1127748 KiB
Current children cumulated memory: 1066588 KiB


################
# More data... #
################

/proc/29199/statm: 492709 478867 754 405 0 489653 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 1970836 KiB
Current children cumulated memory: 1915468 KiB

[startup+1782.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 29528
/proc/meminfo: memFree=11193448/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1970828 memory=1915460 CPUtime=1782.32 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2313759 0 0 0 176701 1531 0 0 20 0 1 0 69467985 2018127872 478865 33554432000 4194304 5849740 140729006986160 140729006985032 5312857 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 492707 478865 754 405 0 489651 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 1970828 KiB
Current children cumulated memory: 1915460 KiB

[startup+1842.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/188 29529
/proc/meminfo: memFree=11420800/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1702868 memory=1647500 CPUtime=1842.32 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2437013 0 0 0 182670 1562 0 0 20 0 1 0 69467985 1743736832 411875 33554432000 4194304 5849740 140729006986160 140729006985032 5312857 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 425717 411875 754 405 0 422661 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 1702868 KiB
Current children cumulated memory: 1647500 KiB

[startup+1902.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/186 29530
/proc/meminfo: memFree=11419020/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1702868 memory=1647500 CPUtime=1902.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2538169 0 0 0 188650 1583 0 0 20 0 1 0 69467985 1743736832 411875 33554432000 4194304 5849740 140729006986160 140729006985160 140590168170375 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 425717 411875 754 405 0 422661 0
Current children cumulated CPU time: 1902.33 s
Current children cumulated vsize: 1702868 KiB
Current children cumulated memory: 1647500 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/187 29532
/proc/meminfo: memFree=11518792/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2147528 memory=2092160 CPUtime=1962.32 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2664032 0 0 0 194622 1610 0 0 20 0 1 0 69467985 2199068672 523040 33554432000 4194304 5849740 140729006986160 140729006985160 140590168170375 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 536882 523040 754 405 0 533826 0
Current children cumulated CPU time: 1962.32 s
Current children cumulated vsize: 2147528 KiB
Current children cumulated memory: 2092160 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 29533
/proc/meminfo: memFree=10934364/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2147528 memory=2092160 CPUtime=2022.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2726639 0 0 0 200594 1639 0 0 20 0 1 0 69467985 2199068672 523040 33554432000 4194304 5849740 140729006986160 140729006985032 5312821 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 536882 523040 754 405 0 533826 0
Current children cumulated CPU time: 2022.33 s
Current children cumulated vsize: 2147528 KiB
Current children cumulated memory: 2092160 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 29534
/proc/meminfo: memFree=10997688/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2147528 memory=2092160 CPUtime=2082.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2789113 0 0 0 206575 1658 0 0 20 0 1 0 69467985 2199068672 523040 33554432000 4194304 5849740 140729006986160 140729006985160 5312884 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 536882 523040 754 405 0 533826 0
Current children cumulated CPU time: 2082.33 s
Current children cumulated vsize: 2147528 KiB
Current children cumulated memory: 2092160 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29535
/proc/meminfo: memFree=10902584/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2213056 memory=2157688 CPUtime=2142.34 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2842828 0 0 0 212560 1674 0 0 20 0 1 0 69467985 2266169344 539422 33554432000 4194304 5849740 140729006986160 140729006985160 5312874 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 553264 539422 754 405 0 550208 0
Current children cumulated CPU time: 2142.34 s
Current children cumulated vsize: 2213056 KiB
Current children cumulated memory: 2157688 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29544
/proc/meminfo: memFree=11333684/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=1762116 memory=1706748 CPUtime=2202.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2903491 0 0 0 218527 1706 0 0 20 0 1 0 69467985 1804406784 426687 33554432000 4194304 5849740 140729006986160 140729006985160 140590168170375 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 440529 426687 754 405 0 437473 0
Current children cumulated CPU time: 2202.33 s
Current children cumulated vsize: 1762116 KiB
Current children cumulated memory: 1706748 KiB

[startup+2262.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/188 29545
/proc/meminfo: memFree=11105356/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2010984 memory=1955440 CPUtime=2262.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2958062 0 0 0 224505 1728 0 0 20 0 1 0 69467985 2059247616 488860 33554432000 4194304 5849740 140729006986160 140729006985160 5437698 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 502746 488860 754 405 0 499690 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 2010984 KiB
Current children cumulated memory: 1955440 KiB

[startup+2322.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/188 29546
/proc/meminfo: memFree=10980756/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2076520 memory=2021148 CPUtime=2322.32 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 2982433 0 0 0 230486 1746 0 0 20 0 1 0 69467985 2126356480 505287 33554432000 4194304 5849740 140729006986160 140729006985032 5312882 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 519130 505287 754 405 0 516074 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 2076520 KiB
Current children cumulated memory: 2021148 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/188 29547
/proc/meminfo: memFree=10996136/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2076520 memory=2021148 CPUtime=2382.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 3019805 0 0 0 236471 1762 0 0 20 0 1 0 69467985 2126356480 505287 33554432000 4194304 5849740 140729006986160 140729006985160 5312827 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 519130 505287 754 405 0 516074 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 2076520 KiB
Current children cumulated memory: 2021148 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 29548
/proc/meminfo: memFree=10439876/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2631212 memory=2575660 CPUtime=2442.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 3047049 0 0 0 242437 1796 0 0 20 0 1 0 69467985 2694361088 643915 33554432000 4194304 5849740 140729006986160 140729006985160 5438311 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 657803 643915 754 405 0 654747 0
Current children cumulated CPU time: 2442.33 s
Current children cumulated vsize: 2631212 KiB
Current children cumulated memory: 2575660 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 29550
/proc/meminfo: memFree=10496572/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2631208 memory=2575840 CPUtime=2502.33 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 3153363 0 0 0 248406 1827 0 0 20 0 1 0 69467985 2694356992 643960 33554432000 4194304 5849740 140729006986160 140729006985160 140590168170375 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 657802 643960 754 405 0 654746 0
Current children cumulated CPU time: 2502.33 s
Current children cumulated vsize: 2631208 KiB
Current children cumulated memory: 2575840 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 29550
/proc/meminfo: memFree=10487208/32770624 swapFree=67108860/67108860
[pid=29199] ppid=29196 vsize=2631208 memory=2575840 CPUtime=2520.04 cores=1,3,5,7
/proc/29199/stat : 29199 (xcsp_picat) R 29196 29199 27059 0 -1 4202496 3160975 0 0 0 250170 1834 0 0 20 0 1 0 69467985 2694356992 643960 33554432000 4194304 5849740 140729006986160 140729006985032 5399551 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7949816 9399828 16531456 140729006990518 140729006990596 140729006990596 140729006993354 0
/proc/29199/statm: 657802 643960 754 405 0 654746 0
Current children cumulated CPU time: 2520.04 s
Current children cumulated vsize: 2631208 KiB
Current children cumulated memory: 2575840 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.04 s]
# the end of solver process 29199 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2501.7 s, system=18.3798 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.04
CPU time (s): 2520.08
CPU user time (s): 2501.7
CPU system time (s): 18.3798
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 2631212
Max. memory (cumulated for all children) (KiB): 2575844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2501.7
system time used= 18.3798
maximum resident set size= 2575844
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3160976
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129
involuntary context switches= 942


# summary of solver processes directly reported to runsolver:
#   pid: 29199
#   total CPU time (s): 2520.08
#   total CPU user time (s): 2501.7
#   total CPU system time (s): 18.3798

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.7616 second user time and 17.3685 second system time

The end

Launcher Data 

Begin job on node107 at 2018-07-25 13:44:08
IDJOB=4295344
IDBENCH=141524
IDSOLVER=2754
FILE ID=node107/4295344-1532519048
RUNJOBID= node107-1532498874-27091
PBS_JOBID= 21021590
Free space on /tmp= 54520 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/Mario/Mario-t-hard-5_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295344-1532519048/watcher-4295344-1532519048 -o /tmp/evaluation-result-4295344-1532519048/solver-4295344-1532519048 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node107-1532498874-27091 --watchdog 2580  xcsp_picat HOME/instance-4295344-1532519048.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4de37f7087aa8e77bde3fd457ed5d54a
RANDOM SEED=1902450397

node107.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        10495160 kB
MemAvailable:   29249204 kB
Buffers:          280668 kB
Cached:         18595628 kB
SwapCached:            0 kB
Active:          6879776 kB
Inactive:       14727884 kB
Active(anon):    2733968 kB
Inactive(anon):    25036 kB
Active(file):    4145808 kB
Inactive(file): 14702848 kB
Unevictable:        7168 kB
Mlocked:            7168 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3132 kB
Writeback:             0 kB
AnonPages:       2738264 kB
Mapped:            41968 kB
Shmem:             25228 kB
Slab:             361348 kB
SReclaimable:     333848 kB
SUnreclaim:        27500 kB
KernelStack:        3344 kB
PageTables:        10316 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    3073236 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1925120 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       91520 kB
DirectMap2M:    33454080 kB

Free space on /tmp at the end= 54520 MiB
End job on node107 at 2018-07-25 14:26:08