Trace number 4293988

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (exit code) 1561.21 1561.32

General information on the benchmark

NameCrosswordDesign/
CrosswordDesign-12-4-rom_c18.xml
MD5SUM81778793cf44fcc277d17f448f65fa63
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark76
Best CPU time to get the best result obtained on this benchmark2519.97
Satisfiable
(Un)Satisfiability was proved
Number of variables432
Number of constraints96
Number of domains5
Minimum domain size2
Maximum domain size124353
Distribution of domain sizes[{"size":2,"count":24},{"size":13,"count":168},{"size":27,"count":144},{"size":124353,"count":96}]
Minimum variable degree1
Maximum variable degree8
Distribution of variable degrees[{"degree":1,"count":120},{"degree":2,"count":168},{"degree":8,"count":144}]
Minimum constraint arity15
Maximum constraint arity16
Distribution of constraint arities[{"arity":15,"count":24},{"arity":16,"count":72}]
Number of extensional constraints96
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":96}]
Optimization problemYES
Type of objectivemax SUM

Solver Data 

1561.08/1561.28	% error: OUT OF MEMORY
1561.08/1561.28	% unhandled interrupt event 
1561.08/1561.28	c xcsp_picat version 2.4#4 (June 15, 2018)

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (3345 MiB free)
  memory of node 1: 16384 MiB (11492 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4293988-1532432861/watcher-4293988-1532432861 -o /tmp/evaluation-result-4293988-1532432861/solver-4293988-1532432861 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580 xcsp_picat HOME/instance-4293988-1532432861.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27398, runsolver pid=27395

[startup+0.10011 s]*
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=15165956/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=111688 memory=17744 CPUtime=0.1 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1559 0 0 0 10 0 0 0 20 0 1 0 60849307 114368512 4436 33554432000 4194304 5849740 140737474323632 140737474323632 4488915 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 27922 4436 593 405 0 24866 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 17744 KiB

[startup+0.209806 s]*
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=15156212/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=111688 memory=23888 CPUtime=0.21 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1562 0 0 0 21 0 0 0 20 0 1 0 60849307 114368512 5972 33554432000 4194304 5849740 140737474323632 140737474323632 140513751849984 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 27922 5972 593 405 0 24866 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 23888 KiB

[startup+0.30959 s]*
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=15129176/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=111688 memory=27984 CPUtime=0.31 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1564 0 0 0 31 0 0 0 20 0 1 0 60849307 114368512 6996 33554432000 4194304 5849740 140737474323632 140737474323632 4476438 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 27922 6996 593 405 0 24866 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 27984 KiB

[startup+0.700253 s]
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=15080024/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=111688 memory=50512 CPUtime=0.69 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1575 0 0 0 68 1 0 0 20 0 1 0 60849307 114368512 12628 33554432000 4194304 5849740 140737474323632 140737474322936 4476526 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 27922 12628 593 405 0 24866 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 50512 KiB

[startup+1.50027 s]
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=14977064/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=181020 memory=91888 CPUtime=1.48 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 2700 0 0 0 147 1 0 0 20 0 1 0 60849307 185364480 22972 33554432000 4194304 5849740 140737474323632 140737474322936 4505503 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 45255 22972 597 405 0 42199 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 181020 KiB
Current children cumulated memory: 91888 KiB

[startup+3.10988 s]
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=14657328/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=181052 memory=120640 CPUtime=3.09 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 5221 0 0 0 307 2 0 0 20 0 1 0 60849307 185397248 30160 33554432000 4194304 5849740 140737474323632 140737474322952 5262149 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 45263 30160 597 405 0 42207 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 181052 KiB
Current children cumulated memory: 120640 KiB

[startup+6.30031 s]
/proc/loadavg: 1.00 1.00 1.04 3/190 27399
/proc/meminfo: memFree=14124144/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=399712 memory=326792 CPUtime=6.29 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 19125 0 0 0 605 24 0 0 20 0 1 0 60849307 409305088 81698 33554432000 4194304 5849740 140737474323632 140737474322920 4550747 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 99928 81698 614 405 0 96872 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 399712 KiB
Current children cumulated memory: 326792 KiB

[startup+12.7003 s]
/proc/loadavg: 1.08 1.01 1.05 3/190 27399
/proc/meminfo: memFree=11769468/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=1220020 memory=1156312 CPUtime=12.69 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 24174 0 0 0 1220 49 0 0 20 0 1 0 60849307 1249300480 289078 33554432000 4194304 5849740 140737474323632 140737474322920 4484727 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 305005 289078 614 405 0 301949 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 1220020 KiB
Current children cumulated memory: 1156312 KiB

[startup+25.5003 s]
/proc/loadavg: 1.28 1.06 1.06 3/190 27399
/proc/meminfo: memFree=9476808/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=4438772 memory=2555176 CPUtime=25.49 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 29236 0 0 0 2428 121 0 0 20 0 1 0 60849307 4545302528 638794 33554432000 4194304 5849740 140737474323632 140737474322920 4504048 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 1109693 638794 614 405 0 1106637 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 4438772 KiB
Current children cumulated memory: 2555176 KiB

[startup+51.1097 s]
/proc/loadavg: 1.53 1.14 1.08 3/190 27399
/proc/meminfo: memFree=3372156/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=8202348 memory=6177600 CPUtime=51.09 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 33393 0 0 0 4921 188 0 0 20 0 1 0 60849307 8399204352 1544400 33554432000 4194304 5849740 140737474323632 140737474322952 4483906 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2050587 1544400 623 405 0 2047531 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 8202348 KiB
Current children cumulated memory: 6177600 KiB

[startup+102.3 s]
/proc/loadavg: 1.71 1.24 1.12 3/190 27461
/proc/meminfo: memFree=10619312/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=12411016 memory=10476468 CPUtime=102.24 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1084917 0 0 0 9383 841 0 0 20 0 1 0 60849307 12708880384 2619117 33554432000 4194304 5849740 140737474323632 140737474322632 5269564 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3102754 2619117 624 405 0 3099698 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 12411016 KiB
Current children cumulated memory: 10476468 KiB

[startup+162.3 s]
/proc/loadavg: 1.94 1.39 1.18 3/192 27470
/proc/meminfo: memFree=7935960/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=12543828 memory=10609280 CPUtime=162.22 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1114569 0 0 0 14823 1399 0 0 20 0 1 0 60849307 12844879872 2652320 33554432000 4194304 5849740 140737474323632 140737474322632 5260281 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3135957 2652320 624 405 0 3132901 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 12543828 KiB
Current children cumulated memory: 10609280 KiB

[startup+222.3 s]
/proc/loadavg: 2.04 1.52 1.24 3/192 27471
/proc/meminfo: memFree=7802272/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=12676640 memory=10742092 CPUtime=222.22 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1147061 0 0 0 20237 1985 0 0 20 0 1 0 60849307 12980879360 2685523 33554432000 4194304 5849740 140737474323632 140737474322632 5260671 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3169160 2685523 624 405 0 3166104 0
Current children cumulated CPU time: 222.22 s
Current children cumulated vsize: 12676640 KiB
Current children cumulated memory: 10742092 KiB

[startup+282.3 s]
/proc/loadavg: 2.08 1.62 1.29 3/192 27472
/proc/meminfo: memFree=11903848/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=12809452 memory=7129112 CPUtime=282.22 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1176320 0 0 0 25723 2499 0 0 20 0 1 0 60849307 13116878848 1782278 33554432000 4194304 5849740 140737474323632 140737474322632 5269181 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3202363 1782278 624 405 0 3199307 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 12809452 KiB
Current children cumulated memory: 7129112 KiB

[startup+342.3 s]
/proc/loadavg: 2.03 1.69 1.34 3/193 27474
/proc/meminfo: memFree=7325816/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=12925664 memory=10993164 CPUtime=342.2 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1206041 0 0 0 31152 3068 0 0 20 0 1 0 60849307 13235879936 2748291 33554432000 4194304 5849740 140737474323632 140737474322632 5260281 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3231416 2748291 624 405 0 3228360 0
Current children cumulated CPU time: 342.2 s
Current children cumulated vsize: 12925664 KiB
Current children cumulated memory: 10993164 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 1.75 1.38 3/193 27475
/proc/meminfo: memFree=11912948/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=13058476 memory=7480528 CPUtime=402.2 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1236522 0 0 0 36610 3610 0 0 20 0 1 0 60849307 13371879424 1870132 33554432000 4194304 5849740 140737474323632 140737474322632 5269181 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3264619 1870132 624 405 0 3261563 0
Current children cumulated CPU time: 402.2 s
Current children cumulated vsize: 13058476 KiB
Current children cumulated memory: 7480528 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.79 1.42 3/192 27477
/proc/meminfo: memFree=6954308/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=13174688 memory=11238064 CPUtime=462.19 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1267876 0 0 0 42016 4203 0 0 20 0 1 0 60849307 13490880512 2809516 33554432000 4194304 5849740 140737474323632 140737474322632 5257234 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3293672 2809516 624 405 0 3290616 0
Current children cumulated CPU time: 462.19 s
Current children cumulated vsize: 13174688 KiB
Current children cumulated memory: 11238064 KiB


################
# More data... #
################

/proc/27398/statm: 3580050 3096111 624 405 0 3576994 0
Current children cumulated CPU time: 1062.18 s
Current children cumulated vsize: 14320200 KiB
Current children cumulated memory: 12384444 KiB

[startup+1122.3 s]
/proc/loadavg: 2.06 2.00 1.72 3/191 27519
/proc/meminfo: memFree=5817824/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14436408 memory=12500268 CPUtime=1122.19 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1571225 0 0 0 101779 10440 0 0 20 0 1 0 60849307 14782881792 3125067 33554432000 4194304 5849740 140737474323632 140737474322632 5260674 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3609102 3125067 624 405 0 3606046 0
Current children cumulated CPU time: 1122.19 s
Current children cumulated vsize: 14436408 KiB
Current children cumulated memory: 12500268 KiB

[startup+1182.3 s]
/proc/loadavg: 2.02 2.00 1.74 3/191 27520
/proc/meminfo: memFree=5661380/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14536016 memory=12599600 CPUtime=1182.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1596387 0 0 0 107260 10958 0 0 20 0 1 0 60849307 14884880384 3149900 33554432000 4194304 5849740 140737474323632 140737474322632 5257177 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3634004 3149900 624 405 0 3630948 0
Current children cumulated CPU time: 1182.18 s
Current children cumulated vsize: 14536016 KiB
Current children cumulated memory: 12599600 KiB

[startup+1242.3 s]
/proc/loadavg: 2.01 2.00 1.76 3/191 27521
/proc/meminfo: memFree=6952276/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14652228 memory=12183040 CPUtime=1242.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1626777 0 0 0 112644 11574 0 0 20 0 1 0 60849307 15003881472 3045760 33554432000 4194304 5849740 140737474323632 140737474322632 5269190 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3663057 3045760 624 405 0 3660001 0
Current children cumulated CPU time: 1242.18 s
Current children cumulated vsize: 14652228 KiB
Current children cumulated memory: 12183040 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.77 3/190 27522
/proc/meminfo: memFree=5507532/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14751840 memory=12816908 CPUtime=1302.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1653960 0 0 0 118090 12128 0 0 20 0 1 0 60849307 15105884160 3204227 33554432000 4194304 5849740 140737474323632 140737474322632 5260488 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3687960 3204227 624 405 0 3684904 0
Current children cumulated CPU time: 1302.18 s
Current children cumulated vsize: 14751840 KiB
Current children cumulated memory: 12816908 KiB

[startup+1362.3 s]
/proc/loadavg: 2.08 2.03 1.80 3/192 27532
/proc/meminfo: memFree=5380796/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14851452 memory=12918272 CPUtime=1362.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1680514 0 0 0 123538 12680 0 0 20 0 1 0 60849307 15207886848 3229568 33554432000 4194304 5849740 140737474323632 140737474322632 5269544 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3712863 3229568 624 405 0 3709807 0
Current children cumulated CPU time: 1362.18 s
Current children cumulated vsize: 14851452 KiB
Current children cumulated memory: 12918272 KiB

[startup+1422.3 s]
/proc/loadavg: 2.03 2.03 1.81 3/192 27532
/proc/meminfo: memFree=9496496/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=14967660 memory=9722484 CPUtime=1422.19 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1710782 0 0 0 128970 13249 0 0 20 0 1 0 60849307 15326883840 2430109 33554432000 4194304 5849740 140737474323632 140737474322632 5269185 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3741915 2430621 624 405 0 3738859 0
Current children cumulated CPU time: 1422.19 s
Current children cumulated vsize: 14967660 KiB
Current children cumulated memory: 9722484 KiB

[startup+1482.3 s]
/proc/loadavg: 2.01 2.02 1.82 3/192 27533
/proc/meminfo: memFree=4915660/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=15067264 memory=13131376 CPUtime=1482.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1739957 0 0 0 134360 13858 0 0 20 0 1 0 60849307 15428878336 3282844 33554432000 4194304 5849740 140737474323632 140737474322632 5260216 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 3766816 3282844 624 405 0 3763760 0
Current children cumulated CPU time: 1482.18 s
Current children cumulated vsize: 15067264 KiB
Current children cumulated memory: 13131376 KiB

[startup+1542.3 s]
/proc/loadavg: 2.15 2.05 1.84 3/192 27534
/proc/meminfo: memFree=10811212/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=7336720 CPUtime=1542.18 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1764057 0 0 0 139862 14356 0 0 20 0 1 0 60849307 11855441920 1834180 33554432000 4194304 5849740 140737474323632 140737474322600 5249600 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 1834180 624 405 0 2891339 0
Current children cumulated CPU time: 1542.18 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 7336720 KiB

[startup+1561.32 s]
# the end of solver process 27398 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1417.26 s, system=143.948 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1548.8 s]
/proc/loadavg: 2.14 2.05 1.84 3/192 27535
/proc/meminfo: memFree=8414136/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9599760 CPUtime=1548.68 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1765938 0 0 0 140477 14391 0 0 20 0 1 0 60849307 11855441920 2399940 33554432000 4194304 5849740 140737474323632 140737474322600 4932587 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2399940 624 405 0 2891339 0
Current children cumulated CPU time: 1548.68 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9599760 KiB

[startup+1555.2 s]
/proc/loadavg: 2.12 2.04 1.85 3/192 27535
/proc/meminfo: memFree=8414264/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9599768 CPUtime=1555.08 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1766468 0 0 0 141117 14391 0 0 20 0 1 0 60849307 11855441920 2399942 33554432000 4194304 5849740 140737474323632 140737474322952 4490416 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2399942 624 405 0 2891339 0
Current children cumulated CPU time: 1555.08 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9599768 KiB

[startup+1558.4 s]
/proc/loadavg: 2.12 2.04 1.85 3/192 27535
/proc/meminfo: memFree=8404956/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9599768 CPUtime=1558.28 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1766479 0 0 0 141437 14391 0 0 20 0 1 0 60849307 11855441920 2399942 33554432000 4194304 5849740 140737474323632 140737474322952 4495197 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2399942 624 405 0 2891339 0
Current children cumulated CPU time: 1558.28 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9599768 KiB

[startup+1560 s]*
/proc/loadavg: 2.11 2.04 1.85 3/192 27535
/proc/meminfo: memFree=8404956/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9599768 CPUtime=1559.89 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1766485 0 0 0 141598 14391 0 0 20 0 1 0 60849307 11855441920 2399942 33554432000 4194304 5849740 140737474323632 140737474322952 4465958 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2399942 624 405 0 2891339 0
Current children cumulated CPU time: 1559.89 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9599768 KiB

[startup+1560.8 s]
/proc/loadavg: 2.11 2.04 1.85 3/192 27535
/proc/meminfo: memFree=8404956/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9599768 CPUtime=1560.68 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1766488 0 0 0 141677 14391 0 0 20 0 1 0 60849307 11855441920 2399942 33554432000 4194304 5849740 140737474323632 140737474322952 4488307 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2399942 624 405 0 2891339 0
Current children cumulated CPU time: 1560.68 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9599768 KiB

[startup+1561.2 s]
/proc/loadavg: 2.11 2.04 1.85 3/192 27535
/proc/meminfo: memFree=8404956/32770624 swapFree=67108860/67108860
[pid=27398] ppid=27395 vsize=11577580 memory=9601816 CPUtime=1561.08 cores=0,2,4,6
/proc/27398/stat : 27398 (xcsp_picat) R 27395 27398 27337 0 -1 4202496 1766666 0 0 0 141717 14391 0 0 20 0 1 0 60849307 11855441920 2400454 33554432000 4194304 5849740 140737474323632 140737474322952 5257111 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9399828 23896064 140737474327734 140737474327812 140737474327812 140737474330570 0
/proc/27398/statm: 2894395 2400454 624 405 0 2891339 0
Current children cumulated CPU time: 1561.08 s
Current children cumulated vsize: 11577580 KiB
Current children cumulated memory: 9601816 KiB

[startup+1561.3 s]*
/proc/loadavg: 2.11 2.04 1.85 3/192 27535
/proc/meminfo: memFree=12317420/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 1561.32
CPU time (s): 1561.21
CPU user time (s): 1417.26
CPU system time (s): 143.948
CPU usage (%): 99.993
Max. virtual memory (cumulated for all children) (KiB): 15150276
Max. memory (cumulated for all children) (KiB): 13214204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1417.26
system time used= 143.948
maximum resident set size= 13214204
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1766946
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1191


# summary of solver processes directly reported to runsolver:
#   pid: 27398
#   total CPU time (s): 1561.21
#   total CPU user time (s): 1417.26
#   total CPU system time (s): 143.948

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.50883 second user time and 11.6232 second system time

The end

Launcher Data 

Begin job on node132 at 2018-07-24 13:47:41
IDJOB=4293988
IDBENCH=141307
IDSOLVER=2754
FILE ID=node132/4293988-1532432861
RUNJOBID= node132-1532432860-27368
PBS_JOBID= 21021577
Free space on /tmp= 52408 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/CrosswordDesign/CrosswordDesign-12-4-rom_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4293988-1532432861/watcher-4293988-1532432861 -o /tmp/evaluation-result-4293988-1532432861/solver-4293988-1532432861 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node132-1532432860-27368 --watchdog 2580  xcsp_picat HOME/instance-4293988-1532432861.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 81778793cf44fcc277d17f448f65fa63
RANDOM SEED=1788848535

node132.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        15198096 kB
MemAvailable:   31866480 kB
Buffers:          273220 kB
Cached:         16459472 kB
SwapCached:            0 kB
Active:          2797448 kB
Inactive:       14059272 kB
Active(anon):     126764 kB
Inactive(anon):    16996 kB
Active(file):    2670684 kB
Inactive(file): 14042276 kB
Unevictable:        7020 kB
Mlocked:            7020 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             74344 kB
Writeback:             0 kB
AnonPages:        108420 kB
Mapped:            40292 kB
Shmem:             17056 kB
Slab:             411288 kB
SReclaimable:     383884 kB
SUnreclaim:        27404 kB
KernelStack:        3328 kB
PageTables:         5208 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     473444 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     45056 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 52408 MiB
End job on node132 at 2018-07-24 14:13:43