Trace number 4395718

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2019-09-12? (TO) 2400.1 2399.91

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-09-350-100.xml
MD5SUM9444e44f99a0ffd374c39bd698e45a3a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark63
Best CPU time to get the best result obtained on this benchmark2400.15
Satisfiable
(Un)Satisfiability was proved
Number of variables3151
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size330
Distribution of domain sizes[{"size":2,"count":3150},{"size":330,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":3150},{"degree":37,"count":1}]
Minimum constraint arity350
Maximum constraint arity3150
Distribution of constraint arities[{"arity":350,"count":9},{"arity":701,"count":36},{"arity":3150,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

32.39/32.47	c xcsp_picat version 2.7b12 (9/12/2019)
67.60/67.65	o 130
103.50/103.50	o 57
150.60/150.64	o 32
389.21/389.23	o 24

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13512 MiB free)
  memory of node 1: 16384 MiB (15887 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4395718-1568328931/watcher-4395718-1568328931 -o /tmp/evaluation-result-4395718-1568328931/solver-4395718-1568328931 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568323423-22107 --watchdog 2560 xcsp_picat HOME/instance-4395718-1568328931.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=23672, runsolver pid=23669
Current StackSize limit: 8192 KiB


[startup+0.100168 s]*
/proc/loadavg: 2.05 2.07 2.06 3/201 23673
/proc/meminfo: memFree=30072972/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2031716 memory=35420 CPUtime=0.1 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 1347 0 0 0 10 0 0 0 20 0 1 0 409141789 2080477184 8855 33554432000 4194304 5870510 140735999674352 140735999671496 4477272 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 507929 8855 867 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 35420 KiB

[startup+0.209879 s]*
/proc/loadavg: 2.05 2.07 2.06 3/201 23673
/proc/meminfo: memFree=30058948/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2031716 memory=51064 CPUtime=0.2 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 1694 0 0 0 20 0 0 0 20 0 1 0 409141789 2080477184 12766 33554432000 4194304 5870510 140735999674352 140735999671496 4460444 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 507929 12766 871 410 0 503402 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 51064 KiB

[startup+0.30981 s]*
/proc/loadavg: 2.21 2.10 2.07 3/201 23673
/proc/meminfo: memFree=30042440/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2031716 memory=69496 CPUtime=0.31 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 1703 0 0 0 30 1 0 0 20 0 1 0 409141789 2080477184 17374 33554432000 4194304 5870510 140735999674352 140735999671496 4524549 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 507929 17374 871 410 0 503402 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 69496 KiB

[startup+0.700348 s]
/proc/loadavg: 2.21 2.10 2.07 3/201 23673
/proc/meminfo: memFree=30030652/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2044024 memory=81024 CPUtime=0.69 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 3676 0 0 0 58 11 0 0 20 0 1 0 409141789 2093080576 20256 33554432000 4194304 5870510 140735999674352 140735999671496 139684292173703 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 511006 20256 932 410 0 506479 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2044024 KiB
Current children cumulated memory: 81024 KiB

[startup+1.50028 s]
/proc/loadavg: 2.21 2.10 2.07 3/201 23673
/proc/meminfo: memFree=30012184/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2059204 memory=96036 CPUtime=1.5 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 7567 0 0 0 135 15 0 0 20 0 1 0 409141789 2108624896 24009 33554432000 4194304 5870510 140735999674352 140735999672968 139684291706396 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 514801 24009 949 410 0 510274 0
Current children cumulated CPU time: 1.5 s
Current children cumulated vsize: 2059204 KiB
Current children cumulated memory: 96036 KiB

[startup+3.10945 s]
/proc/loadavg: 2.21 2.10 2.07 3/201 23673
/proc/meminfo: memFree=30009164/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2059940 memory=98912 CPUtime=3.1 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 8009 0 0 0 295 15 0 0 20 0 1 0 409141789 2109378560 24728 33554432000 4194304 5870510 140735999674352 140735999673448 5477031 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 514985 24728 952 410 0 510458 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2059940 KiB
Current children cumulated memory: 98912 KiB

[startup+6.30027 s]
/proc/loadavg: 2.19 2.10 2.07 3/200 23673
/proc/meminfo: memFree=30006212/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2065720 memory=102164 CPUtime=6.29 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 10764 0 0 0 612 17 0 0 20 0 1 0 409141789 2115297280 25541 33554432000 4194304 5870510 140735999674352 140735999673448 5406673 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 516430 25541 952 410 0 511903 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2065720 KiB
Current children cumulated memory: 102164 KiB

[startup+12.7003 s]
/proc/loadavg: 2.18 2.10 2.07 3/200 23673
/proc/meminfo: memFree=29997160/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2081500 memory=111800 CPUtime=12.69 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 18015 0 0 0 1250 19 0 0 20 0 1 0 409141789 2131456000 27950 33554432000 4194304 5870510 140735999674352 140735999673448 5406920 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 520375 27950 952 410 0 515848 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2081500 KiB
Current children cumulated memory: 111800 KiB

[startup+25.5004 s]
/proc/loadavg: 2.15 2.09 2.07 3/199 23674
/proc/meminfo: memFree=29951016/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2127028 memory=157216 CPUtime=25.49 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 38953 0 0 0 2526 23 0 0 20 0 1 0 409141789 2178076672 39304 33554432000 4194304 5870510 140735999674352 140735999673160 5282578 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 531757 39304 985 410 0 527230 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2127028 KiB
Current children cumulated memory: 157216 KiB

[startup+51.1093 s]
/proc/loadavg: 2.09 2.08 2.06 3/199 23677
/proc/meminfo: memFree=29979928/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2089768 memory=124724 CPUtime=51.1 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 56622 0 0 0 5070 40 0 0 20 0 1 0 409141789 2139922432 31181 33554432000 4194304 5870510 140735999674352 140735999673448 5557788 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 522442 31181 992 410 0 517915 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2089768 KiB
Current children cumulated memory: 124724 KiB

[startup+102.3 s]
/proc/loadavg: 2.04 2.07 2.06 3/199 23681
/proc/meminfo: memFree=29917696/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2151492 memory=186180 CPUtime=102.3 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 84398 0 0 0 10168 62 0 0 20 0 1 0 409141789 2203127808 46545 33554432000 4194304 5870510 140735999674352 140735999672920 5262800 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 537873 46545 992 410 0 533346 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2151492 KiB
Current children cumulated memory: 186180 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.06 2.05 3/199 23685
/proc/meminfo: memFree=29919344/32770624 swapFree=67001416/67108860
[pid=23672] ppid=23669 vsize=2161932 memory=173424 CPUtime=162.3 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 105730 0 0 0 16147 83 0 0 20 0 1 0 409141789 2213818368 43356 33554432000 4194304 5870510 140735999674352 140735999673464 5288971 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 540483 43356 992 410 0 535956 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 2161932 KiB
Current children cumulated memory: 173424 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/199 23690
/proc/meminfo: memFree=29938376/32770624 swapFree=67001424/67108860
[pid=23672] ppid=23669 vsize=2179524 memory=209020 CPUtime=222.3 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 110769 0 0 0 22145 85 0 0 20 0 1 0 409141789 2231832576 52255 33554432000 4194304 5870510 140735999674352 140735999672792 5282505 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 544881 52255 992 410 0 540354 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 2179524 KiB
Current children cumulated memory: 209020 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 23696
/proc/meminfo: memFree=29933864/32770624 swapFree=67001424/67108860
[pid=23672] ppid=23669 vsize=2179524 memory=213556 CPUtime=282.3 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 111182 0 0 0 28145 85 0 0 20 0 1 0 409141789 2231832576 53389 33554432000 4194304 5870510 140735999674352 140735999672792 5283024 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 544881 53389 992 410 0 540354 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 2179524 KiB
Current children cumulated memory: 213556 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 23709
/proc/meminfo: memFree=29841076/32770624 swapFree=67001432/67108860
[pid=23672] ppid=23669 vsize=2198200 memory=240760 CPUtime=342.31 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 114094 0 0 0 34143 88 0 0 20 0 1 0 409141789 2250956800 60190 33554432000 4194304 5870510 140735999674352 140735999672920 5272528 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 549550 60190 992 410 0 545023 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 2198200 KiB
Current children cumulated memory: 240760 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/201 23738
/proc/meminfo: memFree=29928152/32770624 swapFree=67001452/67108860
[pid=23672] ppid=23669 vsize=2131516 memory=170888 CPUtime=402.31 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 125217 0 0 0 40121 110 0 0 20 0 1 0 409141789 2182672384 42722 33554432000 4194304 5870510 140735999674352 140735999673464 5281796 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 532879 42722 992 410 0 528352 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 2131516 KiB
Current children cumulated memory: 170888 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 23744
/proc/meminfo: memFree=29876308/32770624 swapFree=67001452/67108860
[pid=23672] ppid=23669 vsize=2181712 memory=224332 CPUtime=462.31 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 126915 0 0 0 46120 111 0 0 20 0 1 0 409141789 2234073088 56083 33554432000 4194304 5870510 140735999674352 140735999672792 5272392 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 545428 56083 992 410 0 540901 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 2181712 KiB
Current children cumulated memory: 224332 KiB


################
# More data... #
################

/proc/23672/statm: 564306 71382 992 410 0 559779 0
Current children cumulated CPU time: 1662.42 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 285528 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23920
/proc/meminfo: memFree=27862348/32770624 swapFree=67001476/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=287744 CPUtime=1722.43 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 233260 0 0 0 172065 178 0 0 20 0 1 0 409141789 2311397376 71936 33554432000 4194304 5870510 140735999674352 140735999673368 5282429 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 71936 992 410 0 559779 0
Current children cumulated CPU time: 1722.43 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 287744 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23924
/proc/meminfo: memFree=27806980/32770624 swapFree=67001476/67108860
[pid=23672] ppid=23669 vsize=2288044 memory=308212 CPUtime=1782.43 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 245095 0 0 0 178058 185 0 0 20 0 1 0 409141789 2342957056 77053 33554432000 4194304 5870510 140735999674352 140735999673304 5282747 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 572011 77053 992 410 0 567484 0
Current children cumulated CPU time: 1782.43 s
Current children cumulated vsize: 2288044 KiB
Current children cumulated memory: 308212 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23929
/proc/meminfo: memFree=27827156/32770624 swapFree=67001480/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=285528 CPUtime=1842.44 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 258828 0 0 0 184053 191 0 0 20 0 1 0 409141789 2311397376 71382 33554432000 4194304 5870510 140735999674352 140735999672792 5283024 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 71382 992 410 0 559779 0
Current children cumulated CPU time: 1842.44 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 285528 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23935
/proc/meminfo: memFree=27870264/32770624 swapFree=67001480/67108860
[pid=23672] ppid=23669 vsize=2207904 memory=250704 CPUtime=1902.45 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 258952 0 0 0 190052 193 0 0 20 0 1 0 409141789 2260893696 62676 33554432000 4194304 5870510 140735999674352 140735999673368 5258735 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 551976 62676 992 410 0 547449 0
Current children cumulated CPU time: 1902.45 s
Current children cumulated vsize: 2207904 KiB
Current children cumulated memory: 250704 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23939
/proc/meminfo: memFree=27833084/32770624 swapFree=67001480/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=289792 CPUtime=1962.45 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 269538 0 0 0 196048 197 0 0 20 0 1 0 409141789 2311397376 72448 33554432000 4194304 5870510 140735999674352 140735999673368 5274519 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 72448 992 410 0 559779 0
Current children cumulated CPU time: 1962.45 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 289792 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23943
/proc/meminfo: memFree=27846540/32770624 swapFree=67001484/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=283480 CPUtime=2022.45 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 270138 0 0 0 202043 202 0 0 20 0 1 0 409141789 2311397376 70870 33554432000 4194304 5870510 140735999674352 140735999673368 5282464 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 70870 992 410 0 559779 0
Current children cumulated CPU time: 2022.45 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 283480 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 23949
/proc/meminfo: memFree=27812808/32770624 swapFree=67001484/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=289792 CPUtime=2082.45 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 281287 0 0 0 208036 209 0 0 20 0 1 0 409141789 2311397376 72448 33554432000 4194304 5870510 140735999674352 140735999673368 5258443 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 72448 992 410 0 559779 0
Current children cumulated CPU time: 2082.45 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 289792 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23961
/proc/meminfo: memFree=27824644/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=283648 CPUtime=2142.46 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 294120 0 0 0 214028 218 0 0 20 0 1 0 409141789 2311397376 70912 33554432000 4194304 5870510 140735999674352 140735999673368 5282578 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 70912 992 410 0 559779 0
Current children cumulated CPU time: 2142.46 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 283648 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23965
/proc/meminfo: memFree=27828504/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=289624 CPUtime=2202.47 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 306275 0 0 0 220026 221 0 0 20 0 1 0 409141789 2311397376 72406 33554432000 4194304 5870510 140735999674352 140735999672792 5282367 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 72406 992 410 0 559779 0
Current children cumulated CPU time: 2202.47 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 289624 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23971
/proc/meminfo: memFree=27849712/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=283648 CPUtime=2262.48 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 306916 0 0 0 226024 224 0 0 20 0 1 0 409141789 2311397376 70912 33554432000 4194304 5870510 140735999674352 140735999673368 5282574 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 70912 992 410 0 559779 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 283648 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23975
/proc/meminfo: memFree=27812732/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=287744 CPUtime=2322.47 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 317460 0 0 0 232020 227 0 0 20 0 1 0 409141789 2311397376 71936 33554432000 4194304 5870510 140735999674352 140735999673368 5288842 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 71936 992 410 0 559779 0
Current children cumulated CPU time: 2322.47 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 287744 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23979
/proc/meminfo: memFree=27810596/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=291840 CPUtime=2382.48 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 329719 0 0 0 238015 233 0 0 20 0 1 0 409141789 2311397376 72960 33554432000 4194304 5870510 140735999674352 140735999673368 5262766 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 72960 992 410 0 559779 0
Current children cumulated CPU time: 2382.48 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 291840 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23982
/proc/meminfo: memFree=27800884/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=293720 CPUtime=2400.08 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 330959 0 0 0 239772 236 0 0 20 0 1 0 409141789 2311397376 73430 33554432000 4194304 5870510 140735999674352 140735999673368 5282680 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 73430 992 410 0 559779 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 293720 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.91 s]
# the end of solver process 23672 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2397.73 s, system=2.3692 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 23982
/proc/meminfo: memFree=27800884/32770624 swapFree=67001496/67108860
[pid=23672] ppid=23669 vsize=2257224 memory=293720 CPUtime=2400.08 cores=1,3,5,7
/proc/23672/stat : 23672 (xcsp_picat) R 23669 23672 22075 0 -1 4202496 330959 0 0 0 239772 236 0 0 20 0 1 0 409141789 2311397376 73430 33554432000 4194304 5870510 140735999674352 140735999673368 5282680 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 26820608 140735999677471 140735999677549 140735999677549 140735999680458 0
/proc/23672/statm: 564306 73430 992 410 0 559779 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 2257224 KiB
Current children cumulated memory: 293720 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2399.91
CPU time (s): 2400.1
CPU user time (s): 2397.73
CPU system time (s): 2.3692
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 2418272
Max. memory (cumulated for all children) (KiB): 364156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2397.73
system time used= 2.3692
maximum resident set size= 393436
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 330959
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 27
involuntary context switches= 1954


# summary of solver processes directly reported to runsolver:
#   pid: 23672
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2397.73
#   total CPU system time (s): 2.3692

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.62824 second user time and 17.8081 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-13 00:54:47
IDJOB=4395718
IDBENCH=122967
IDSOLVER=2845
FILE ID=node136/4395718-1568328931
RUNJOBID= node136-1568323423-22107
PBS_JOBID= 21701143
Free space on /tmp= 56788 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-09-350-100.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4395718-1568328931/watcher-4395718-1568328931 -o /tmp/evaluation-result-4395718-1568328931/solver-4395718-1568328931 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568323423-22107 --watchdog 2560  xcsp_picat HOME/instance-4395718-1568328931.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9444e44f99a0ffd374c39bd698e45a3a
RANDOM SEED=652725021

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30104840 kB
MemAvailable:   31639620 kB
Buffers:           65396 kB
Cached:          1750240 kB
SwapCached:         3908 kB
Active:          1138452 kB
Inactive:         943708 kB
Active(anon):     264444 kB
Inactive(anon):    41884 kB
Active(file):     874008 kB
Inactive(file):   901824 kB
Unevictable:      107452 kB
Mlocked:          107452 kB
SwapTotal:      67108860 kB
SwapFree:       67001416 kB
Dirty:              3152 kB
Writeback:             0 kB
AnonPages:        371352 kB
Mapped:            44200 kB
Shmem:             31316 kB
Slab:             178628 kB
SReclaimable:     149564 kB
SUnreclaim:        29064 kB
KernelStack:        3536 kB
PageTables:         6136 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2779968 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    284672 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 56784 MiB
End job on node136 at 2019-09-13 01:34:47