Trace number 4407561

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.1 2400.06

General information on the benchmark

NameRandom/Random-m1-10-60-20/
rand-10-60-20-30-51200-43.xml
MD5SUMb8d48d817bcc13bb1c11a01b9e9dbb1a
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark13.5942
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of constraints30
Number of domains1
Minimum domain size20
Maximum domain size20
Distribution of domain sizes[{"size":20,"count":60}]
Minimum variable degree1
Maximum variable degree9
Distribution of variable degrees[{"degree":1,"count":1},{"degree":2,"count":3},{"degree":3,"count":8},{"degree":4,"count":14},{"degree":5,"count":10},{"degree":6,"count":12},{"degree":7,"count":6},{"degree":8,"count":5},{"degree":9,"count":1}]
Minimum constraint arity10
Maximum constraint arity10
Distribution of constraint arities[{"arity":10,"count":30}]
Number of extensional constraints30
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":30}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13327 MiB free)
  memory of node 1: 16384 MiB (11651 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407561-1569509642/watcher-4407561-1569509642 -o /var/tmp/evaluation-result-4407561-1569509642/solver-4407561-1569509642 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node119-1569509600-6250 --watchdog 2560 xcsp_picat HOME/instance-4407561-1569509642.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=6279, runsolver pid=6276
Current StackSize limit: 8192 KiB


[startup+0.100119 s]*
/proc/loadavg: 0.08 0.03 0.05 4/199 6280
/proc/meminfo: memFree=25565048/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=17100 CPUtime=0.1 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1912 0 0 0 10 0 0 0 20 0 1 0 526878991 2080477184 4275 33554432000 4194304 5870510 140736943207856 140736943207160 4451717 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 4275 834 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 17100 KiB

[startup+0.20963 s]*
/proc/loadavg: 0.08 0.03 0.05 3/199 6280
/proc/meminfo: memFree=25557788/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=23244 CPUtime=0.21 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1915 0 0 0 21 0 0 0 20 0 1 0 526878991 2080477184 5811 33554432000 4194304 5870510 140736943207856 140736943207160 139991527812096 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 5811 834 410 0 503402 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 23244 KiB

[startup+0.309583 s]*
/proc/loadavg: 0.08 0.03 0.05 3/199 6280
/proc/meminfo: memFree=25553320/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=29388 CPUtime=0.31 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1922 0 0 0 31 0 0 0 20 0 1 0 526878991 2080477184 7347 33554432000 4194304 5870510 140736943207856 140736943207160 4826828 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 7347 834 410 0 503402 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 29388 KiB

[startup+0.700314 s]
/proc/loadavg: 0.08 0.03 0.05 3/199 6280
/proc/meminfo: memFree=25540288/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=47820 CPUtime=0.7 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1932 0 0 0 69 1 0 0 20 0 1 0 526878991 2080477184 11955 33554432000 4194304 5870510 140736943207856 140736943207160 4456145 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 11955 834 410 0 503402 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 47820 KiB

[startup+1.50032 s]
/proc/loadavg: 0.08 0.03 0.05 3/199 6280
/proc/meminfo: memFree=25513380/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=88952 CPUtime=1.49 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1952 0 0 0 148 1 0 0 20 0 1 0 526878991 2080477184 22238 33554432000 4194304 5870510 140736943207856 140736943207160 4461503 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 22238 839 410 0 503402 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 88952 KiB

[startup+3.10952 s]
/proc/loadavg: 0.08 0.03 0.05 3/199 6280
/proc/meminfo: memFree=25404472/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=172920 CPUtime=3.1 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 2013 0 0 0 307 3 0 0 20 0 1 0 526878991 2080477184 43230 33554432000 4194304 5870510 140736943207856 140736943207160 139991527812096 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 43230 839 410 0 503402 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 172920 KiB

[startup+6.3003 s]
/proc/loadavg: 0.24 0.06 0.06 3/199 6280
/proc/meminfo: memFree=25238424/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2031716 memory=334712 CPUtime=6.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 2128 0 0 0 624 5 0 0 20 0 1 0 526878991 2080477184 83678 33554432000 4194304 5870510 140736943207856 140736943207160 139991527812096 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 507929 83678 839 410 0 503402 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 334712 KiB

[startup+12.7003 s]
/proc/loadavg: 0.38 0.10 0.07 3/199 6280
/proc/meminfo: memFree=24679596/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2338872 memory=933556 CPUtime=12.69 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 9405 0 0 0 1241 28 0 0 20 0 1 0 526878991 2395004928 233389 33554432000 4194304 5870510 140736943207856 140736943206824 5246661 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 584718 233389 863 410 0 580191 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2338872 KiB
Current children cumulated memory: 933556 KiB

[startup+25.5004 s]
/proc/loadavg: 0.74 0.19 0.10 3/200 6282
/proc/meminfo: memFree=23940708/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=2722744 memory=1606216 CPUtime=25.49 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 18557 0 0 0 2469 80 0 0 20 0 1 0 526878991 2788089856 401554 33554432000 4194304 5870510 140736943207856 140736943206824 5246367 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 680686 401554 864 410 0 676159 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2722744 KiB
Current children cumulated memory: 1606216 KiB

[startup+51.1097 s]
/proc/loadavg: 1.17 0.34 0.15 3/199 6282
/proc/meminfo: memFree=23350068/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=3002536 memory=2183988 CPUtime=51.1 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 30904 0 0 0 4929 181 0 0 20 0 1 0 526878991 3074596864 545997 33554432000 4194304 5870510 140736943207856 140736943206824 5246661 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 750634 545997 864 410 0 746107 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 3002536 KiB
Current children cumulated memory: 2183988 KiB

[startup+102.3 s]
/proc/loadavg: 1.60 0.58 0.24 3/199 6351
/proc/meminfo: memFree=20714120/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=3342428 memory=2843364 CPUtime=102.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 52760 0 0 0 9841 388 0 0 20 0 1 0 526878991 3422646272 710841 33554432000 4194304 5870510 140736943207856 140736943207176 5245088 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 835607 710841 864 410 0 831080 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 3342428 KiB
Current children cumulated memory: 2843364 KiB

[startup+162.3 s]
/proc/loadavg: 1.80 0.82 0.35 3/200 6357
/proc/meminfo: memFree=20704480/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=3619672 memory=3008048 CPUtime=162.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 80016 0 0 0 15517 712 0 0 20 0 1 0 526878991 3706544128 752012 33554432000 4194304 5870510 140736943207856 140736943206824 5246685 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 904918 752012 864 410 0 900391 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 3619672 KiB
Current children cumulated memory: 3008048 KiB

[startup+222.3 s]
/proc/loadavg: 1.93 1.04 0.45 3/199 6361
/proc/meminfo: memFree=17977532/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7748880 memory=5574000 CPUtime=222.3 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 231928 0 0 0 21254 976 0 0 20 0 1 0 526878991 7934853120 1393500 33554432000 4194304 5870510 140736943207856 140736943206184 5337297 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1937220 1393500 883 410 0 1932693 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 7748880 KiB
Current children cumulated memory: 5574000 KiB

[startup+282.3 s]
/proc/loadavg: 1.97 1.21 0.55 3/199 6366
/proc/meminfo: memFree=17977512/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7749308 memory=5574472 CPUtime=282.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 268052 0 0 0 27252 977 0 0 20 0 1 0 526878991 7935291392 1393618 33554432000 4194304 5870510 140736943207856 140736943206184 5337297 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1937327 1393618 883 410 0 1932800 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 7749308 KiB
Current children cumulated memory: 5574472 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 1.35 0.64 3/200 6372
/proc/meminfo: memFree=17975804/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7750588 memory=5575460 CPUtime=342.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 386420 0 0 0 33247 982 0 0 20 0 1 0 526878991 7936602112 1393865 33554432000 4194304 5870510 140736943207856 140736943206184 5321680 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1937647 1393865 883 410 0 1933120 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 7750588 KiB
Current children cumulated memory: 5575460 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.47 0.72 3/199 6383
/proc/meminfo: memFree=17975624/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7750588 memory=5575584 CPUtime=402.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 489877 0 0 0 39243 986 0 0 20 0 1 0 526878991 7936602112 1393896 33554432000 4194304 5870510 140736943207856 140736943206184 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1937647 1393896 883 410 0 1933120 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 7750588 KiB
Current children cumulated memory: 5575584 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.57 0.80 3/200 6410
/proc/meminfo: memFree=17974340/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7751228 memory=5576136 CPUtime=462.29 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 547694 0 0 0 45240 989 0 0 20 0 1 0 526878991 7937257472 1394034 33554432000 4194304 5870510 140736943207856 140736943206184 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1937807 1394034 883 410 0 1933280 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 7751228 KiB
Current children cumulated memory: 5576136 KiB


################
# More data... #
################

/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1602.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 1.99 1.68 3/200 6521
/proc/meminfo: memFree=17964068/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1662.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1470916 0 0 0 165181 1051 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5261019 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1662.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 1.99 1.70 3/200 6525
/proc/meminfo: memFree=17963464/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1722.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1508897 0 0 0 171178 1054 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5337288 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1722.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.71 3/201 6531
/proc/meminfo: memFree=17964060/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1782.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1547333 0 0 0 177175 1057 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5321686 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1782.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 1.73 3/200 6535
/proc/meminfo: memFree=17963472/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1842.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1588038 0 0 0 183173 1059 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5261111 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1842.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1902.3 s]
/proc/loadavg: 2.57 2.14 1.80 3/199 6540
/proc/meminfo: memFree=17963384/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1902.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1624326 0 0 0 189171 1061 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5337288 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1902.32 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+1962.3 s]
/proc/loadavg: 2.21 2.12 1.81 3/200 6546
/proc/meminfo: memFree=17963312/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7753148 memory=5579440 CPUtime=1962.33 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1660707 0 0 0 195169 1064 0 0 20 0 1 0 526878991 7939223552 1394860 33554432000 4194304 5870510 140736943207856 140736943206184 5337306 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1938287 1394860 883 410 0 1933760 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 7753148 KiB
Current children cumulated memory: 5579440 KiB

[startup+2022.3 s]
/proc/loadavg: 2.08 2.10 1.82 3/199 6550
/proc/meminfo: memFree=17939436/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7776504 memory=5603008 CPUtime=2022.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1713069 0 0 0 201164 1068 0 0 20 0 1 0 526878991 7963140096 1400752 33554432000 4194304 5870510 140736943207856 140736943206872 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944126 1400752 883 410 0 1939599 0
Current children cumulated CPU time: 2022.32 s
Current children cumulated vsize: 7776504 KiB
Current children cumulated memory: 5603008 KiB

[startup+2082.3 s]
/proc/loadavg: 2.03 2.08 1.84 3/199 6555
/proc/meminfo: memFree=17939212/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7777144 memory=5603760 CPUtime=2082.33 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1754067 0 0 0 207161 1072 0 0 20 0 1 0 526878991 7963795456 1400940 33554432000 4194304 5870510 140736943207856 140736943206184 5321611 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944286 1400940 883 410 0 1939759 0
Current children cumulated CPU time: 2082.33 s
Current children cumulated vsize: 7777144 KiB
Current children cumulated memory: 5603760 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.06 1.85 3/200 6561
/proc/meminfo: memFree=17930876/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7777784 memory=5604512 CPUtime=2142.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1793809 0 0 0 213158 1074 0 0 20 0 1 0 526878991 7964450816 1401128 33554432000 4194304 5870510 140736943207856 140736943206184 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944446 1401128 883 410 0 1939919 0
Current children cumulated CPU time: 2142.32 s
Current children cumulated vsize: 7777784 KiB
Current children cumulated memory: 5604512 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.05 1.86 3/200 6573
/proc/meminfo: memFree=17928016/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7778424 memory=5605104 CPUtime=2202.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1839081 0 0 0 219155 1077 0 0 20 0 1 0 526878991 7965106176 1401276 33554432000 4194304 5870510 140736943207856 140736943206184 5321694 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944606 1401276 883 410 0 1940079 0
Current children cumulated CPU time: 2202.32 s
Current children cumulated vsize: 7778424 KiB
Current children cumulated memory: 5605104 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 1.87 3/200 6577
/proc/meminfo: memFree=17928920/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7778424 memory=5605104 CPUtime=2262.33 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1869332 0 0 0 225154 1079 0 0 20 0 1 0 526878991 7965106176 1401276 33554432000 4194304 5870510 140736943207856 140736943206184 5261111 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944606 1401276 883 410 0 1940079 0
Current children cumulated CPU time: 2262.33 s
Current children cumulated vsize: 7778424 KiB
Current children cumulated memory: 5605104 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 1.87 3/201 6583
/proc/meminfo: memFree=17929440/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7778424 memory=5605104 CPUtime=2322.32 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1902969 0 0 0 231151 1081 0 0 20 0 1 0 526878991 7965106176 1401276 33554432000 4194304 5870510 140736943207856 140736943206184 5337393 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944606 1401276 883 410 0 1940079 0
Current children cumulated CPU time: 2322.32 s
Current children cumulated vsize: 7778424 KiB
Current children cumulated memory: 5605104 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.03 1.88 3/200 6587
/proc/meminfo: memFree=17929840/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7778424 memory=5605104 CPUtime=2382.33 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1934216 0 0 0 237149 1084 0 0 20 0 1 0 526878991 7965106176 1401276 33554432000 4194304 5870510 140736943207856 140736943206184 5337306 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944606 1401276 883 410 0 1940079 0
Current children cumulated CPU time: 2382.33 s
Current children cumulated vsize: 7778424 KiB
Current children cumulated memory: 5605104 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400 s]*
/proc/loadavg: 2.08 2.05 1.89 3/200 6587
/proc/meminfo: memFree=17929872/32770624 swapFree=66954172/67108860
[pid=6279] ppid=6276 vsize=7778424 memory=5605104 CPUtime=2400.04 cores=1,3,5,7
/proc/6279/stat : 6279 (xcsp_picat) R 6276 6279 6218 0 -1 4202496 1943932 0 0 0 238919 1085 0 0 20 0 1 0 526878991 7965106176 1401276 33554432000 4194304 5870510 140736943207856 140736943206184 5337529 0 0 4096 8389634 0 0 0 17 3 0 0 0 0 0 7970040 9572284 31199232 140736943211527 140736943211609 140736943211609 140736943214534 0
/proc/6279/statm: 1944606 1401276 883 410 0 1940079 0
Current children cumulated CPU time: 2400.04 s
Current children cumulated vsize: 7778424 KiB
Current children cumulated memory: 5605104 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.06 s]
# the end of solver process 6279 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2389.2 s, system=10.8992 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.06
CPU time (s): 2400.1
CPU user time (s): 2389.2
CPU system time (s): 10.8992
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 7778424
Max. memory (cumulated for all children) (KiB): 5708984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2389.2
system time used= 10.8992
maximum resident set size= 5708984
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1943933
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20
involuntary context switches= 1356


# summary of solver processes directly reported to runsolver:
#   pid: 6279
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2389.2
#   total CPU system time (s): 10.8992

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.98756 second user time and 18.4077 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-26 16:53:21
IDJOB=4407561
IDBENCH=121853
IDSOLVER=2873
FILE ID=node119/4407561-1569509642
RUNJOBID= node119-1569509600-6250
PBS_JOBID= 21705795
Free space on /var/tmp= 13472 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/Random/Random-m1-10-60-20/rand-10-60-20-30-51200-43.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407561-1569509642/watcher-4407561-1569509642 -o /var/tmp/evaluation-result-4407561-1569509642/solver-4407561-1569509642 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node119-1569509600-6250 --watchdog 2560  xcsp_picat HOME/instance-4407561-1569509642.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b8d48d817bcc13bb1c11a01b9e9dbb1a
RANDOM SEED=581571668

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25578944 kB
MemAvailable:   31759144 kB
Buffers:          175584 kB
Cached:          6121084 kB
SwapCached:        46676 kB
Active:          3075452 kB
Inactive:        3298724 kB
Active(anon):      43248 kB
Inactive(anon):   107848 kB
Active(file):    3032204 kB
Inactive(file):  3190876 kB
Unevictable:      107736 kB
Mlocked:          107736 kB
SwapTotal:      67108860 kB
SwapFree:       66954172 kB
Dirty:             45720 kB
Writeback:             0 kB
AnonPages:        140360 kB
Mapped:            23872 kB
Shmem:             64988 kB
Slab:             414144 kB
SReclaimable:     385580 kB
SUnreclaim:        28564 kB
KernelStack:        3488 kB
PageTables:         5444 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2579560 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     88064 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /var/tmp at the end= 13468 MiB
End job on node119 at 2019-09-26 17:33:21