Trace number 4407815

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
(reference) PicatSAT 2019-09-12? (TO) 2400.06 2399.82

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n150/
TravellingSalesman-150-50-07.xml
MD5SUM085cda1b13f6303a9f5f924c492c290a
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark1190
Best CPU time to get the best result obtained on this benchmark2400.01
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints151
Number of domains2
Minimum domain size61
Maximum domain size150
Distribution of domain sizes[{"size":61,"count":150},{"size":150,"count":150}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":150},{"degree":3,"count":150}]
Minimum constraint arity3
Maximum constraint arity150
Distribution of constraint arities[{"arity":3,"count":150},{"arity":150,"count":1}]
Number of extensional constraints150
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":150},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data 

126.30/126.33	c xcsp_picat version 2.7b12 (9/12/2019)
291.13/291.13	o 3136

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14062 MiB free)
  memory of node 1: 16384 MiB (11394 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407815-1569512980/watcher-4407815-1569512980 -o /var/tmp/evaluation-result-4407815-1569512980/solver-4407815-1569512980 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node146-1569509599-27079 --watchdog 2560 xcsp_picat HOME/instance-4407815-1569512980.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27932, runsolver pid=27929

[startup+0.100202 s]*
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=26050904/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=22912 CPUtime=0.1 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1292 0 0 0 10 0 0 0 20 0 1 0 527211875 2080477184 5728 33554432000 4194304 5870510 140736646034672 140736646033976 4826680 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 5728 837 410 0 503402 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 22912 KiB

[startup+0.209919 s]*
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=26038508/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=33152 CPUtime=0.2 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1297 0 0 0 20 0 0 0 20 0 1 0 527211875 2080477184 8288 33554432000 4194304 5870510 140736646034672 140736646033976 4461842 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 8288 837 410 0 503402 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 33152 KiB

[startup+0.309669 s]*
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=26028144/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=43392 CPUtime=0.3 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1302 0 0 0 30 0 0 0 20 0 1 0 527211875 2080477184 10848 33554432000 4194304 5870510 140736646034672 140736646033976 4826576 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 10848 837 410 0 503402 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 43392 KiB

[startup+0.700395 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=26007664/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=82304 CPUtime=0.69 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1321 0 0 0 68 1 0 0 20 0 1 0 527211875 2080477184 20576 33554432000 4194304 5870510 140736646034672 140736646033976 4479224 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 20576 837 410 0 503402 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 82304 KiB

[startup+1.50038 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=25957560/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=164260 CPUtime=1.49 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1361 0 0 0 147 2 0 0 20 0 1 0 527211875 2080477184 41065 33554432000 4194304 5870510 140736646034672 140736646033976 4429500 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 41065 841 410 0 503402 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 164260 KiB

[startup+3.10971 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=25559348/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=537168 CPUtime=3.09 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 1642 0 0 0 302 7 0 0 20 0 1 0 527211875 2080477184 134292 33554432000 4194304 5870510 140736646034672 140736646033976 4520559 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 134292 880 410 0 503402 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 537168 KiB

[startup+6.30035 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=24816484/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=2031716 memory=1327696 CPUtime=6.28 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2092 0 0 0 610 18 0 0 20 0 1 0 527211875 2080477184 331924 33554432000 4194304 5870510 140736646034672 140736646033976 4432488 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 507929 331924 880 410 0 503402 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 2031716 KiB
Current children cumulated memory: 1327696 KiB

[startup+12.7003 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=23707284/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533892 memory=2359680 CPUtime=12.69 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 40004 0 0 0 1233 36 0 0 20 0 1 0 527211875 3618705408 589920 33554432000 4194304 5870510 140736646034672 140736646033848 5337600 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883473 589920 955 410 0 878946 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 3533892 KiB
Current children cumulated memory: 2359680 KiB

[startup+25.5003 s]
/proc/loadavg: 1.98 1.98 1.95 3/200 27933
/proc/meminfo: memFree=23707420/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533892 memory=2359680 CPUtime=25.49 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 40005 0 0 0 2513 36 0 0 20 0 1 0 527211875 3618705408 589920 33554432000 4194304 5870510 140736646034672 140736646033848 5337596 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883473 589920 955 410 0 878946 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 3533892 KiB
Current children cumulated memory: 2359680 KiB

[startup+51.1096 s]
/proc/loadavg: 1.99 1.98 1.95 3/200 27936
/proc/meminfo: memFree=23707316/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533892 memory=2359684 CPUtime=51.1 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 49092 0 0 0 5073 37 0 0 20 0 1 0 527211875 3618705408 589921 33554432000 4194304 5870510 140736646034672 140736646033848 5337297 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883473 589921 956 410 0 878946 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 3533892 KiB
Current children cumulated memory: 2359684 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/202 27949
/proc/meminfo: memFree=23689076/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533892 memory=2359684 CPUtime=102.29 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 58389 0 0 0 10192 37 0 0 20 0 1 0 527211875 3618705408 589921 33554432000 4194304 5870510 140736646034672 140736646033848 5337497 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883473 589921 956 410 0 878946 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 3533892 KiB
Current children cumulated memory: 2359684 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/202 27953
/proc/meminfo: memFree=23649776/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3515108 memory=2344424 CPUtime=162.3 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 155534 0 0 0 16161 69 0 0 20 0 1 0 527211875 3599470592 586106 33554432000 4194304 5870510 140736646034672 140736646032744 140371120960200 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 878777 586106 982 410 0 874250 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 3515108 KiB
Current children cumulated memory: 2344424 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/202 27959
/proc/meminfo: memFree=23688856/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533952 memory=2360260 CPUtime=222.31 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 190182 0 0 0 22148 83 0 0 20 0 1 0 527211875 3618766848 590065 33554432000 4194304 5870510 140736646034672 140736646033848 5337502 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883488 590065 992 410 0 878961 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 3533952 KiB
Current children cumulated memory: 2360260 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 27963
/proc/meminfo: memFree=23692820/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3533952 memory=2353272 CPUtime=282.32 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 232235 0 0 0 28145 87 0 0 20 0 1 0 527211875 3618766848 588318 33554432000 4194304 5870510 140736646034672 140736646033928 5282284 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 883488 588318 992 410 0 878961 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 3533952 KiB
Current children cumulated memory: 2353272 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/201 27967
/proc/meminfo: memFree=23671600/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3615340 memory=2380700 CPUtime=342.33 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 340414 0 0 0 34108 125 0 0 20 0 1 0 527211875 3702108160 595175 33554432000 4194304 5870510 140736646034672 140736646033624 5275132 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 903835 595175 992 410 0 899308 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 3615340 KiB
Current children cumulated memory: 2380700 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 27974
/proc/meminfo: memFree=23677168/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3541188 memory=2372968 CPUtime=402.33 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 416303 0 0 0 40070 163 0 0 20 0 1 0 527211875 3626176512 593242 33554432000 4194304 5870510 140736646034672 140736646033032 140371116136384 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 885297 593242 992 410 0 880770 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 3541188 KiB
Current children cumulated memory: 2372968 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 27978
/proc/meminfo: memFree=23623728/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3636152 memory=2421876 CPUtime=462.33 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 521896 0 0 0 46032 201 0 0 20 0 1 0 527211875 3723419648 605469 33554432000 4194304 5870510 140736646034672 140736646033032 5278122 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 909038 605469 992 410 0 904511 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 3636152 KiB
Current children cumulated memory: 2421876 KiB


################
# More data... #
################

/proc/27932/statm: 1028821 702466 992 410 0 1024294 0
Current children cumulated CPU time: 1602.43 s
Current children cumulated vsize: 4115284 KiB
Current children cumulated memory: 2809864 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.03 2.02 3/199 28237
/proc/meminfo: memFree=23360888/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=4117356 memory=2793156 CPUtime=1662.43 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2082377 0 0 0 165350 893 0 0 20 0 1 0 527211875 4216172544 698289 33554432000 4194304 5870510 140736646034672 140736646033032 5282759 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 1029339 698289 992 410 0 1024812 0
Current children cumulated CPU time: 1662.43 s
Current children cumulated vsize: 4117356 KiB
Current children cumulated memory: 2793156 KiB

[startup+1722.3 s]
/proc/loadavg: 2.06 2.04 2.02 3/199 28241
/proc/meminfo: memFree=23357932/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=4118412 memory=2796220 CPUtime=1722.44 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2159869 0 0 0 171320 924 0 0 20 0 1 0 527211875 4217253888 699055 33554432000 4194304 5870510 140736646034672 140736646033624 5282578 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 1029603 699055 992 410 0 1025076 0
Current children cumulated CPU time: 1722.44 s
Current children cumulated vsize: 4118412 KiB
Current children cumulated memory: 2796220 KiB

[startup+1782.3 s]
/proc/loadavg: 1.86 2.00 2.01 2/192 28294
/proc/meminfo: memFree=23566540/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3904724 memory=2684856 CPUtime=1782.45 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2199819 0 0 0 177286 959 0 0 20 0 1 0 527211875 3998437376 671214 33554432000 4194304 5870510 140736646034672 140736646033032 5282505 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 976181 671214 992 410 0 971654 0
Current children cumulated CPU time: 1782.45 s
Current children cumulated vsize: 3904724 KiB
Current children cumulated memory: 2684856 KiB

[startup+1842.3 s]
/proc/loadavg: 1.32 1.82 1.95 2/192 28300
/proc/meminfo: memFree=23486952/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=4121240 memory=2763868 CPUtime=1842.46 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2211071 0 0 0 183261 985 0 0 20 0 1 0 527211875 4220149760 690967 33554432000 4194304 5870510 140736646034672 140736646033624 5282759 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 1030310 690967 992 410 0 1025783 0
Current children cumulated CPU time: 1842.46 s
Current children cumulated vsize: 4121240 KiB
Current children cumulated memory: 2763868 KiB

[startup+1902.3 s]
/proc/loadavg: 1.12 1.67 1.89 2/194 28313
/proc/meminfo: memFree=23516236/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3907184 memory=2734324 CPUtime=1902.47 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2291250 0 0 0 189233 1014 0 0 20 0 1 0 527211875 4000956416 683581 33554432000 4194304 5870510 140736646034672 140736646033688 5278096 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 976796 683581 992 410 0 972269 0
Current children cumulated CPU time: 1902.47 s
Current children cumulated vsize: 3907184 KiB
Current children cumulated memory: 2734324 KiB

[startup+1962.3 s]
/proc/loadavg: 1.04 1.55 1.83 2/194 28317
/proc/meminfo: memFree=23681144/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3775120 memory=2570760 CPUtime=1962.48 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2311360 0 0 0 195208 1040 0 0 20 0 1 0 527211875 3865722880 642690 33554432000 4194304 5870510 140736646034672 140736646033624 5262779 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 943780 642690 992 410 0 939253 0
Current children cumulated CPU time: 1962.48 s
Current children cumulated vsize: 3775120 KiB
Current children cumulated memory: 2570760 KiB

[startup+2022.3 s]
/proc/loadavg: 1.02 1.45 1.78 2/194 28325
/proc/meminfo: memFree=23709296/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3694896 memory=2542172 CPUtime=2022.48 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2403314 0 0 0 201172 1076 0 0 20 0 1 0 527211875 3783573504 635543 33554432000 4194304 5870510 140736646034672 140736646033624 5263049 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 923724 635543 992 410 0 919197 0
Current children cumulated CPU time: 2022.48 s
Current children cumulated vsize: 3694896 KiB
Current children cumulated memory: 2542172 KiB

[startup+2082.3 s]
/proc/loadavg: 1.01 1.37 1.73 2/194 28328
/proc/meminfo: memFree=23673628/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3780276 memory=2579140 CPUtime=2082.49 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2464521 0 0 0 207137 1112 0 0 20 0 1 0 527211875 3871002624 644785 33554432000 4194304 5870510 140736646034672 140736646033688 140371115350571 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 945069 644785 992 410 0 940542 0
Current children cumulated CPU time: 2082.49 s
Current children cumulated vsize: 3780276 KiB
Current children cumulated memory: 2579140 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.30 1.69 2/194 28332
/proc/meminfo: memFree=23690784/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3781908 memory=2560824 CPUtime=2142.5 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2530284 0 0 0 213099 1151 0 0 20 0 1 0 527211875 3872673792 640206 33554432000 4194304 5870510 140736646034672 140736646033624 5289471 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 945477 640206 992 410 0 940950 0
Current children cumulated CPU time: 2142.5 s
Current children cumulated vsize: 3781908 KiB
Current children cumulated memory: 2560824 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.25 1.64 2/192 28339
/proc/meminfo: memFree=23569044/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3710496 memory=2553460 CPUtime=2202.51 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2555547 0 0 0 219074 1177 0 0 20 0 1 0 527211875 3799547904 638365 33554432000 4194304 5870510 140736646034672 140736646033032 5282505 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 927624 638365 992 410 0 923097 0
Current children cumulated CPU time: 2202.51 s
Current children cumulated vsize: 3710496 KiB
Current children cumulated memory: 2553460 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.20 1.60 2/192 28343
/proc/meminfo: memFree=23661460/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3804260 memory=2588072 CPUtime=2262.51 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2689142 0 0 0 225043 1208 0 0 20 0 1 0 527211875 3895562240 647018 33554432000 4194304 5870510 140736646034672 140736646033624 5283024 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 951065 647018 992 410 0 946538 0
Current children cumulated CPU time: 2262.51 s
Current children cumulated vsize: 3804260 KiB
Current children cumulated memory: 2588072 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.16 1.57 2/192 28347
/proc/meminfo: memFree=23644088/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3804260 memory=2607212 CPUtime=2322.52 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2780235 0 0 0 231008 1244 0 0 20 0 1 0 527211875 3895562240 651803 33554432000 4194304 5870510 140736646034672 140736646033688 140371120978092 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 951065 651803 992 410 0 946538 0
Current children cumulated CPU time: 2322.52 s
Current children cumulated vsize: 3804260 KiB
Current children cumulated memory: 2607212 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.13 1.53 2/192 28354
/proc/meminfo: memFree=23666064/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3804260 memory=2586080 CPUtime=2382.53 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2843889 0 0 0 236968 1285 0 0 20 0 1 0 527211875 3895562240 646520 33554432000 4194304 5870510 140736646034672 140736646033624 5274889 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 951065 646520 992 410 0 946538 0
Current children cumulated CPU time: 2382.53 s
Current children cumulated vsize: 3804260 KiB
Current children cumulated memory: 2586080 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.8 s]
/proc/loadavg: 1.00 1.13 1.52 2/192 28355
/proc/meminfo: memFree=23680144/32770624 swapFree=67002108/67108860
[pid=27932] ppid=27929 vsize=3804260 memory=2575844 CPUtime=2400.03 cores=1,3,5,7
/proc/27932/stat : 27932 (xcsp_picat) R 27929 27932 27047 0 -1 4202496 2883674 0 0 0 238704 1299 0 0 20 0 1 0 527211875 3895562240 643961 33554432000 4194304 5870510 140736646034672 140736646033624 5277491 0 0 4096 8389634 0 0 0 17 1 0 0 0 0 0 7970040 9572284 28692480 140736646038535 140736646038617 140736646038617 140736646041542 0
/proc/27932/statm: 951065 643961 992 410 0 946538 0
Current children cumulated CPU time: 2400.03 s
Current children cumulated vsize: 3804260 KiB
Current children cumulated memory: 2575844 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.82 s]
# the end of solver process 27932 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2387.05 s, system=13.0165 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2399.82
CPU time (s): 2400.06
CPU user time (s): 2387.05
CPU system time (s): 13.0165
CPU usage (%): 100.01
Max. virtual memory (cumulated for all children) (KiB): 4466180
Max. memory (cumulated for all children) (KiB): 3168888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2387.05
system time used= 13.0165
maximum resident set size= 3169848
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2883674
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 72
involuntary context switches= 1047


# summary of solver processes directly reported to runsolver:
#   pid: 27932
#   total CPU time (s): 2400.06
#   total CPU user time (s): 2387.05
#   total CPU system time (s): 13.0165

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.43783 second user time and 17.9276 second system time

The end

Launcher Data 

Begin job on node146 at 2019-09-26 17:48:58
IDJOB=4407815
IDBENCH=135806
IDSOLVER=2873
FILE ID=node146/4407815-1569512980
RUNJOBID= node146-1569509599-27079
PBS_JOBID= 21705781
Free space on /var/tmp= 13512 MiB

SOLVER NAME= PicatSAT 2019-09-12
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n150/TravellingSalesman-150-50-07.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-4407815-1569512980/watcher-4407815-1569512980 -o /var/tmp/evaluation-result-4407815-1569512980/solver-4407815-1569512980 -C 2400 -W 2500 -M 15500 --bin-var /var/tmp/runsolver-exch-node146-1569509599-27079 --watchdog 2560  xcsp_picat HOME/instance-4407815-1569512980.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 085cda1b13f6303a9f5f924c492c290a
RANDOM SEED=244469615

node146.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26068672 kB
MemAvailable:   31648640 kB
Buffers:          132248 kB
Cached:          5582896 kB
SwapCached:         3456 kB
Active:          3088552 kB
Inactive:        2812576 kB
Active(anon):     200160 kB
Inactive(anon):    58504 kB
Active(file):    2888392 kB
Inactive(file):  2754072 kB
Unevictable:      108944 kB
Mlocked:          108944 kB
SwapTotal:      67108860 kB
SwapFree:       67002108 kB
Dirty:              3120 kB
Writeback:             0 kB
AnonPages:        293168 kB
Mapped:            24256 kB
Shmem:             64060 kB
Slab:             395292 kB
SReclaimable:     365964 kB
SUnreclaim:        29328 kB
KernelStack:        3568 kB
PageTables:         5896 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2742244 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    237568 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      109952 kB
DirectMap2M:    33435648 kB

Free space on /var/tmp at the end= 13512 MiB
End job on node146 at 2019-09-26 18:28:58