Trace number 4309387

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-08-14? (TO) 2519.91 2520.01

General information on the benchmark

NameTravellingSalesman/
TravellingSalesman-75-50-00_c18.xml
MD5SUM7fcf74bccc1d4f399a3457b4fd80f100
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark357
Best CPU time to get the best result obtained on this benchmark2519.91
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of constraints76
Number of domains2
Minimum domain size59
Maximum domain size75
Distribution of domain sizes[{"size":59,"count":75},{"size":75,"count":75}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":75},{"degree":3,"count":75}]
Minimum constraint arity3
Maximum constraint arity75
Distribution of constraint arities[{"arity":3,"count":75},{"arity":75,"count":1}]
Number of extensional constraints75
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":75},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10685 MiB free)
  memory of node 1: 16384 MiB (12615 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4309387-1534317512/watcher-4309387-1534317512 -o /tmp/evaluation-result-4309387-1534317512/solver-4309387-1534317512 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534293202-13750 --watchdog 2580 xcsp_picat HOME/instance-4309387-1534317512.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=16668, runsolver pid=16665
Current StackSize limit: 8192 KiB


[startup+0.100353 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23839444/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2025744 memory=22828 CPUtime=0.1 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 1259 0 0 0 10 0 0 0 20 0 1 0 249314381 2074361856 5707 33554432000 4194304 5849940 140721021479920 140721021479224 4465602 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 506436 5707 597 405 0 503380 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 22828 KiB

[startup+0.209595 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23822792/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2025744 memory=39960 CPUtime=0.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 1505 0 0 0 21 0 0 0 20 0 1 0 249314381 2074361856 9990 33554432000 4194304 5849940 140721021479920 140721021479224 4492535 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 506436 9990 640 405 0 503380 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 2025744 KiB
Current children cumulated memory: 39960 KiB

[startup+0.309477 s]*
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23815904/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2026492 memory=47356 CPUtime=0.3 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 1832 0 0 0 30 0 0 0 20 0 1 0 249314381 2075127808 11839 33554432000 4194304 5849940 140721021479920 140721021479032 140653362794375 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 506623 11839 704 405 0 503567 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 2026492 KiB
Current children cumulated memory: 47356 KiB

[startup+0.700252 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23813732/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2028288 memory=51220 CPUtime=0.68 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 2283 0 0 0 66 2 0 0 20 0 1 0 249314381 2076966912 12805 33554432000 4194304 5849940 140721021479920 140721021478952 140653362794375 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 507072 12805 706 405 0 504016 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 2028288 KiB
Current children cumulated memory: 51220 KiB

[startup+1.50024 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23811020/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2032512 memory=55436 CPUtime=1.48 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 3339 0 0 0 142 6 0 0 20 0 1 0 249314381 2081292288 13859 33554432000 4194304 5849940 140721021479920 140721021479032 140653362047741 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 508128 13859 706 405 0 505072 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 2032512 KiB
Current children cumulated memory: 55436 KiB

[startup+3.10947 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23802556/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2038784 memory=61836 CPUtime=3.09 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 4964 0 0 0 295 14 0 0 20 0 1 0 249314381 2087714816 15459 33554432000 4194304 5849940 140721021479920 140721021479016 140653362794375 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 509696 15459 706 405 0 506640 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 2038784 KiB
Current children cumulated memory: 61836 KiB

[startup+6.30022 s]
/proc/loadavg: 2.08 2.03 2.05 3/187 16669
/proc/meminfo: memFree=23789776/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2051072 memory=74124 CPUtime=6.29 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 6400 0 0 0 602 27 0 0 20 0 1 0 249314381 2100297728 18531 33554432000 4194304 5849940 140721021479920 140721021479032 5406735 0 0 4096 8389634 0 0 0 17 0 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 512768 18531 706 405 0 509712 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2051072 KiB
Current children cumulated memory: 74124 KiB

[startup+12.7003 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 16669
/proc/meminfo: memFree=23764960/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2076372 memory=99424 CPUtime=12.68 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 8374 0 0 0 1217 51 0 0 20 0 1 0 249314381 2126204928 24856 33554432000 4194304 5849940 140721021479920 140721021479160 5472143 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 519093 24856 706 405 0 516037 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 2076372 KiB
Current children cumulated memory: 99424 KiB

[startup+25.5004 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 16669
/proc/meminfo: memFree=23627828/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2214288 memory=237256 CPUtime=25.49 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 28125 0 0 0 2471 78 0 0 20 0 1 0 249314381 2267430912 59314 33554432000 4194304 5849940 140721021479920 140721021478408 5319922 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 553572 59314 733 405 0 550516 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2214288 KiB
Current children cumulated memory: 237256 KiB

[startup+51.1096 s]
/proc/loadavg: 1.99 2.01 2.04 3/187 16669
/proc/meminfo: memFree=23645760/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2194784 memory=217972 CPUtime=51.09 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 57480 0 0 0 5027 82 0 0 20 0 1 0 249314381 2247458816 54493 33554432000 4194304 5849940 140721021479920 140721021478168 5437917 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 548696 54493 740 405 0 545640 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2194784 KiB
Current children cumulated memory: 217972 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16677
/proc/meminfo: memFree=23574952/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2265680 memory=288624 CPUtime=102.28 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 109230 0 0 0 10063 165 0 0 20 0 1 0 249314381 2320056320 72156 33554432000 4194304 5849940 140721021479920 140721021478328 5319932 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 566420 72156 749 405 0 563364 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2265680 KiB
Current children cumulated memory: 288624 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16738
/proc/meminfo: memFree=23996836/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2154972 memory=176036 CPUtime=162.26 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 125245 0 0 0 16041 185 0 0 20 0 1 0 249314381 2206691328 44009 33554432000 4194304 5849940 140721021479920 140721021478920 5437913 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 538743 44009 749 405 0 535687 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 2154972 KiB
Current children cumulated memory: 176036 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16739
/proc/meminfo: memFree=23948332/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2226900 memory=251032 CPUtime=222.26 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 134453 0 0 0 22014 212 0 0 20 0 1 0 249314381 2280345600 62758 33554432000 4194304 5849940 140721021479920 140721021478792 4206506 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 556725 62758 749 405 0 553669 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 2226900 KiB
Current children cumulated memory: 251032 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16740
/proc/meminfo: memFree=23958868/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2161080 memory=188352 CPUtime=282.26 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 136377 0 0 0 27987 239 0 0 20 0 1 0 249314381 2212945920 47088 33554432000 4194304 5849940 140721021479920 140721021478920 5437930 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 540270 47088 749 405 0 537214 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 2161080 KiB
Current children cumulated memory: 188352 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16741
/proc/meminfo: memFree=23973244/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2164536 memory=189136 CPUtime=342.25 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 144964 0 0 0 33956 269 0 0 20 0 1 0 249314381 2216484864 47284 33554432000 4194304 5849940 140721021479920 140721021478920 140653362794375 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 541134 47284 749 405 0 538078 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 2164536 KiB
Current children cumulated memory: 189136 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16743
/proc/meminfo: memFree=23872032/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2235364 memory=260484 CPUtime=402.25 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 146577 0 0 0 39922 303 0 0 20 0 1 0 249314381 2289012736 65121 33554432000 4194304 5849940 140721021479920 140721021478920 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 558841 65121 749 405 0 555785 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 2235364 KiB
Current children cumulated memory: 260484 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/187 16744
/proc/meminfo: memFree=23908892/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2235364 memory=262592 CPUtime=462.25 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 153098 0 0 0 45896 329 0 0 20 0 1 0 249314381 2289012736 65648 33554432000 4194304 5849940 140721021479920 140721021478920 5335752 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 558841 65648 749 405 0 555785 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 2235364 KiB
Current children cumulated memory: 262592 KiB


################
# More data... #
################

/proc/16668/statm: 563831 70824 749 405 0 560775 0
Current children cumulated CPU time: 1722.22 s
Current children cumulated vsize: 2255324 KiB
Current children cumulated memory: 283296 KiB

[startup+1782.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/187 17037
/proc/meminfo: memFree=23465160/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320860 memory=348832 CPUtime=1782.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 333324 0 0 0 177208 1013 0 0 20 0 1 0 249314381 2376560640 87208 33554432000 4194304 5849940 140721021479920 140721021478920 5339250 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580215 87208 749 405 0 577159 0
Current children cumulated CPU time: 1782.21 s
Current children cumulated vsize: 2320860 KiB
Current children cumulated memory: 348832 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/187 17038
/proc/meminfo: memFree=23546836/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320860 memory=348832 CPUtime=1842.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 339578 0 0 0 183181 1040 0 0 20 0 1 0 249314381 2376560640 87208 33554432000 4194304 5849940 140721021479920 140721021478792 5335793 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580215 87208 749 405 0 577159 0
Current children cumulated CPU time: 1842.21 s
Current children cumulated vsize: 2320860 KiB
Current children cumulated memory: 348832 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/189 17048
/proc/meminfo: memFree=23415244/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320616 memory=348588 CPUtime=1902.2 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 346570 0 0 0 189155 1065 0 0 20 0 1 0 249314381 2376310784 87147 33554432000 4194304 5849940 140721021479920 140721021478920 5437675 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580154 87147 749 405 0 577098 0
Current children cumulated CPU time: 1902.2 s
Current children cumulated vsize: 2320616 KiB
Current children cumulated memory: 348588 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/189 17049
/proc/meminfo: memFree=23546548/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320616 memory=348588 CPUtime=1962.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 362280 0 0 0 195115 1106 0 0 20 0 1 0 249314381 2376310784 87147 33554432000 4194304 5849940 140721021479920 140721021478920 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580154 87147 749 405 0 577098 0
Current children cumulated CPU time: 1962.21 s
Current children cumulated vsize: 2320616 KiB
Current children cumulated memory: 348588 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/189 17050
/proc/meminfo: memFree=23546828/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320616 memory=348588 CPUtime=2022.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 371186 0 0 0 201085 1136 0 0 20 0 1 0 249314381 2376310784 87147 33554432000 4194304 5849940 140721021479920 140721021479080 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580154 87147 749 405 0 577098 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 2320616 KiB
Current children cumulated memory: 348588 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/189 17051
/proc/meminfo: memFree=23481416/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2254952 memory=282924 CPUtime=2082.21 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 379236 0 0 0 207058 1163 0 0 20 0 1 0 249314381 2309070848 70731 33554432000 4194304 5849940 140721021479920 140721021478920 5335774 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 563738 70731 749 405 0 560682 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 2254952 KiB
Current children cumulated memory: 282924 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/189 17052
/proc/meminfo: memFree=23520140/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320488 memory=348460 CPUtime=2142.2 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 392494 0 0 0 213023 1197 0 0 20 0 1 0 249314381 2376179712 87115 33554432000 4194304 5849940 140721021479920 140721021478920 5437906 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580122 87115 749 405 0 577066 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 2320488 KiB
Current children cumulated memory: 348460 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/187 17054
/proc/meminfo: memFree=23366808/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320488 memory=348460 CPUtime=2202.2 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 399878 0 0 0 218992 1228 0 0 20 0 1 0 249314381 2376179712 87115 33554432000 4194304 5849940 140721021479920 140721021478920 5438036 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580122 87115 749 405 0 577066 0
Current children cumulated CPU time: 2202.2 s
Current children cumulated vsize: 2320488 KiB
Current children cumulated memory: 348460 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 17055
/proc/meminfo: memFree=23610852/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2262288 memory=290388 CPUtime=2262.2 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 412546 0 0 0 224959 1261 0 0 20 0 1 0 249314381 2316582912 72597 33554432000 4194304 5849940 140721021479920 140721021478920 5437828 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 565572 72597 749 405 0 562516 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 2262288 KiB
Current children cumulated memory: 290388 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 17056
/proc/meminfo: memFree=23474880/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2262288 memory=290388 CPUtime=2322.19 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 421819 0 0 0 230927 1292 0 0 20 0 1 0 249314381 2316582912 72597 33554432000 4194304 5849940 140721021479920 140721021478920 140653362794375 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 565572 72597 749 405 0 562516 0
Current children cumulated CPU time: 2322.19 s
Current children cumulated vsize: 2262288 KiB
Current children cumulated memory: 290388 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 17058
/proc/meminfo: memFree=23587780/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2285588 memory=313560 CPUtime=2382.19 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 431313 0 0 0 236898 1321 0 0 20 0 1 0 249314381 2340442112 78390 33554432000 4194304 5849940 140721021479920 140721021478920 5438016 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 571397 78390 749 405 0 568341 0
Current children cumulated CPU time: 2382.19 s
Current children cumulated vsize: 2285588 KiB
Current children cumulated memory: 313560 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 17059
/proc/meminfo: memFree=23581452/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2291404 memory=319376 CPUtime=2442.19 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 440527 0 0 0 242877 1342 0 0 20 0 1 0 249314381 2346397696 79844 33554432000 4194304 5849940 140721021479920 140721021478792 5339857 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 572851 79844 749 405 0 569795 0
Current children cumulated CPU time: 2442.19 s
Current children cumulated vsize: 2291404 KiB
Current children cumulated memory: 319376 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 17068
/proc/meminfo: memFree=23573676/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2291404 memory=319376 CPUtime=2502.18 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 448622 0 0 0 248847 1371 0 0 20 0 1 0 249314381 2346397696 79844 33554432000 4194304 5849940 140721021479920 140721021478920 5307802 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 572851 79844 749 405 0 569795 0
Current children cumulated CPU time: 2502.18 s
Current children cumulated vsize: 2291404 KiB
Current children cumulated memory: 319376 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/188 17068
/proc/meminfo: memFree=23367584/32770624 swapFree=67059132/67108860
[pid=16668] ppid=16665 vsize=2320252 memory=348216 CPUtime=2519.9 cores=0,2,4,6
/proc/16668/stat : 16668 (xcsp_picat) R 16665 16668 13719 0 -1 4202496 451393 0 0 0 250611 1379 0 0 20 0 1 0 249314381 2375938048 87054 33554432000 4194304 5849940 140721021479920 140721021478920 140653362794375 0 0 4096 8389634 0 0 0 17 2 0 0 0 0 0 7949816 9396308 30052352 140721021486262 140721021486340 140721021486340 140721021489098 0
/proc/16668/statm: 580063 87054 749 405 0 577007 0
Current children cumulated CPU time: 2519.9 s
Current children cumulated vsize: 2320252 KiB
Current children cumulated memory: 348216 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 16668 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2506.11 s, system=13.8006 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.91
CPU user time (s): 2506.11
CPU system time (s): 13.8006
CPU usage (%): 99.9959
Max. virtual memory (cumulated for all children) (KiB): 2321436
Max. memory (cumulated for all children) (KiB): 349300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2506.11
system time used= 13.8006
maximum resident set size= 349300
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 451393
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24
involuntary context switches= 3180


# summary of solver processes directly reported to runsolver:
#   pid: 16668
#   total CPU time (s): 2519.91
#   total CPU user time (s): 2506.11
#   total CPU system time (s): 13.8006

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0709 second user time and 18.3165 second system time

The end

Launcher Data 

Begin job on node103 at 2018-08-15 09:18:32
IDJOB=4309387
IDBENCH=141625
IDSOLVER=2794
FILE ID=node103/4309387-1534317512
RUNJOBID= node103-1534293202-13750
PBS_JOBID= 21038140
Free space on /tmp= 37336 MiB

SOLVER NAME= PicatSAT 2018-08-14
BENCH NAME= XCSP18/TravellingSalesman/TravellingSalesman-75-50-00_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4309387-1534317512/watcher-4309387-1534317512 -o /tmp/evaluation-result-4309387-1534317512/solver-4309387-1534317512 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1534293202-13750 --watchdog 2580  xcsp_picat HOME/instance-4309387-1534317512.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7fcf74bccc1d4f399a3457b4fd80f100
RANDOM SEED=859043051

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        23860732 kB
MemAvailable:   31582148 kB
Buffers:          187024 kB
Cached:          7735784 kB
SwapCached:         5144 kB
Active:          4530236 kB
Inactive:        3760852 kB
Active(anon):     360248 kB
Inactive(anon):    67484 kB
Active(file):    4169988 kB
Inactive(file):  3693368 kB
Unevictable:        7772 kB
Mlocked:            7772 kB
SwapTotal:      67108860 kB
SwapFree:       67059132 kB
Dirty:              3140 kB
Writeback:             0 kB
AnonPages:        370648 kB
Mapped:            55948 kB
Shmem:             56920 kB
Slab:             315556 kB
SReclaimable:     286520 kB
SUnreclaim:        29036 kB
KernelStack:        3360 kB
PageTables:         6052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2713372 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    208896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 37328 MiB
End job on node103 at 2018-08-15 10:00:32