Trace number 4295965

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PicatSAT 2018-06-15? (TO) 2519.98 2520.01

General information on the benchmark

NameTravellingSalesman/
TravellingSalesman-100-50-00_c18.xml
MD5SUMac62098c303420005332b673e951092f
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark451
Best CPU time to get the best result obtained on this benchmark2519.97
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints101
Number of domains2
Minimum domain size62
Maximum domain size100
Distribution of domain sizes[{"size":62,"count":100},{"size":100,"count":100}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":100},{"degree":3,"count":100}]
Minimum constraint arity3
Maximum constraint arity100
Distribution of constraint arities[{"arity":3,"count":100},{"arity":100,"count":1}]
Number of extensional constraints100
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":100},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9101 MiB free)
  memory of node 1: 16384 MiB (11269 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4295965-1532591734/watcher-4295965-1532591734 -o /tmp/evaluation-result-4295965-1532591734/solver-4295965-1532591734 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1532562373-32762 --watchdog 2580 xcsp_picat HOME/instance-4295965-1532591734.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=3755, runsolver pid=3752

[startup+0.100161 s]*
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20838280/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=111688 memory=23096 CPUtime=0.1 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 1358 0 0 0 10 0 0 0 20 0 1 0 76736605 114368512 5774 33554432000 4194304 5849740 140721405547184 140721405547184 4488823 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 27922 5774 596 405 0 24866 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 23096 KiB

[startup+0.209905 s]*
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20825992/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=111688 memory=35384 CPUtime=0.21 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 1364 0 0 0 21 0 0 0 20 0 1 0 76736605 114368512 8846 33554432000 4194304 5849740 140721405547184 140721405547184 4458032 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 27922 8846 596 405 0 24866 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 35384 KiB

[startup+0.309736 s]*
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20813704/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=111688 memory=47672 CPUtime=0.31 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 1370 0 0 0 31 0 0 0 20 0 1 0 76736605 114368512 11918 33554432000 4194304 5849740 140721405547184 140721405547184 4454802 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 27922 11918 596 405 0 24866 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 111688 KiB
Current children cumulated memory: 47672 KiB

[startup+0.700372 s]
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20800116/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=165852 memory=83008 CPUtime=0.69 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 4419 0 0 0 67 2 0 0 20 0 1 0 76736605 169832448 20752 33554432000 4194304 5849740 140721405547184 140721405546152 5249600 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 41463 20752 604 405 0 38407 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 165852 KiB
Current children cumulated memory: 83008 KiB

[startup+1.50039 s]
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20797304/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=170456 memory=109068 CPUtime=1.49 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 9858 0 0 0 141 8 0 0 20 0 1 0 76736605 174546944 27267 33554432000 4194304 5849740 140721405547184 140721405546152 5262149 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 42614 27267 604 405 0 39558 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 170456 KiB
Current children cumulated memory: 109068 KiB

[startup+3.10958 s]
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20727188/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=195920 memory=131796 CPUtime=3.1 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 15890 0 0 0 296 14 0 0 20 0 1 0 76736605 200622080 32949 33554432000 4194304 5849740 140721405547184 140721405546504 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 48980 32949 707 405 0 45924 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 195920 KiB
Current children cumulated memory: 131796 KiB

[startup+6.30028 s]
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20706652/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=224600 memory=160412 CPUtime=6.3 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 18985 0 0 0 605 25 0 0 20 0 1 0 76736605 229990400 40103 33554432000 4194304 5849740 140721405547184 140721405546424 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 56150 40103 707 405 0 53094 0
Current children cumulated CPU time: 6.3 s
Current children cumulated vsize: 224600 KiB
Current children cumulated memory: 160412 KiB

[startup+12.7003 s]
/proc/loadavg: 2.05 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20669792/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=249176 memory=185052 CPUtime=12.7 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 20791 0 0 0 1221 49 0 0 20 0 1 0 76736605 255156224 46263 33554432000 4194304 5849740 140721405547184 140721405546296 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 62294 46263 707 405 0 59238 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 249176 KiB
Current children cumulated memory: 185052 KiB

[startup+25.5003 s]
/proc/loadavg: 2.04 2.03 2.05 3/190 3756
/proc/meminfo: memFree=20595236/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=298328 memory=234204 CPUtime=25.49 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 23030 0 0 0 2451 98 0 0 20 0 1 0 76736605 305487872 58551 33554432000 4194304 5849740 140721405547184 140721405546296 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 74582 58551 707 405 0 71526 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 298328 KiB
Current children cumulated memory: 234204 KiB

[startup+51.1099 s]
/proc/loadavg: 2.02 2.02 2.05 3/190 3756
/proc/meminfo: memFree=20304236/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=577172 memory=512996 CPUtime=51.1 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 82084 0 0 0 4943 167 0 0 20 0 1 0 76736605 591024128 128249 33554432000 4194304 5849740 140721405547184 140721405545448 5413386 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 144293 128249 738 405 0 141237 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 577172 KiB
Current children cumulated memory: 512996 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/190 3757
/proc/meminfo: memFree=20384740/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=436880 memory=373024 CPUtime=102.29 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 105027 0 0 0 10044 185 0 0 20 0 1 0 76736605 447365120 93256 33554432000 4194304 5849740 140721405547184 140721405546344 5437698 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 109220 93256 742 405 0 106164 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 436880 KiB
Current children cumulated memory: 373024 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/190 3759
/proc/meminfo: memFree=20196504/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=586808 memory=522876 CPUtime=162.29 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 177028 0 0 0 15878 351 0 0 20 0 1 0 76736605 600891392 130719 33554432000 4194304 5849740 140721405547184 140721405545448 5322848 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 146702 130719 751 405 0 143646 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 586808 KiB
Current children cumulated memory: 522876 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/191 3761
/proc/meminfo: memFree=20344344/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=436520 memory=374528 CPUtime=222.29 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 232427 0 0 0 21856 373 0 0 20 0 1 0 76736605 446996480 93632 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 109130 93632 751 405 0 106074 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 436520 KiB
Current children cumulated memory: 374528 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/193 3771
/proc/meminfo: memFree=20325404/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=434100 memory=373976 CPUtime=282.29 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 279641 0 0 0 27830 399 0 0 20 0 1 0 76736605 444518400 93494 33554432000 4194304 5849740 140721405547184 140721405546344 5335512 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 108525 93494 751 405 0 105469 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 434100 KiB
Current children cumulated memory: 373976 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/193 3794
/proc/meminfo: memFree=20283444/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=436584 memory=376508 CPUtime=342.29 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 352409 0 0 0 33803 426 0 0 20 0 1 0 76736605 447062016 94127 33554432000 4194304 5849740 140721405547184 140721405546056 5339447 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 109146 94127 751 405 0 106090 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 436584 KiB
Current children cumulated memory: 376508 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/193 3795
/proc/meminfo: memFree=20144140/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=579960 memory=515068 CPUtime=402.28 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 444913 0 0 0 39775 453 0 0 20 0 1 0 76736605 593879040 128767 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 144990 128767 751 405 0 141934 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 579960 KiB
Current children cumulated memory: 515068 KiB

[startup+462.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/193 3796
/proc/meminfo: memFree=20161736/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=580528 memory=515648 CPUtime=462.28 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 499499 0 0 0 45747 481 0 0 20 0 1 0 76736605 594460672 128912 33554432000 4194304 5849740 140721405547184 140721405545672 4234742 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 145132 128912 751 405 0 142076 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 580528 KiB
Current children cumulated memory: 515648 KiB


################
# More data... #
################

/proc/3755/statm: 152068 137049 751 405 0 149012 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 608272 KiB
Current children cumulated memory: 548196 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/191 3900
/proc/meminfo: memFree=20093848/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=620176 memory=552456 CPUtime=1782.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 683304 0 0 0 177217 1008 0 0 20 0 1 0 76736605 635060224 138114 33554432000 4194304 5849740 140721405547184 140721405546184 5438083 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 155044 138114 751 405 0 151988 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 620176 KiB
Current children cumulated memory: 552456 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/191 3901
/proc/meminfo: memFree=20065808/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619984 memory=552264 CPUtime=1842.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 684933 0 0 0 183181 1044 0 0 20 0 1 0 76736605 634863616 138066 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154996 138066 751 405 0 151940 0
Current children cumulated CPU time: 1842.25 s
Current children cumulated vsize: 619984 KiB
Current children cumulated memory: 552264 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/191 3902
/proc/meminfo: memFree=20032612/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619984 memory=552264 CPUtime=1902.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 687214 0 0 0 189158 1068 0 0 20 0 1 0 76736605 634863616 138066 33554432000 4194304 5849740 140721405547184 140721405546184 5312882 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154996 138066 751 405 0 151940 0
Current children cumulated CPU time: 1902.26 s
Current children cumulated vsize: 619984 KiB
Current children cumulated memory: 552264 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3904
/proc/meminfo: memFree=20157944/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619984 memory=552264 CPUtime=1962.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 688726 0 0 0 195140 1085 0 0 20 0 1 0 76736605 634863616 138066 33554432000 4194304 5849740 140721405547184 140721405546184 5437620 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154996 138066 751 405 0 151940 0
Current children cumulated CPU time: 1962.25 s
Current children cumulated vsize: 619984 KiB
Current children cumulated memory: 552264 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/190 3905
/proc/meminfo: memFree=20111556/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619984 memory=552264 CPUtime=2022.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 689915 0 0 0 201121 1105 0 0 20 0 1 0 76736605 634863616 138066 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154996 138066 751 405 0 151940 0
Current children cumulated CPU time: 2022.26 s
Current children cumulated vsize: 619984 KiB
Current children cumulated memory: 552264 KiB

[startup+2082.3 s]
/proc/loadavg: 2.07 2.03 2.05 3/190 3913
/proc/meminfo: memFree=20043284/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619612 memory=551892 CPUtime=2082.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 693196 0 0 0 207095 1131 0 0 20 0 1 0 76736605 634482688 137973 33554432000 4194304 5849740 140721405547184 140721405546344 5437698 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154903 137973 751 405 0 151847 0
Current children cumulated CPU time: 2082.26 s
Current children cumulated vsize: 619612 KiB
Current children cumulated memory: 551892 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/190 3914
/proc/meminfo: memFree=19970932/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619612 memory=551892 CPUtime=2142.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 694885 0 0 0 213072 1154 0 0 20 0 1 0 76736605 634482688 137973 33554432000 4194304 5849740 140721405547184 140721405546184 5437819 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154903 137973 751 405 0 151847 0
Current children cumulated CPU time: 2142.26 s
Current children cumulated vsize: 619612 KiB
Current children cumulated memory: 551892 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/190 3915
/proc/meminfo: memFree=19901804/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619612 memory=551892 CPUtime=2202.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 697271 0 0 0 219050 1176 0 0 20 0 1 0 76736605 634482688 137973 33554432000 4194304 5849740 140721405547184 140721405546056 5360437 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154903 137973 751 405 0 151847 0
Current children cumulated CPU time: 2202.26 s
Current children cumulated vsize: 619612 KiB
Current children cumulated memory: 551892 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3917
/proc/meminfo: memFree=19902184/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619612 memory=551892 CPUtime=2262.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 699972 0 0 0 225022 1203 0 0 20 0 1 0 76736605 634482688 137973 33554432000 4194304 5849740 140721405547184 140721405546344 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154903 137973 751 405 0 151847 0
Current children cumulated CPU time: 2262.25 s
Current children cumulated vsize: 619612 KiB
Current children cumulated memory: 551892 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3918
/proc/meminfo: memFree=19902332/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619412 memory=551692 CPUtime=2322.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 702382 0 0 0 231004 1222 0 0 20 0 1 0 76736605 634277888 137923 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154853 137923 751 405 0 151797 0
Current children cumulated CPU time: 2322.26 s
Current children cumulated vsize: 619412 KiB
Current children cumulated memory: 551692 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3919
/proc/meminfo: memFree=20178616/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=619412 memory=551692 CPUtime=2382.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 705018 0 0 0 236983 1242 0 0 20 0 1 0 76736605 634277888 137923 33554432000 4194304 5849740 140721405547184 140721405546184 5312592 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 154853 137923 751 405 0 151797 0
Current children cumulated CPU time: 2382.25 s
Current children cumulated vsize: 619412 KiB
Current children cumulated memory: 551692 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3920
/proc/meminfo: memFree=20076212/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=608224 memory=548276 CPUtime=2442.25 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 708510 0 0 0 242957 1268 0 0 20 0 1 0 76736605 622821376 137069 33554432000 4194304 5849740 140721405547184 140721405546344 5340387 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 152056 137069 751 405 0 149000 0
Current children cumulated CPU time: 2442.25 s
Current children cumulated vsize: 608224 KiB
Current children cumulated memory: 548276 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/191 3921
/proc/meminfo: memFree=20043820/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=608224 memory=548276 CPUtime=2502.26 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 710270 0 0 0 248937 1289 0 0 20 0 1 0 76736605 622821376 137069 33554432000 4194304 5849740 140721405547184 140721405546344 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 152056 137069 751 405 0 149000 0
Current children cumulated CPU time: 2502.26 s
Current children cumulated vsize: 608224 KiB
Current children cumulated memory: 548276 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/191 3921
/proc/meminfo: memFree=20044100/32770624 swapFree=67108860/67108860
[pid=3755] ppid=3752 vsize=608224 memory=548276 CPUtime=2519.97 cores=1,3,5,7
/proc/3755/stat : 3755 (xcsp_picat) R 3752 3755 32730 0 -1 4202496 711234 0 0 0 250701 1296 0 0 20 0 1 0 76736605 622821376 137069 33554432000 4194304 5849740 140721405547184 140721405546184 140224252002183 0 0 4096 8389634 0 0 0 17 5 0 0 0 0 0 7949816 9399828 28078080 140721405551798 140721405551876 140721405551876 140721405554634 0
/proc/3755/statm: 152056 137069 751 405 0 149000 0
Current children cumulated CPU time: 2519.97 s
Current children cumulated vsize: 608224 KiB
Current children cumulated memory: 548276 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 3755 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2507.02 s, system=12.9639 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.98
CPU user time (s): 2507.02
CPU system time (s): 12.9639
CPU usage (%): 99.9987
Max. virtual memory (cumulated for all children) (KiB): 652948
Max. memory (cumulated for all children) (KiB): 585220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2507.02
system time used= 12.9639
maximum resident set size= 585220
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 711234
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 46
involuntary context switches= 819


# summary of solver processes directly reported to runsolver:
#   pid: 3755
#   total CPU time (s): 2519.98
#   total CPU user time (s): 2507.02
#   total CPU system time (s): 12.9639

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 15.6494 second user time and 13.7158 second system time

The end

Launcher Data 

Begin job on node134 at 2018-07-26 09:55:34
IDJOB=4295965
IDBENCH=141623
IDSOLVER=2754
FILE ID=node134/4295965-1532591734
RUNJOBID= node134-1532562373-32762
PBS_JOBID= 21021958
Free space on /tmp= 55560 MiB

SOLVER NAME= PicatSAT 2018-06-15
BENCH NAME= XCSP18/TravellingSalesman/TravellingSalesman-100-50-00_c18.xml
COMMAND LINE= xcsp_picat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4295965-1532591734/watcher-4295965-1532591734 -o /tmp/evaluation-result-4295965-1532591734/solver-4295965-1532591734 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node134-1532562373-32762 --watchdog 2580  xcsp_picat HOME/instance-4295965-1532591734.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac62098c303420005332b673e951092f
RANDOM SEED=1286713670

node134.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        20859716 kB
MemAvailable:   31913716 kB
Buffers:          221416 kB
Cached:         11092928 kB
SwapCached:            0 kB
Active:          2160296 kB
Inactive:        9255464 kB
Active(anon):      52628 kB
Inactive(anon):    76428 kB
Active(file):    2107668 kB
Inactive(file):  9179036 kB
Unevictable:        7396 kB
Mlocked:            7396 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3148 kB
Writeback:             0 kB
AnonPages:        108788 kB
Mapped:            43600 kB
Shmem:             25248 kB
Slab:             194108 kB
SReclaimable:     166260 kB
SUnreclaim:        27848 kB
KernelStack:        3392 kB
PageTables:         5228 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     483352 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     38912 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 55556 MiB
End job on node134 at 2018-07-26 10:37:34