Trace number 4398655

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 252.724 254.559

General information on the benchmark

NameGolombRuler/GolombRuler-a4-s1/
GolombRuler-09-a4.xml
MD5SUM24dd80e7bb1ef2b7df88c183d3ee4992
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark44
Best CPU time to get the best result obtained on this benchmark42.1712
Satisfiable
(Un)Satisfiability was proved
Number of variables9
Number of constraints548
Number of domains1
Minimum domain size501
Maximum domain size501
Distribution of domain sizes[{"size":501,"count":9}]
Minimum variable degree225
Maximum variable degree226
Distribution of variable degrees[{"degree":225,"count":7},{"degree":226,"count":2}]
Minimum constraint arity1
Maximum constraint arity9
Distribution of constraint arities[{"arity":1,"count":1},{"arity":3,"count":168},{"arity":4,"count":378},{"arity":9,"count":1}]
Number of extensional constraints0
Number of intensional constraints547
Distribution of constraint types[{"type":"intension","count":547},{"type":"ordered","count":1}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15313 MiB free)
  memory of node 1: 16384 MiB (15423 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398655-1568608644/watcher-4398655-1568608644 -o /tmp/evaluation-result-4398655-1568608644/solver-4398655-1568608644 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node102-1568597211-7653 --watchdog 312 cosoco -model -nbcores=8 HOME/instance-4398655-1568608644.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2016 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2046 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 252 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=9472, runsolver pid=9469
Current StackSize limit: 8192 KiB


[startup+0.100069 s]*
/proc/loadavg: 8.02 6.67 6.98 2/191 9473
/proc/meminfo: memFree=31469308/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=33960 memory=9624 CPUtime=0.1 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 2618 0 0 0 10 0 0 0 20 0 1 0 437115784 34775040 2406 33554432000 4194304 6211092 140734335602272 140734335598808 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 8490 2406 823 493 0 1795 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 33960 KiB
Current children cumulated memory: 9624 KiB

[startup+0.209075 s]*
/proc/loadavg: 8.02 6.67 6.98 2/191 9473
/proc/meminfo: memFree=31463976/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=39924 memory=15224 CPUtime=0.2 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 3974 0 0 0 20 0 0 0 20 0 1 0 437115784 40882176 3806 33554432000 4194304 6211092 140734335602272 140734335598808 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 9981 3806 823 493 0 3286 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 39924 KiB
Current children cumulated memory: 15224 KiB

[startup+0.308579 s]*
/proc/loadavg: 8.02 6.67 6.98 2/191 9473
/proc/meminfo: memFree=31459140/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=45384 memory=19976 CPUtime=0.31 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 5217 0 0 0 30 1 0 0 20 0 1 0 437115784 46473216 4994 33554432000 4194304 6211092 140734335602272 140734335598808 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 11346 4994 823 493 0 4651 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 45384 KiB
Current children cumulated memory: 19976 KiB

[startup+0.700321 s]
/proc/loadavg: 8.02 6.67 6.98 2/191 9473
/proc/meminfo: memFree=31447420/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=66300 memory=39200 CPUtime=0.69 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 9503 0 0 0 67 2 0 0 20 0 1 0 437115784 67891200 9800 33554432000 4194304 6211092 140734335602272 140734335598808 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 16575 9800 823 493 0 9880 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 66300 KiB
Current children cumulated memory: 39200 KiB

[startup+1.50035 s]
/proc/loadavg: 8.02 6.67 6.98 2/191 9473
/proc/meminfo: memFree=31424584/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=111196 memory=80024 CPUtime=1.49 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 17127 0 0 0 146 3 0 0 20 0 1 0 437115784 113864704 20006 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 27799 20006 824 493 0 21104 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 111196 KiB
Current children cumulated memory: 80024 KiB

[startup+3.1091 s]
/proc/loadavg: 7.45 6.58 6.94 2/191 9473
/proc/meminfo: memFree=31325608/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=206052 memory=160480 CPUtime=3.1 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 31630 0 0 0 306 4 0 0 20 0 1 0 437115784 210997248 40120 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 51513 40120 824 493 0 44818 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 206052 KiB
Current children cumulated memory: 160480 KiB

[startup+6.30035 s]
/proc/loadavg: 7.45 6.58 6.94 2/192 9475
/proc/meminfo: memFree=31174780/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=349408 memory=320120 CPUtime=6.28 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 58821 0 0 0 618 10 0 0 20 0 1 0 437115784 357793792 80030 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 87352 80030 824 493 0 80657 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 349408 KiB
Current children cumulated memory: 320120 KiB

[startup+12.7003 s]
/proc/loadavg: 6.46 6.39 6.88 2/192 9475
/proc/meminfo: memFree=30875352/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=701544 memory=639940 CPUtime=12.68 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 113717 0 0 0 1250 18 0 0 20 0 1 0 437115784 718381056 159985 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 175386 159985 824 493 0 168691 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 701544 KiB
Current children cumulated memory: 639940 KiB

[startup+25.5004 s]
/proc/loadavg: 5.62 6.21 6.82 2/191 9475
/proc/meminfo: memFree=30224012/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=1440660 memory=1279556 CPUtime=25.46 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 221532 0 0 0 2512 34 0 0 20 0 1 0 437115784 1475235840 319889 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 360165 319889 824 493 0 353470 0
Current children cumulated CPU time: 25.46 s
Current children cumulated vsize: 1440660 KiB
Current children cumulated memory: 1279556 KiB

[startup+51.1089 s]
/proc/loadavg: 4.04 5.80 6.66 2/192 9478
/proc/meminfo: memFree=28919924/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=2996628 memory=2560792 CPUtime=51.06 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 436549 0 0 0 5040 66 0 0 20 0 1 0 437115784 3068547072 640198 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 749157 640198 824 493 0 742462 0
Current children cumulated CPU time: 51.06 s
Current children cumulated vsize: 2996628 KiB
Current children cumulated memory: 2560792 KiB

[startup+102.3 s]
/proc/loadavg: 2.22 4.99 6.34 2/192 9481
/proc/meminfo: memFree=26362056/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=5337704 memory=5124884 CPUtime=102.23 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 865016 0 0 0 10091 132 0 0 20 0 1 0 437115784 5465808896 1281221 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 1334426 1281221 824 493 0 1327731 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 5337704 KiB
Current children cumulated memory: 5124884 KiB

[startup+162.3 s]
/proc/loadavg: 1.45 4.26 6.00 2/191 9484
/proc/meminfo: memFree=23356176/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=8287460 memory=8127656 CPUtime=162.2 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 1366885 0 0 0 16015 205 0 0 20 0 1 0 437115784 8486359040 2031914 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 2071865 2031914 824 493 0 2065170 0
Current children cumulated CPU time: 162.2 s
Current children cumulated vsize: 8287460 KiB
Current children cumulated memory: 8127656 KiB

[startup+222.3 s]
/proc/loadavg: 1.16 3.67 5.69 2/191 9494
/proc/meminfo: memFree=20343336/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=11711796 memory=11132604 CPUtime=222.17 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 1868754 0 0 0 21938 279 0 0 20 0 1 0 437115784 11992879104 2783151 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 2927949 2783151 824 493 0 2921254 0
Current children cumulated CPU time: 222.17 s
Current children cumulated vsize: 11711796 KiB
Current children cumulated memory: 11132604 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+252 s]*
/proc/loadavg: 1.15 3.43 5.55 2/191 9496
/proc/meminfo: memFree=18842964/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=12702588 memory=12617004 CPUtime=251.86 cores=0-7
/proc/9472/stat : 9472 (cosoco) R 9469 9472 7626 0 -1 4202496 2116705 0 0 0 24868 318 0 0 20 0 1 0 437115784 13007450112 3154251 33554432000 4194304 6211092 140734335602272 140734335596536 139646283852773 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 3175647 3154251 824 493 0 3168952 0
Current children cumulated CPU time: 251.86 s
Current children cumulated vsize: 12702588 KiB
Current children cumulated memory: 12617004 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+254.559 s]
# the end of solver process 9472 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=248.976 s, system=3.74755 s

Solver just ended.
Dumping a history of the last processes samples

[startup+252.8 s]
/proc/loadavg: 1.15 3.43 5.55 2/191 9496
/proc/meminfo: memFree=18842964/32770624 swapFree=66998864/67108860
[pid=9472] ppid=9469 vsize=12702720 memory=12617004 CPUtime=251.99 cores=0-7
/proc/9472/stat : 9472 (cosoco) S 9469 9472 7626 0 -1 512 2116715 0 0 0 24880 319 0 0 20 0 1 0 437115784 13007585280 3154251 33554432000 4194304 6211092 140734335602272 140734335596536 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 3175680 3154251 824 493 0 3168985 0
Current children cumulated CPU time: 251.99 s
Current children cumulated vsize: 12702720 KiB
Current children cumulated memory: 12617004 KiB

[startup+253.6 s]
/proc/loadavg: 1.15 3.43 5.55 3/192 9497
/proc/meminfo: memFree=18300604/32770624 swapFree=66998868/67108860
[pid=9472] ppid=9469 vsize=12702720 memory=12617004 CPUtime=252.1 cores=0-7
/proc/9472/stat : 9472 (cosoco) S 9469 9472 7626 0 -1 512 2116715 0 0 0 24891 319 0 0 20 0 1 0 437115784 13007585280 3154251 33554432000 4194304 6211092 140734335602272 140734335596536 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 3175680 3154251 824 493 0 3168985 0
Current children cumulated CPU time: 252.1 s
Current children cumulated vsize: 12702720 KiB
Current children cumulated memory: 12617004 KiB

[startup+254 s]*
/proc/loadavg: 1.15 3.43 5.55 2/192 9497
/proc/meminfo: memFree=17763560/32770624 swapFree=66998868/67108860
[pid=9472] ppid=9469 vsize=12702720 memory=12617004 CPUtime=252.16 cores=0-7
/proc/9472/stat : 9472 (cosoco) S 9469 9472 7626 0 -1 512 2116715 0 0 0 24897 319 0 0 20 0 1 0 437115784 13007585280 3154251 33554432000 4194304 6211092 140734335602272 140734335596536 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 35598336 140734335603734 140734335603826 140734335603826 140734335606734 0
/proc/9472/statm: 3175680 3154251 824 493 0 3168985 0
Current children cumulated CPU time: 252.16 s
Current children cumulated vsize: 12702720 KiB
Current children cumulated memory: 12617004 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 254.559
CPU time (s): 252.724
CPU user time (s): 248.976
CPU system time (s): 3.74755
CPU usage (%): 99.279
Max. virtual memory (cumulated for all children) (KiB): 12702720
Max. memory (cumulated for all children) (KiB): 12617004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 248.976
system time used= 3.74755
maximum resident set size= 12617136
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2116715
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 133849
involuntary context switches= 316


# summary of solver processes directly reported to runsolver:
#   pid: 9472
#   total CPU time (s): 252.724
#   total CPU user time (s): 248.976
#   total CPU system time (s): 3.74755

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.00939 second user time and 1.62142 second system time

The end

Launcher Data 

Begin job on node102 at 2019-09-16 06:36:38
IDJOB=4398655
IDBENCH=126243
IDSOLVER=2852
FILE ID=node102/4398655-1568608644
RUNJOBID= node102-1568597211-7653
PBS_JOBID= 21703406
Free space on /tmp= 59328 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/GolombRuler/GolombRuler-a4-s1/GolombRuler-09-a4.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398655-1568608644/watcher-4398655-1568608644 -o /tmp/evaluation-result-4398655-1568608644/solver-4398655-1568608644 -C 2016 -W 252 -M 31000 --bin-var /tmp/runsolver-exch-node102-1568597211-7653 --watchdog 312  cosoco -model -nbcores=8 HOME/instance-4398655-1568608644.xml

TIME LIMIT= 2016 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 24dd80e7bb1ef2b7df88c183d3ee4992
RANDOM SEED=490385872

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31475600 kB
MemAvailable:   31903964 kB
Buffers:          131192 kB
Cached:           595992 kB
SwapCached:         7660 kB
Active:           377100 kB
Inactive:         360924 kB
Active(anon):       6360 kB
Inactive(anon):    46552 kB
Active(file):     370740 kB
Inactive(file):   314372 kB
Unevictable:      110384 kB
Mlocked:          110384 kB
SwapTotal:      67108860 kB
SwapFree:       66998864 kB
Dirty:              2836 kB
Writeback:             4 kB
AnonPages:        113920 kB
Mapped:            40828 kB
Shmem:             33456 kB
Slab:             147444 kB
SReclaimable:     118176 kB
SUnreclaim:        29268 kB
KernelStack:        3424 kB
PageTables:         6040 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     507464 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 58804 MiB
End job on node102 at 2019-09-16 06:40:53