Trace number 4396814

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (MO) 142.858 144.574

General information on the benchmark

NameRoomMate/
RoomMate-int-s1/RoomMate-sr1000c-int.xml
MD5SUM2ff4403728a82746813109e0b9ab6660
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark495.64
Satisfiable
(Un)Satisfiability was proved
Number of variables1000
Number of constraints1998000
Number of domains1
Minimum domain size999
Maximum domain size999
Distribution of domain sizes[{"size":999,"count":1000}]
Minimum variable degree3996
Maximum variable degree3996
Distribution of variable degrees[{"degree":3996,"count":1000}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":1998000}]
Number of extensional constraints0
Number of intensional constraints1998000
Distribution of constraint types[{"type":"intension","count":1998000}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14740 MiB free)
  memory of node 1: 16384 MiB (15361 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396814-1568582048/watcher-4396814-1568582048 -o /tmp/evaluation-result-4396814-1568582048/solver-4396814-1568582048 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568572744-4608 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396814-1568582048.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=6450, runsolver pid=6447
Current StackSize limit: 8192 KiB


[startup+0.100144 s]*
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30813996/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=37496 memory=13688 CPUtime=0.1 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 3592 0 0 0 10 0 0 0 20 0 1 0 434476409 38395904 3422 33554432000 4194304 6211092 140730926245824 140730926241768 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 9374 3422 807 493 0 2679 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 37496 KiB
Current children cumulated memory: 13688 KiB

[startup+0.209769 s]*
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30811764/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=39532 memory=15732 CPUtime=0.2 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 4186 0 0 0 20 0 0 0 20 0 1 0 434476409 40480768 3933 33554432000 4194304 6211092 140730926245824 140730926241768 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 9883 3933 807 493 0 3188 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 39532 KiB
Current children cumulated memory: 15732 KiB

[startup+0.309253 s]*
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30809904/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=41756 memory=17444 CPUtime=0.3 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 4806 0 0 0 30 0 0 0 20 0 1 0 434476409 42758144 4361 33554432000 4194304 6211092 140730926245824 140730926241768 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 10439 4361 807 493 0 3744 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41756 KiB
Current children cumulated memory: 17444 KiB

[startup+0.700281 s]
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30804980/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=49108 memory=24564 CPUtime=0.69 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 6920 0 0 0 68 1 0 0 20 0 1 0 434476409 50286592 6141 33554432000 4194304 6211092 140730926245824 140730926243096 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 12277 6141 807 493 0 5582 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 49108 KiB
Current children cumulated memory: 24564 KiB

[startup+1.5003 s]
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30795568/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=64340 memory=39332 CPUtime=1.49 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 11257 0 0 0 148 1 0 0 20 0 1 0 434476409 65884160 9833 33554432000 4194304 6211092 140730926245824 140730926243096 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 16085 9833 807 493 0 9390 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 64340 KiB
Current children cumulated memory: 39332 KiB

[startup+3.10959 s]
/proc/loadavg: 2.08 2.08 2.08 3/200 6451
/proc/meminfo: memFree=30758404/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=94936 memory=69848 CPUtime=3.1 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 18636 0 0 0 307 3 0 0 20 0 1 0 434476409 97214464 17462 33554432000 4194304 6211092 140730926245824 140730926243096 5648333 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 23734 17462 807 493 0 17039 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 94936 KiB
Current children cumulated memory: 69848 KiB

[startup+6.30028 s]
/proc/loadavg: 1.91 2.04 2.07 3/200 6451
/proc/meminfo: memFree=30700748/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=155732 memory=130612 CPUtime=6.28 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 33065 0 0 0 623 5 0 0 20 0 1 0 434476409 159469568 32653 33554432000 4194304 6211092 140730926245824 140730926243096 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 38933 32653 807 493 0 32238 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 155732 KiB
Current children cumulated memory: 130612 KiB

[startup+12.7003 s]
/proc/loadavg: 1.92 2.04 2.07 3/200 6451
/proc/meminfo: memFree=30590444/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=277720 memory=249712 CPUtime=12.69 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 60116 0 0 0 1258 11 0 0 20 0 1 0 434476409 284385280 62428 33554432000 4194304 6211092 140730926245824 140730926240984 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 69430 62428 807 493 0 62735 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 277720 KiB
Current children cumulated memory: 249712 KiB

[startup+25.5004 s]
/proc/loadavg: 1.94 2.04 2.07 3/200 6454
/proc/meminfo: memFree=29281852/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=1627148 memory=1601916 CPUtime=25.48 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 398162 0 0 0 2486 62 0 0 20 0 1 0 434476409 1666199552 400479 33554432000 4194304 6211092 140730926245824 140730926240920 5071149 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 406787 400479 823 493 0 400092 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 1627148 KiB
Current children cumulated memory: 1601916 KiB

[startup+51.1096 s]
/proc/loadavg: 1.96 2.04 2.07 3/200 6454
/proc/meminfo: memFree=26084172/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=4771068 memory=4745588 CPUtime=51.07 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 1184289 0 0 0 4939 168 0 0 20 0 1 0 434476409 4885573632 1186397 33554432000 4194304 6211092 140730926245824 140730926240920 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 1192767 1186397 823 493 0 1186072 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 4771068 KiB
Current children cumulated memory: 4745588 KiB

[startup+102.3 s]
/proc/loadavg: 2.03 2.04 2.07 3/200 6459
/proc/meminfo: memFree=19807988/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=11057548 memory=11031944 CPUtime=102.24 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 2755853 0 0 0 9838 386 0 0 20 0 1 0 434476409 11322929152 2757986 33554432000 4194304 6211092 140730926245824 140730926240920 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 2764387 2757986 823 493 0 2757692 0
Current children cumulated CPU time: 102.24 s
Current children cumulated vsize: 11057548 KiB
Current children cumulated memory: 11031944 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+141.7 s]
/proc/loadavg: 2.01 2.04 2.06 3/200 6462
/proc/meminfo: memFree=15021884/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=15882868 memory=15856804 CPUtime=141.61 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) R 6447 6450 4577 0 -1 4202496 3962125 0 0 0 13596 565 0 0 20 0 1 0 434476409 16264056832 3964201 33554432000 4194304 6211092 140730926245824 140730926238712 139830073949157 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 3970750 3964201 823 493 0 3964055 0
Current children cumulated CPU time: 141.61 s
Current children cumulated vsize: 15882868 KiB
Current children cumulated memory: 15856804 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+144.574 s]
# the end of solver process 6450 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=136.293 s, system=6.56528 s

Solver just ended.
Dumping a history of the last processes samples

[startup+142.4 s]
/proc/loadavg: 2.01 2.04 2.06 3/201 6464
/proc/meminfo: memFree=14768800/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=15883000 memory=15857068 CPUtime=141.73 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) S 6447 6450 4577 0 -1 512 3962140 0 0 0 13606 567 0 0 20 0 1 0 434476409 16264192000 3964267 33554432000 4194304 6211092 140730926245824 140730926238712 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 3970750 3964267 823 493 0 3964055 0
Current children cumulated CPU time: 141.73 s
Current children cumulated vsize: 15883000 KiB
Current children cumulated memory: 15857068 KiB

[startup+143.2 s]
/proc/loadavg: 2.01 2.04 2.06 4/201 6464
/proc/meminfo: memFree=14271172/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=15883000 memory=15857068 CPUtime=141.87 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) S 6447 6450 4577 0 -1 512 3962140 0 0 0 13619 568 0 0 20 0 1 0 434476409 16264192000 3964267 33554432000 4194304 6211092 140730926245824 140730926238712 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 3970750 3964267 823 493 0 3964055 0
Current children cumulated CPU time: 141.87 s
Current children cumulated vsize: 15883000 KiB
Current children cumulated memory: 15857068 KiB

[startup+143.6 s]
/proc/loadavg: 2.01 2.04 2.06 4/201 6464
/proc/meminfo: memFree=14271172/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=15883000 memory=15857068 CPUtime=141.95 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) S 6447 6450 4577 0 -1 512 3962140 0 0 0 13627 568 0 0 20 0 1 0 434476409 16264192000 3964267 33554432000 4194304 6211092 140730926245824 140730926238712 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 3970750 3964267 823 493 0 3964055 0
Current children cumulated CPU time: 141.95 s
Current children cumulated vsize: 15883000 KiB
Current children cumulated memory: 15857068 KiB

[startup+143.7 s]
/proc/loadavg: 2.01 2.04 2.06 4/201 6464
/proc/meminfo: memFree=14271172/32770624 swapFree=66936952/67108860
[pid=6450] ppid=6447 vsize=15883000 memory=15857068 CPUtime=141.98 cores=0,2,4,6
/proc/6450/stat : 6450 (cosoco) S 6447 6450 4577 0 -1 512 3962140 0 0 0 13629 569 0 0 20 0 1 0 434476409 16264192000 3964267 33554432000 4194304 6211092 140730926245824 140730926238712 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 36450304 140730926248971 140730926249073 140730926249073 140730926251982 0
/proc/6450/statm: 3970750 3964267 823 493 0 3964055 0
Current children cumulated CPU time: 141.98 s
Current children cumulated vsize: 15883000 KiB
Current children cumulated memory: 15857068 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 144.574
CPU time (s): 142.858
CPU user time (s): 136.293
CPU system time (s): 6.56528
CPU usage (%): 98.8129
Max. virtual memory (cumulated for all children) (KiB): 15883000
Max. memory (cumulated for all children) (KiB): 15857068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 136.293
system time used= 6.56528
maximum resident set size= 15857100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3962140
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 164102
involuntary context switches= 116


# summary of solver processes directly reported to runsolver:
#   pid: 6450
#   total CPU time (s): 142.858
#   total CPU user time (s): 136.293
#   total CPU system time (s): 6.56528

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.637125 second user time and 1.008 second system time

The end

Launcher Data 

Begin job on node151 at 2019-09-15 23:13:30
IDJOB=4396814
IDBENCH=126912
IDSOLVER=2848
FILE ID=node151/4396814-1568582048
RUNJOBID= node151-1568572744-4608
PBS_JOBID= 21703306
Free space on /tmp= 59224 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/RoomMate/RoomMate-int-s1/RoomMate-sr1000c-int.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396814-1568582048/watcher-4396814-1568582048 -o /tmp/evaluation-result-4396814-1568582048/solver-4396814-1568582048 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1568572744-4608 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396814-1568582048.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2ff4403728a82746813109e0b9ab6660
RANDOM SEED=2113842222

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5335.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30824164 kB
MemAvailable:   31827292 kB
Buffers:          207988 kB
Cached:          1094612 kB
SwapCached:        69652 kB
Active:           759172 kB
Inactive:         634280 kB
Active(anon):      27172 kB
Inactive(anon):   106784 kB
Active(file):     732000 kB
Inactive(file):   527496 kB
Unevictable:      109456 kB
Mlocked:          109456 kB
SwapTotal:      67108860 kB
SwapFree:       66936952 kB
Dirty:             58528 kB
Writeback:             0 kB
AnonPages:        137536 kB
Mapped:            43236 kB
Shmem:             34348 kB
Slab:             148376 kB
SReclaimable:     118932 kB
SUnreclaim:        29444 kB
KernelStack:        3504 kB
PageTables:         5668 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     553884 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     90112 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 58764 MiB
End job on node151 at 2019-09-15 23:15:55