Trace number 4266475

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco-sat 1.12? (MO) 224.31599 224.455

General information on the benchmark

NameChessboardColoration/ChessboardColoration-int-s1/
ChessboardColoration-int-35-35.xml
MD5SUM8013d5ca2692908d001f725061313983
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark33
Best CPU time to get the best result obtained on this benchmark3312.9099
Satisfiable
(Un)Satisfiability was proved
Number of variables1225
Number of constraints354026
Number of domains1
Minimum domain size1225
Maximum domain size1225
Distribution of domain sizes[{"size":1225,"count":1225}]
Minimum variable degree1158
Maximum variable degree1158
Distribution of variable degrees[{"degree":1158,"count":1225}]
Minimum constraint arity4
Maximum constraint arity1225
Distribution of constraint arities[{"arity":4,"count":354025},{"arity":1225,"count":1}]
Number of extensional constraints0
Number of intensional constraints354025
Distribution of constraint types[{"type":"intension","count":354025},{"type":"lex","count":1}]
Optimization problemYES
Type of objectivemin MAXIMUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14239 MiB free)
  memory of node 1: 16384 MiB (14838 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4266475-1502593544/watcher-4266475-1502593544 -o /tmp/evaluation-result-4266475-1502593544/solver-4266475-1502593544 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580 cosoco -lc -model -restarts -sat HOME/instance-4266475-1502593544.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=27326, runsolver pid=27323

[startup+0.100835 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29763160/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=39836 memory=15908 CPUtime=0.09 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 4148 0 0 0 9 0 0 0 20 0 1 0 92442688 40792064 3977 33554432000 4194304 5972588 140730390185664 140730390182232 5471948 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 9959 3977 717 435 0 3322 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 39836 KiB
Current children cumulated memory: 15908 KiB

[startup+0.209683 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29762788/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=40160 memory=16136 CPUtime=0.2 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 4261 0 0 0 20 0 0 0 20 0 1 0 92442688 41123840 4034 33554432000 4194304 5972588 140730390185664 140730390182232 140305465916389 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 10040 4034 717 435 0 3403 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40160 KiB
Current children cumulated memory: 16136 KiB

[startup+0.30887 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29762416/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=40424 memory=16396 CPUtime=0.3 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 4341 0 0 0 30 0 0 0 20 0 1 0 92442688 41394176 4099 33554432000 4194304 5972588 140730390185664 140730390182232 5384316 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 10106 4099 717 435 0 3469 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 40424 KiB
Current children cumulated memory: 16396 KiB

[startup+0.700272 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29761672/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=41600 memory=17500 CPUtime=0.68 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 4748 0 0 0 68 0 0 0 20 0 1 0 92442688 42598400 4375 33554432000 4194304 5972588 140730390185664 140730390182232 5417430 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 10400 4375 717 435 0 3763 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 41600 KiB
Current children cumulated memory: 17500 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29760184/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=45620 memory=20768 CPUtime=1.48 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 5594 0 0 0 148 0 0 0 20 0 1 0 92442688 46714880 5192 33554432000 4194304 5972588 140730390185664 140730390182232 5669908 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 11405 5192 717 435 0 4768 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 45620 KiB
Current children cumulated memory: 20768 KiB

[startup+3.10936 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29752132/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=52124 memory=26152 CPUtime=3.1 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 6785 0 0 0 309 1 0 0 20 0 1 0 92442688 53374976 6538 33554432000 4194304 5972588 140730390185664 140730390182232 5414636 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 13031 6538 717 435 0 6394 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 52124 KiB
Current children cumulated memory: 26152 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29742016/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=65000 memory=37184 CPUtime=6.29 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 9089 0 0 0 627 2 0 0 20 0 1 0 92442688 66560000 9296 33554432000 4194304 5972588 140730390185664 140730390182232 140305465916389 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 16250 9296 717 435 0 9613 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 65000 KiB
Current children cumulated memory: 37184 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=29427500/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=427892 memory=402264 CPUtime=12.68 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 100344 0 0 0 1254 14 0 0 20 0 1 0 92442688 438161408 100566 33554432000 4194304 5972588 140730390185664 140730390179224 4967517 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 106973 100566 787 435 0 100336 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 427892 KiB
Current children cumulated memory: 402264 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=28472264/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=1366120 memory=1340620 CPUtime=25.48 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 335324 0 0 0 2505 43 0 0 20 0 1 0 92442688 1398906880 335155 33554432000 4194304 5972588 140730390185664 140730390177240 4967517 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 341530 335155 787 435 0 334893 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 1366120 KiB
Current children cumulated memory: 1340620 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27327
/proc/meminfo: memFree=26563196/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=3242340 memory=3216660 CPUtime=51.07 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 804423 0 0 0 5004 103 0 0 20 0 1 0 92442688 3320156160 804165 33554432000 4194304 5972588 140730390185664 140730390179224 140305465916389 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 810585 804165 787 435 0 803948 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 3242340 KiB
Current children cumulated memory: 3216660 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27328
/proc/meminfo: memFree=22819540/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=6993128 memory=6967572 CPUtime=102.23 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 1742135 0 0 0 10000 223 0 0 20 0 1 0 92442688 7160963072 1741893 33554432000 4194304 5972588 140730390185664 140730390177432 4967517 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 1748282 1741893 787 435 0 1741645 0
Current children cumulated CPU time: 102.23 s
Current children cumulated vsize: 6993128 KiB
Current children cumulated memory: 6967572 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 27329
/proc/meminfo: memFree=18414284/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=11390244 memory=11364224 CPUtime=162.19 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 2841290 0 0 0 15855 364 0 0 20 0 1 0 92442688 11663609856 2841056 33554432000 4194304 5972588 140730390185664 140730390177240 140305475575159 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 2847561 2841056 787 435 0 2840924 0
Current children cumulated CPU time: 162.19 s
Current children cumulated vsize: 11390244 KiB
Current children cumulated memory: 11364224 KiB

[startup+222.3 s]
/proc/loadavg: 2.44 2.12 2.08 3/187 27331
/proc/meminfo: memFree=14012592/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=15783024 memory=15757448 CPUtime=222.15 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 3939582 0 0 0 21704 511 0 0 20 0 1 0 92442688 16161816576 3939362 33554432000 4194304 5972588 140730390185664 140730390179224 4967517 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 3945756 3939362 787 435 0 3939119 0
Current children cumulated CPU time: 222.15 s
Current children cumulated vsize: 15783024 KiB
Current children cumulated memory: 15757448 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+223.6 s]
/proc/loadavg: 2.44 2.12 2.08 3/187 27331
/proc/meminfo: memFree=13939680/32770624 swapFree=67108860/67108860
[pid=27326] ppid=27323 vsize=15877728 memory=15852224 CPUtime=223.45 cores=1,3,5,7
/proc/27326/stat : 27326 (cosoco) R 27323 27326 24168 0 -1 4202496 3963270 0 0 0 21830 515 0 0 20 0 1 0 92442688 16258793472 3963056 33554432000 4194304 5972588 140730390185664 140730390179224 4967517 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 8070896 8075904 40968192 140730390193338 140730390193438 140730390193438 140730390196174 0
/proc/27326/statm: 3969432 3963056 787 435 0 3962795 0
Current children cumulated CPU time: 223.45 s
Current children cumulated vsize: 15877728 KiB
Current children cumulated memory: 15852224 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+224.455 s]
# the end of solver process 27326 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=218.302 s, system=6.0136 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+224 s]*
/proc/loadavg: 2.49 2.14 2.08 3/187 27331
/proc/meminfo: memFree=21484808/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+224.4 s]
/proc/loadavg: 2.49 2.14 2.08 3/187 27331
/proc/meminfo: memFree=21484808/32770624 swapFree=67108860/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child ended because it received signal 15 (SIGTERM)
Real time (s): 224.455
CPU time (s): 224.316
CPU user time (s): 218.302
CPU system time (s): 6.0136
CPU usage (%): 99.9381
Max. virtual memory (cumulated for all children) (KiB): 15877728
Max. memory (cumulated for all children) (KiB): 15852224

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 218.302
system time used= 6.0136
maximum resident set size= 15852248
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3963270
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 179
involuntary context switches= 130


# summary of solver processes directly reported to runsolver:
#   pid: 27326
#   total CPU time (s): 224.316
#   total CPU user time (s): 218.302
#   total CPU system time (s): 6.0136

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.817291 second user time and 1.63223 second system time

The end

Launcher Data 

Begin job on node103 at 2017-08-13 04:51:26
IDJOB=4266475
IDBENCH=139738
IDSOLVER=2655
FILE ID=node103/4266475-1502593544
RUNJOBID= node103-1502567255-24253
PBS_JOBID= 20628288
Free space on /tmp= 61772 MiB

SOLVER NAME= cosoco-sat 1.12
BENCH NAME= XCSP17/ChessboardColoration/ChessboardColoration-int-s1/ChessboardColoration-int-35-35.xml
COMMAND LINE= cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4266475-1502593544/watcher-4266475-1502593544 -o /tmp/evaluation-result-4266475-1502593544/solver-4266475-1502593544 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node103-1502567255-24253 --watchdog 2580  cosoco -lc -model -restarts -sat HOME/instance-4266475-1502593544.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8013d5ca2692908d001f725061313983
RANDOM SEED=906386772

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29776124 kB
MemAvailable:   31965948 kB
Buffers:          131524 kB
Cached:          2353452 kB
SwapCached:            0 kB
Active:           552068 kB
Inactive:        2018364 kB
Active(anon):      88056 kB
Inactive(anon):    25212 kB
Active(file):     464012 kB
Inactive(file):  1993152 kB
Unevictable:        6344 kB
Mlocked:            6344 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             22516 kB
Writeback:             0 kB
AnonPages:        122740 kB
Mapped:            44276 kB
Shmem:             25228 kB
Slab:             122612 kB
SReclaimable:      96988 kB
SUnreclaim:        25624 kB
KernelStack:        3360 kB
PageTables:         5376 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     383708 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     61440 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61768 MiB
End job on node103 at 2017-08-13 04:55:11