Featured post

The Ultimate Cheat Sheet On Hadoop

Top 20 frequently asked questions to test your Hadoop knowledge given in the below Hadoop cheat sheet. Try finding your own answers and match the answers given here.




Question #1 

You have written a MapReduce job that will process 500 million input records and generate 500 million key-value pairs. The data is not uniformly distributed. Your MapReduce job will create a significant amount of intermediate data that it needs to transfer between mappers and reducers which is a potential bottleneck. A custom implementation of which of the following interfaces is most likely to reduce the amount of intermediate data transferred across the network?



A. Writable
B. WritableComparable
C. InputFormat
D. OutputFormat
E. Combiner
F. Partitioner
Ans: e




Question #2 

Where is Hive metastore stored by default ?


A. In HDFS
B. In client machine in the form of a flat file.
C. In client machine in a derby database
D. In lib directory of HADOOP_HOME, and requires HADOOP_CLASSPATH to be modified.
Ans: c




Question…

How to achieve Virtualization in cloud computing real ideas

In order to run applications on a Cloud, one needs a flexible middleware that eases the development and the deployment process.

Middleware Approach to Deploy Application on Cloud

  1. GridGain provides a middleware that aims to develop and run applications on both public and private Clouds without any changes in the application code. 
  2. It is also possible to write dedicated applications based on the map/reduce programming model. Although GridGain provides a mechanism to seamlessly deploy applications on a grid or a Cloud, it does not support the deployment of the infrastructure itself.
  3. It does, however, provide protocols to discover running GridGain nodes and organize them into topologies (Local Grid, Global Grid, etc.) to run applications on only a subset of all nodes.
    Elastic Grid infrastructure provides dynamic allocation, deployment, and management of Java applications through the Cloud. 
  4. It also offers a Cloud virtualization layer that abstracts specific Cloud computing provider technology to isolate applications from specific implementations

Virtualization in CLOUD Computing

With the rapid expansion of Information Technology (IT) infrastructures in recent years, managing computing resources in enterprise environments has become increasingly complex.

In this context, virtualization technologies have been widely adopted by the industry as a means to enable efficient resource allocation and management, in order to reduce operational costs while improving application performance and reliability.
  1. Generally speaking, virtualization aims at partitioning physical resources into logical resources that can be allocated to applications in a flexible manner.
  2. For instance, server virtualization is a technology that partitions the physical machine into multiple Virtual Machines (VMs), each capable of running applications just like a physical machine. By separating logical resources from the underlying physical resources, server virtualization enables flexible assignment of workloads to physical machines.
  3. This not only allows workload running on multiple virtual machines to be consolidated on a single physical machine but also enables a technique called VM migration, which is the process of dynamically moving a virtual machine from one physical machine to another.

Comments

Popular posts from this blog

AWS Vs Azure Load Balancers Top Insights

Hadoop File System Basic Commands

4 Important Skills You Need for Data Scientists

Hyperledger Fabric: 20 Real Interview Questions