Featured post

The Ultimate Cheat Sheet On Hadoop

Top 20 frequently asked questions to test your Hadoop knowledge given in the below Hadoop cheat sheet. Try finding your own answers and match the answers given here.




Question #1 

You have written a MapReduce job that will process 500 million input records and generate 500 million key-value pairs. The data is not uniformly distributed. Your MapReduce job will create a significant amount of intermediate data that it needs to transfer between mappers and reducers which is a potential bottleneck. A custom implementation of which of the following interfaces is most likely to reduce the amount of intermediate data transferred across the network?



A. Writable
B. WritableComparable
C. InputFormat
D. OutputFormat
E. Combiner
F. Partitioner
Ans: e




Question #2 

Where is Hive metastore stored by default ?


A. In HDFS
B. In client machine in the form of a flat file.
C. In client machine in a derby database
D. In lib directory of HADOOP_HOME, and requires HADOOP_CLASSPATH to be modified.
Ans: c




Question…

Beginner's Tutorial on Cloud Resources Management(1of 2)

Cloud resource management refers to the allocation of cloud resources, such as processor power, memory capacity, and network bandwidth.
resource management in cloud computing

Resource management in Cloud computing

  • The resource management system is the system responsible for allocating the cloud resources to users and applications. 
  • For any resource management system to become successful, it needs to flexibly utilize the available cloud resources whilst maintaining service isolation.

How resource management works

  1. The resource management system is expected to operate under the predefined QoS requirements as set by the customers. 
  2. The resource management at cloud scale requires a rich set of resource management schemes.
  3. The provider should show an option for scalability.

Challenges 

The big challenge for cloud service providers is in managing physical and virtual resources according to user-resources demands. 

  • It is in a way that rapidly and dynamically provides resources to applications. 
  • The big challenge for cloud service providers is in managing physical and virtual resources according to user-resources demands. 
  • Resource provider should show solutions to migrate with minimal time.

    Comments

    Popular posts from this blog

    AWS Vs Azure Load Balancers Top Insights

    Hadoop File System Basic Commands

    4 Important Skills You Need for Data Scientists

    Hyperledger Fabric: 20 Real Interview Questions