Featured post

The Ultimate Cheat Sheet On Hadoop

Top 20 frequently asked questions to test your Hadoop knowledge given in the below Hadoop cheat sheet. Try finding your own answers and match the answers given here.

Question #1 

You have written a MapReduce job that will process 500 million input records and generate 500 million key-value pairs. The data is not uniformly distributed. Your MapReduce job will create a significant amount of intermediate data that it needs to transfer between mappers and reducers which is a potential bottleneck. A custom implementation of which of the following interfaces is most likely to reduce the amount of intermediate data transferred across the network?

A. Writable
B. WritableComparable
C. InputFormat
D. OutputFormat
E. Combiner
F. Partitioner
Ans: e

Question #2 

Where is Hive metastore stored by default ?

B. In client machine in the form of a flat file.
C. In client machine in a derby database
D. In lib directory of HADOOP_HOME, and requires HADOOP_CLASSPATH to be modified.
Ans: c


Big Data:Top Hadoop Interview Questions (2 of 5)

Frequently asked Hadoop interview questions.

1. What is Hadoop?Hadoop is a framework that allows users the power of distributed computing.

2.What is the difference between SQL and Hadoop?

SQL is allowed to work with structured data. But SQL is most suitable for legacy technologies. Hadoop is suitable for unstructured data. And, it is well suited for modern technologis.

3. What is Hadoop framework?

It is distributed network of commodity servers(A server can contain multiple clusters, and a cluster can have multiple nodes)

4. What are 4 properties of Hadoop?

Accessible-Hadoop runs on large clusters of commodity machinesRobust-An assumption that low commodity machines cause many machine failures. But it handles these tactfully. Scalable-Hadoop scales linearly to handle larger data by adding more nodes to the cluster. Simple-Hadoop allows users to quickly write efficient parallel code

5. What kind of data Hadoop needs?

Traditional RDBMS having relational structure with data resides in tables. In Hadoop. data should be in Key,Value pair.

6. Is Hadoop suitable for on the fly processing?

Hadoop is not suitable. It is suitable only for off-line processing. That means, we can not use Hadoop on active web logs. We can use it on web logs data,which already generated. So, in this property Hadoop is matching to traditional data warehouses.

7. What is Map reduce?

Map reduce is a data processing model, which contain mappers, and reducers. It takes unstructred data as input, and create as Key,Value pairs for processing on Hadoop.


Popular posts from this blog

AWS Vs Azure Load Balancers Top Insights

Hadoop File System Basic Commands

4 Important Skills You Need for Data Scientists

Hyperledger Fabric: 20 Real Interview Questions