Featured Post

15 Python Tips : How to Write Code Effectively

Image
 Here are some Python tips to keep in mind that will help you write clean, efficient, and bug-free code.     Python Tips for Effective Coding 1. Code Readability and PEP 8  Always aim for clean and readable code by following PEP 8 guidelines.  Use meaningful variable names, avoid excessively long lines (stick to 79 characters), and organize imports properly. 2. Use List Comprehensions List comprehensions are concise and often faster than regular for-loops. Example: squares = [x**2 for x in range(10)] instead of creating an empty list and appending each square value. 3. Take Advantage of Python’s Built-in Libraries  Libraries like itertools, collections, math, and datetime provide powerful functions and data structures that can simplify your code.   For example, collections.Counter can quickly count elements in a list, and itertools.chain can flatten nested lists. 4. Use enumerate Instead of Range     When you need both the index and the value in a loop, enumerate is a more Pyth

Big Data: Top Hadoop Interview Questions (3 of 5)

1) What are daemons in Hadoop?

Big Data: Top Hadoop Interview Questions
#Big Data: Top Hadoop Interview Questions:
In reality running Hadoop means, running daemons of resident programs in multiple servers of your network. This kind of architecture is called fully configured cluster.

2) How daemons run in Hadoop architecture?

Some daemons run in only one server, and others run in more than one server

3) What are the 5 daemons of Hadoop?

-Name node
-Secondary name node
-Data Node
-Job tracker
-Task tracker

4) How many levels do we classify Hadoop broadly?

Broadly we can classify as, it is combination of distributed storage and distributed computation.
Also, as Master/Slave architecture

5) Who is the master of HDFS?

Name node is the master of HDFS

6) What are the functions of Name node?

-Master of HDFS
-Directs slave node i.e., Data nodes
-Book keeping for HDFS
-Monitor overall health of HDFS

7) What is data node?

Each slave machine will have Data node daemon.It performs grunt work of distributed file system

8) What are the functions of Data node?

-Main functionality is read or write HDFS file blocks to local system
-Data node communicates to name node about data blocks. Name node in turn communcates about data block and Data nodes to client.
-Data nodes can communicate each other
-Every change of data in Data node will communicate to Name node

9) How many replicas of data blocks stored in different Data nodes?

3

10) What is Secondary Data node(SNN)?
  • SNN is an assistant to Name node. It also monitors the state of HDFS cluster
  • Like Name node each cluster has one SNN, and it typically resides on its own machine
  • Data nodes and Task trackers run on multiple servers.
It does not record any changes, but time to time it suggests Name node to take SNAP shots of HDFS metadata

11) What will happen if Name node fails?

Then , human interventions is required. That time SNN acts as Name node.

12) What is the role of Job tracker?

This is mediator between client and Task tracker
- Prepares execution plan
-Assign works to task trackers
-Assign nodes to different tasks
-Monitors all tasks are running fine or not

13) What is the role of Task tracker?

Manages execution of individual tasks on each slave node
Single task tracker for each slave node
A task tracker can spread multiple JVMs in a single slave node, to process parallel

Comments

Popular posts from this blog

How to Fix datetime Import Error in Python Quickly

SQL Query: 3 Methods for Calculating Cumulative SUM

Python placeholder '_' Perfect Way to Use it