Skip to main content

Big Data: Top Hadoop Interview Questions (3 of 5)

1) What are daemons in Hadoop?

Big Data: Top Hadoop Interview Questions
#Big Data: Top Hadoop Interview Questions:
In reality running Hadoop means, running daemons of resident programs in multiple servers of your network. This kind of architecture is called fully configured cluster.

2) How daemons run in Hadoop architecture?

Some daemons run in only one server, and others run in more than one server

3) What are the 5 daemons of Hadoop?

-Name node
-Secondary name node
-Data Node
-Job tracker
-Task tracker

4) How many levels do we classify Hadoop broadly?

Broadly we can classify as, it is combination of distributed storage and distributed computation.
Also, as Master/Slave architecture

5) Who is the master of HDFS?

Name node is the master of HDFS

6) What are the functions of Name node?

-Master of HDFS
-Directs slave node i.e., Data nodes
-Book keeping for HDFS
-Monitor overall health of HDFS

7) What is data node?

Each slave machine will have Data node daemon.It performs grunt work of distributed file system

8) What are the functions of Data node?

-Main functionality is read or write HDFS file blocks to local system
-Data node communicates to name node about data blocks. Name node in turn communcates about data block and Data nodes to client.
-Data nodes can communicate each other
-Every change of data in Data node will communicate to Name node

9) How many replicas of data blocks stored in different Data nodes?

3

10) What is Secondary Data node(SNN)?
  • SNN is an assistant to Name node. It also monitors the state of HDFS cluster
  • Like Name node each cluster has one SNN, and it typically resides on its own machine
  • Data nodes and Task trackers run on multiple servers.
It does not record any changes, but time to time it suggests Name node to take SNAP shots of HDFS metadata

11) What will happen if Name node fails?

Then , human interventions is required. That time SNN acts as Name node.

12) What is the role of Job tracker?

This is mediator between client and Task tracker
- Prepares execution plan
-Assign works to task trackers
-Assign nodes to different tasks
-Monitors all tasks are running fine or not

13) What is the role of Task tracker?

Manages execution of individual tasks on each slave node
Single task tracker for each slave node
A task tracker can spread multiple JVMs in a single slave node, to process parallel

Comments

Popular posts from this blog

R Vs SAS differences to read today

Statistical analysis should know by every software engineer. R is an open source statistical programming language. SAS is licensed analysis suite for statistics. The two are very much popular in Machine learning and data analytics projects.
SAS is analysis suite software and R is a programming language R ProgrammingR supports both statistical analysis and GraphicsR is an open source project.R is 18th most popular LanguageR packages are written in C, C++, Java, Python and.NetR is popular in Machine learning, data mining and Statistical analysis projects. SASSAS is a statistical analysis suite. Developed to process data sets in mainframe computers.Later developed to support multi-platforms. Like  Mainframe, Windows, and LinuxSAS has multiple products. SAS/ Base is very basic level.SAS is popular in data related projects. Learn SAS vs R Top Differences between SAS Vs R Programming SAS AdvantagesThe data integration from any data source is faster in SAS.The licensed software suite, so you…

Blue Prism complete tutorials download now

Blue prism is an automation tool useful to execute repetitive tasks without human effort. To learn this tool you need the right material. Provided below quick reference materials to understand detailed elements, architecture and creating new bots. Useful if you are a new learner and trying to enter into automation career. The number one and most popular tool in automation is a Blue prism. In this post, I have given references for popular materials and resources so that you can use for your interviews.
RPA Blue Prism RPA blue prism tutorial popular resources I have given in this post. You can download quickly. Learning Blue Prism is a really good option if you are a learner of Robotic process automation.
RPA Advantages The RPA is also called "Robotic Process Automation"- Real advantages are you can automate any business process and you can complete the customer requests in less time.

The Books Available on Blue Prism 
Blue Prism resourcesDavid chappal PDF bookBlue Prism BlogsVi…

Top Differences Read Today Agile vs Waterfall model

The Agile and Waterfall both models are popular in Software development. The Agile model is so flexible compared to waterfall model. Top differences on Waterfall vs Agile give you clear understanding on both the processes. Waterfall ModelThe traditional model is waterfall. It has less flexibility.Expensive and time consuming model.Less scalable to meet the demand of customer requirements.The approach is top down. Starting from requirements one has to finish all the stages, till deployment to complete one cycle.A small change in requirement, one has to follow all the stages till deployment.Waterfall model creates idleness in resource management. Agile ModelAgile model is excellent for rapid deployment of small changesThe small split-requirements you can call them as sprintsLess idleness in resource management.Scope for complete team involvement.Faster delivery makes client happy.You can deploy changes related to compliance or regulatory quickly.Collaboration improves among the team.