Featured post

How to Use Special Keys in UNIX

UNIX operating system has some special keys. These you can use to interrupt the program processing or to resume it. The file management and keys totally different in UNIX kinds of operating systems. 



An example of a UNIX special key and its use.
Special Keys in UNIX much useful to take action  when something happens.

1. Why You Need Program Interruption in UNIX.

A scenario where you made some mistake in the input command and you need to stop the further process. Then you can use the CTRL+C command. It is equal to the DELETE command.

2. List of UNIX Special Keys.

RETURN key 
The RETURN key signifies the end of a line of input. On any terminal, RETURN has a key of its own, or return may be typed by holding down the control key and typing a 'm'.

CTRL-m Key
Hint: Ctrl-m command is equal to RETURN key in Unix systems


DELETE Key
The DELETE key stops a program/command immediately, without waiting for it to finish. DELETE can be achieved equivalently with ctrl-c.
Hint: Ctrl-c Command you can use …

The best 5 differences of AWS EMR and Hadoop

With Amazon Elastic MapReduce (Amazon EMR) you can analyze and process vast amounts of data. It does this by distributing the computational work across a cluster of virtual servers running in the Amazon cloud. The cluster is managed using an open-source framework called Hadoop.
With Amazon Elastic MapReduce (Amazon EMR) you can analyze and process vast amounts of data.

Amazon EMR - Elastic MapReduce, The Unique Features


Amazon EMR has made enhancements to Hadoop and other open-source applications to work seamlessly with AWS.

For example, Hadoop clusters running on Amazon EMR use EC2 instances as virtual Linux servers for the master and slave nodes, Amazon S3 for bulk storage of input and output data, and CloudWatch to monitor cluster performance and raise alarms.

You can also move data into and out of DynamoDB using Amazon EMR and Hive.

All of this is orchestrated by Amazon EMR control software that launches and manages the Hadoop cluster. This process is called an Amazon EMR cluster.

What does Hadoop do...

Hadoop uses a distributed processing architecture called MapReduce in which a task is mapped to a set of servers for processing.

The results of the computation performed by those servers is then reduced down to a single output set.

One node, designated as the master node, controls the distribution of tasks. The following diagram shows a Hadoop cluster with the master node directing a group of slave nodes which process the data.

One Master node handles multiple slave nodes.
AWS Cloud Formation
All open-source projects that run on top of the Hadoop architecture can also be run on Amazon EMR. The most popular applications, such as Hive, Pig, HBase, DistCp, and Ganglia, are already integrated with Amazon EMR.
By running Hadoop on Amazon EMR you will get the following benefits of the cloud:
  1. The ability to provision clusters of virtual servers within minutes.
  2. You can scale the number of virtual servers in your cluster to manage your computation needs, and only pay for what you use. 
  3. Integration with other AWS services.

Comments

Popular posts from this blog

How to Use Special Keys in UNIX

How to Categorise Python Top Uses

10 Top Unix Disk Space Quiz Questions

Hyperledger Fabric: 20 Real Interview Questions

5 Super SEO Blogger Tools

5 Top Features People Need Today in Modern Devices