Featured post

3 Top Books Every Analytics Engineer to Read

Many of the analytics jobs nowadays are for the financial domain. The top financial domains are Banking, Payments, and credit cards. 
The Best Books are on:
SASUNIXPython

The skills you need to work in data analytics are SAS, UNIX, Python, and JavaScript.  I have selected three books for beginners of data analysts. 

1. SAS best book 
I found one best book that is little SAS. This post covers almost all examples and critical macros you need for your job.

The best-selling Little SAS Book just got even better. Readers worldwide study this easy-to-follow book to help them learn the basics of SAS programming.

Now Rebecca Ottesen has teamed up with the original authors, Lora Delwiche, and Susan Slaughter, to provide a new way to challenge and improve your SAS skills through thought-provoking questions, exercises, and projects.
2. UNIX best book
The basic commands you will get everywhere. The way of executing Macros or shell scripts is really you need. This is a good book so that you can automate…
Post a Comment

How to Setup Hadoop Cluster Top Ideas

Hadoop cluster setup in Centos Operating System explained in this post. So you can install CentOs either in your Laptop or in Virtual Machine.
Hadoop cluster setup proces
Hadoop Cluster Setup Process

9 Steps Process to Setup Hadoop Cluster

Step 1:  Installing Sun Java on Linux. Commands to execute for the same:
sudo apt-add-repository ppa:flexiondotorg/java
sudo apt-get update
sudo apt-get install sun-java6-jre sun-java6-plugin
sudo update-java-alternatives -s java-6-sun

Step 2:  Create Hadoop User. Commands to execute for the same:
$sudo addgroup hadoop
$sudo adduser —ingroup hadoop hduser

Step 3:  Install SSH Server if not already present. Commands are:
$ sudo apt-get install openssh-server
$ su - hduser
$ ssh-keygen -t rsa -P ""
$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys

Step 4:  Installing Hadoop. Commands for the same are:
$wget http://www.eng.lsu.edu/mirrors/apache/hadoop/core/hadoop-0.22.0/hadoop-0.22.0.tar.gz
$ cd /home/hduser
$ tar xzf hadoop-0.22.2.tar.gz
$ mv hadoop-0.22.2 hadoop

Step 5:  Edit .bashrc. Commands:
# Set Hadoop-related environment variables
export HADOOP_HOME=/home/hduser/hadoop
# Set JAVA_HOME (we will also configure JAVA_HOME directly for Hadoop later on)
export JAVA_HOME=/usr/lib/jvm/java-6-sun

Step 6:  Update hadoop-env.sh
Here we need to only update the JAVA_HOME variable, we just need to open the file from text editor.
$vi /home/hduser/hadoop/conf/hadoop-env.sh
And update the following:
export JAVA_HOME=/usr/lib/jvm/java-6-sun

Step 7:  Update the files residing in the conf folder.  The three main files are:
Core-site.xml
Mapred-site.xml
Hdfs-site.xml
Here we need to change the value of namenode and jobtracker to where we want to run.

Step 8:  Start the hadoop cluster, using command.
Start-all.sh

Step 9:  Check if all the processes are up and running, using command:
Jps
That’s it. The cluster should be up and running with the following 5 processes:
  • NameNode
  • SecondaryNameNode
  • DataNode
  • JobTracker
  • TaskTracker
If we see all these processes, it means our installation is successful and the cluster is up and running.

Comments

Post a Comment

Thanks for your message. We will get back you.

Popular posts from this blog

Quick Comparison AWS Vs Azure Load Balancer

Image
Amazon Web Services has three types of load balancers. And Azure is having two types of load balancers. This post tells you the top comparison between these two load balancers.


Amazon Web Services Load Balancer Types
Application Load balancer Network Load balancer Classic Load balancers.
Application Load Balancer
Balancing of HTTP and HTTPS traffic and provides advanced request routing targeted at the delivery of modern application architectures, including microservices and containers. 
Operating at the individual request level (Layer 7), Application Load Balancer routes traffic to targets within Amazon Virtual Private Cloud (Amazon VPC) based on the content of the request.
Network Load Balancer
 Network Load Balancer is best suited for load balancing of Transmission Control Protocol (TCP), User Datagram Protocol (UDP), and Transport Layer Security (TLS) traffic where extreme performance is required.
Classic Load BalancerClassic Load Balancer provides basic load balancing across multiple Amazo…
Read more

Hyperledger Fabric: 20 Real Interview Questions

Image
I am practicing Hyperledger. This is one of the top listed blockchains. This architecture follows R3 Corda specifications. Sharing the interview questions with you that I have prepared for my interview.

Though Ethereum leads in the real-time applications. The latest Hyperledger version is now ready for production applications. It has now become stable for production applications.
The Hyperledger now backed by IBM. But, it is still an open source. These interview questions help you to read quickly. The below set of interview questions help you like a tutorial on Hyperledger fabric. Hyperledger Fabric Interview Questions1). What are Nodes?
In Hyperledger the communication entities are called Nodes.

2). What are the three different types of Nodes?
- Client Node
- Peer Node
- Order Node
The Client node initiates transactions. The peer node commits the transaction. The order node guarantees the delivery.

3). What is Channel?
A channel in Hyperledger is the subnet of the main blockchain. You c…
Read more

10 Best Visualization Charts to Present data

Image
I am going to share with you top data visualization charts examples in this post. The data growing up year to year giving a problem for users to understand. 

So data visualization is the best way to present data. The given examples of top data visualization charts help you understand the visualization concept quickly.
...



10 Types of Top Visualization Charts ExamplesPie chartsHistogramsScatter plotsTimetable chartsVenn diagramsSteam graphsStacked area graphsStacked bar graphsParallel setsMulti-set bar charts
Pie Charts


Best Example: The real usage of Pie-charts is to find information about different groups.The complete data to draw Pie chart.
Histograms



Best Example The purpose of the Histogram is to know the frequency distribution.The complete data to draw Histogram Scatter Plots


Best Example: The best example is to find the data scattering and to study the patterns. Useful in the study of medical data.The complete data to draw a Scatter plot. Time Table Charts


Best Example The best example is Scho…
Read more

JavaScript Vs JSON Top Differences

Image
Today I woke up after my night sleep, and quickly I completed my daily routines. I thought a few minutes to write useful posts to my readers. I decided to write the differences between Javascript and JSON.



JSON Quick InsightsJSON is simply a data-interchange format and, therefore, does not directly require immediate knowledge of the JavaScript language.JSON a subset of the JavaScript language. Since JSON is made from JavaScript.Data exchange can occur between both browser and server and even server to server, for that matter. Of course, these are not the only possible means to exchange JSON, and to leave it at those two would be rather limiting.The file extension is .json.JSON can be structured:A collection of name/value pairs.An ordered list of values.An introduction to JSON read here.
JavaScript Quick InsightsJavaScript is a text-based scripting language, whereby sequences of Unicode characters are strung togetherJavaScript supports two different types of data types.Primitive and non-…
Read more