Skip to main content

Greenplum Database basics in the age of Hadoop (1 of 2)

The Greenplum Database constructs on the basis of open origin database PostgreSQL. It firstly purposes like a information storage and uses a shared-nothing architecture|shared-nothing, astronomically collateral (computing)|massively collateral handling (MPP) design.

How Greenplum works...
In this design, information is partitioned athwart numerous section servers, and every one section controls and commands a clearly different part of the altogether data; there is no disk-level parting nor information argument amid sections.
Greenplum Database’s collateral request optimizer changes every one request into a material implementation design.
Greenplum’s optimizer utilizes a cost-based set of rules to appraise prospective implementation designs, bears a worldwide view of implementation athwart the computer array, and circumstances in the charges of moving information amid knots.

The ensuing request designs hold customary relational database transactions like well like collateral motion transactions that report as and how information ought to be moved amid knots throughout request implementation. Commodity Gigabit Ethernet and 10-gigabit Ethernet technics is applied aimed at the transference amid knots.

The design part of Greenplum...
During implementation of every one node within the design, numerous relational transactions are treated by Pipeline (computing)|pipelining: the capacity to start a assignment beforehand its forerunner assignment has finished, to rise effectual alikeness. For instance, when a table audit is seizing place, lines picked may be pipelined in to a connect procedure. 30+High+Paying+IT+Jobs
  • Internally, the Greenplum configuration uses record delivering and segment-level replication and delivers converted to be operated by largely automatic equipment a procedure by which a system automatically transfers control to a duplicate system when it detects a fault or failure. At the storage layer, RAID methods may disguise flat circular plate disappointments.
  • At the configuration layer, Greenplum copies section and principal information to different knots to establish that the mislaying of a engine must not influence the altogether database obtainability.


Popular posts from this blog

The best 5 differences of AWS EMR and Hadoop

With Amazon Elastic MapReduce (Amazon EMR) you can analyze and process vast amounts of data. It does this by distributing the computational work across a cluster of virtual servers running in the Amazon cloud. The cluster is managed using an open-source framework called Hadoop.

Amazon EMR has made enhancements to Hadoop and other open-source applications to work seamlessly with AWS. For example, Hadoop clusters running on Amazon EMR use EC2 instances as virtual Linux servers for the master and slave nodes, Amazon S3 for bulk storage of input and output data, and CloudWatch to monitor cluster performance and raise alarms.

You can also move data into and out of DynamoDB using Amazon EMR and Hive. All of this is orchestrated by Amazon EMR control software that launches and manages the Hadoop cluster. This process is called an Amazon EMR cluster.

What does Hadoop do...

Hadoop uses a distributed processing architecture called MapReduce in which a task is mapped to a set of servers for proce…

Top 20 ultimate ETL Questions really good for interviews

How to print/display the first line of a file?  there are many ways to do this. However the easiest way to display the first line of a file is using the [head] command.  $> head -1 file. Txt no prize in guessing that if you specify [head -2] then it would print first 2 records of the file.  another way can be by using [sed] command. [sed] is a very powerful text editor which can be used for various text manipulation purposes like this.  $> sed '2,$ d' file. Txt how does the above command work?  The 'd' parameter basically tells [sed] to delete all the records from display from line 2 to last line of the file (last line is represented by $ symbol). Of course it does not actually delete those lines from the file, it just does not display those lines in standard output screen. So you only see the remaining line which is the 1st line.  how to print/display the last line of a file?  the easiest way is to use the [tail] command.  $> tail -1 file. Txt if you want to do it using…

5 Things About AWS EC2 You Need to Focus!

Amazon Elastic Compute Cloud (Amazon EC2) - is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers.
Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction.

The basic functions of EC2... 
It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment.Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change.Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use. Amazon EC2 provides developers the tools to build failure resilient applications and isolate themselves from common failure scenarios. 
Key Points for Interviews:
EC2 is the basic fundamental block around which the AWS are structured.EC2 provides remote ope…