Posts

Showing posts with the label Sqoop

Featured Post

How to Work With Tuple in Python

Image
Tuple in python is one of the streaming datasets. The other streaming datasets are List and Dictionary. Operations that you can perform on it are shown here for your reference. Writing tuple is easy. It has values of comma separated, and enclosed with parenthesis '()'. The values in the tuple are immutable, which means you cannot replace with new values. #1. How to create a tuple Code: my_tuple=(1,2,3,4,5) print(my_tuple) Output: (1, 2, 3, 4, 5) ** Process exited - Return Code: 0 ** Press Enter to exit terminal #2. How to read tuple values Code: print(my_tuple[0]) Output: 1 ** Process exited - Return Code: 0 ** Press Enter to exit terminal #3. How to add two tuples Code: a=(1,6,7,8) c=(3,4,5,6,7,8) d=print(a+c) Output: (1, 6, 7, 8, 3, 4, 5, 6, 7, 8) ** Process exited - Return Code: 0 ** Press Enter to exit terminal #4.  How to count tuple values Here the count is not counting values; count the repetition of a given value. Code: sample=(1, 6, 7, 8, 3, 4, 5, 6, 7, 8) print(sample

Sqoop Real Use in Hadoop Framework

Image
Why Sqoop you need while working on Hadoop-The Sqoop and its primary reason is to import data from structural data sources such as Oracle/DB2 into HDFS(also called Hadoop file system). To our readers, I have collected a good video from Edureka which helps you to understand the functionality of Sqoop. The comparison between Sqoop and Flume How name come for Sqoop Sqoop word came from SQL+HADOOP=SQOOP. And Sqoop is a data transfer tool. The main use of Sqoop is to import and export a large amount of data from RDBMS to HDFS and vice versa. List of basic Sqoop commands Codegen- It helps to generate code to interact with database records. Create-hive-table- It helps to Import a table definition into a hive Eval- It helps to evaluate SQL statement and display the results Export-It helps to export an HDFS directory into a database table Help- It helps to list the available commands Import- It helps to import a table from a database to HDFS Import-all-tables- It

5 Top features of Sqoop in the age of Big data

The ‘Sqoop’ is a command-line user interface program for conveying information amid relational databases and Hadoop. The SQOOP It aids increasing stacks of a sole table either a gratis shape SQL request as well like preserved appointments that may be run numerous periods to ingress upgrades produced to a database ever since the final ingress. Imports may as well be applied to inhabit boards in Apache Hive|Hive either HBase.  Exports may be applied to put information as of Hadoop into a relational database. Apache Foundation Sqoop grew to be a top-level Apache Software Foundation, Apache program in March 2012. Microsoft utilizes a Sqoop-based connector to aid transference information as of Microsoft SQL Server databases to Hadoop. Couchbase, Inc. As well delivers a Couchbase Server-Hadoop connector by intents of Sqoop.