Featured Post

How to Work With Tuple in Python

-
Image
Tuple in python is one of the streaming datasets. The other streaming datasets are List and Dictionary. Operations that you can perform on it are shown here for your reference. Writing tuple is easy. It has values of comma separated, and enclosed with parenthesis '()'. The values in the tuple are immutable, which means you cannot replace with new values. #1. How to create a tuple Code: Tuple example my_tuple=(1,2,3,4,5) print(my_tuple) Output: (1, 2, 3, 4, 5) ** Process exited - Return Code: 0 ** Press Enter to exit terminal #2. How to read tuple values Code: print(my_tuple[0]) Output: 1 ** Process exited - Return Code: 0 ** Press Enter to exit terminal #3. How to add two tuples Code: a=(1,6,7,8) c=(3,4,5,6,7,8) d=print(a+c) Output: (1, 6, 7, 8, 3, 4, 5, 6, 7, 8) ** Process exited - Return Code: 0 ** Press Enter to exit terminal #4.  How to count tuple values Here the count is not counting values; count the repetition of a given value. Code: sample=(1, 6, 7, 8, 3, 4, 5, 6, 7, 8
Post a Comment

Top Key Architecture Components in HIVE

-
5 architectural components present in Hadoop Hive: Shell: allows interactive queries like MySQL shell connected to a database – Also supports web and JDBC clients Driver: session handles, fetch, execute Compiler: parse, plan, optimize Execution engine: DAG of stages (M/R, HDFS, or metadata) Metastore: schema, location in HDFS, SerDe

 Data Mode of Hive:
  • Tables
– Typed columns (int, float, string, date, boolean)
– Also, list: map (for JSON-like data)
  • Partitions
– e.g., to range-partition tables by date
  • Buckets
– Hash partitions within ranges (useful for sampling, join optimization)

HIVE Meta Store
  • Database: namespace containing a set of tables
  • Holds table definitions (column types, physical layout)
  • Partition data 
  • Uses JPOX ORM for implementation; can be stored in Derby, MySQL, many other relational databases
Physical Layout of HIVE
  • Warehouse directory in HDFS
– e.g., /home/hive/warehouse
  • Tables stored in subdirectories of warehouse
– Partitions, buckets form subdirectories of tables
  • Actual data stored in flat files
– Control char-delimited text, or SequenceFiles
– With custom SerDe, can use arbitrary format

Comments

Post a Comment

Thanks for your message. We will get back you.

Popular posts from this blog

7 AWS Interview Questions asked in Infosys, TCS

-
Image
Here are seven amazing Infosys AWS interview questions for your quick reference. These are also asked in TCS. Infosys and TCS AWS interview questions 1). What is AWS? Amazon Web Services (AWS) provides on-demand computing resources and services in the cloud, with pay-as-you-go pricing. For example, you can run a server on AWS that you can log on to, configure, secure, and run just as you would a server that's sitting in front of you 2). What you can do with AWS? Store public or private data. Host a static website. These websites use client-side technologies (such as HTML, CSS, and JavaScript) to display content that doesn't change frequently. A static website doesn't require server-side technologies (such as PHP and ASP.NET). Host a dynamic website or web app. These websites include classic three-tier applications, with web, application, and database tiers. Support students or online training programs. Process business and scientific data. Handle peak loads. AWS Quest
Read more

How to Decode TLV Quickly

-
Image
TLV format contains three parts Tag, Length, and value. In a credit card or financial transactions, the TLV protocol supports this format. Below, you will find the ideas to decode TLV data quickly.  According to IBM , the tag tells what type of data it is. The length field denotes the length of the value. The value-field denotes the actual value. Structure of TLV. TLV comprises three field values. Tag Length Value How to Decode TLV The EMV labs developed tags which in turn part of EMV protocol. Each tag has an unique meaning. And the Tag and Length together takes 1 to 4 bytes of memory. 1. The Best example for TLV. Below is the way to decode the EMV tag. The first part of the TLV format is TAG. The second part is LENGTH, and finally the VALUE. Syntax of EMV tag: [Tag][Value Length][Value] (ex. " 9F40 05 F000F0A001 ") where,  Tag Name =  9F40 Value Length (in bytes) =  05  Value (Hex representation of bytes. Example, "F0" – 1-byte) =  F000F0A001 Finally, what is 9F40
Read more

Hyperledger Fabric: 20 Real Interview Questions

-
Image
Hyperledger is one of the top-listed blockchains. This architecture follows R3 Corda specifications. Sharing the interview questions with you that I have prepared for my interview. Though Ethereum leads in real-time applications. The latest Hyperledger version is now ready for production applications. It has now become stable for production applications. The Hyperledger is now backed by IBM. But, it is still an open source. These interview questions help you to read quickly. The below set of interview questions helps you like a tutorial on Hyperledger fabric. Hyperledger Fabric Interview Questions 1). What are Nodes? In Hyperledger the communication entities are called Nodes. 2). What are the three different types of Nodes? - Client Node - Peer Node - Order Node The Client node initiates transactions. The peer node commits the transaction. The order node guarantees delivery. 3). What is Channel? A channel in Hyperledger is the subnet of the main blockchain. You can ha
Read more