Featured Post

Scraping Website: How to Write a Script in Python

Image
Here's a python script that you can use as a model to scrape a website. Python script The below logic uses BeautifulSoup Package for web scraping. import requests from bs4 import BeautifulSoup url = 'https://www.example.com' response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') # Print the title of the webpage print(soup.title.text) # Print all the links in the webpage for link in soup.find_all('a'):     print(link.get('href')) In this script, we first import the Requests and Beautiful Soup libraries. We then define the URL we want to scrape and use the Requests library to send a GET request to that URL. We then pass the response text to Beautiful Soup to parse the HTML contents of the webpage. We then use Beautiful Soup to extract the title of the webpage and print it to the console. We also use a for loop to find all the links in the webpage and print their href attributes to the console. This is just a basic example, but

Big Data:Top Hadoop Interview Questions (2 of 5)

Frequently asked Hadoop interview questions.


1. What is Hadoop?Hadoop is a framework that allows users the power of distributed computing.

2.What is the difference between SQL and Hadoop?

SQL is allowed to work with structured data. But SQL is most suitable for legacy technologies. Hadoop is suitable for unstructured data. And, it is well suited for modern technologis.
Hadoop

3. What is Hadoop framework?

It is distributed network of commodity servers(A server can contain multiple clusters, and a cluster can have multiple nodes)

4. What are 4 properties of Hadoop?

Accessible-Hadoop runs on large clusters of commodity machinesRobust-An assumption that low commodity machines cause many machine failures. But it handles these tactfully. Scalable-Hadoop scales linearly to handle larger data by adding more nodes to the cluster. Simple-Hadoop allows users to quickly write efficient parallel code

5. What kind of data Hadoop needs?

Traditional RDBMS having relational structure with data resides in tables. In Hadoop. data should be in Key,Value pair.

6. Is Hadoop suitable for on the fly processing?

Hadoop is not suitable. It is suitable only for off-line processing. That means, we can not use Hadoop on active web logs. We can use it on web logs data,which already generated. So, in this property Hadoop is matching to traditional data warehouses.

7. What is Map reduce?

Map reduce is a data processing model, which contain mappers, and reducers. It takes unstructred data as input, and create as Key,Value pairs for processing on Hadoop.

Comments

Popular posts from this blog

7 AWS Interview Questions asked in Infosys, TCS

How to Decode TLV Quickly