Featured Post

Scraping Website: How to Write a Script in Python

Image
Here's a python script that you can use as a model to scrape a website. Python script The below logic uses BeautifulSoup Package for web scraping. import requests from bs4 import BeautifulSoup url = 'https://www.example.com' response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') # Print the title of the webpage print(soup.title.text) # Print all the links in the webpage for link in soup.find_all('a'):     print(link.get('href')) In this script, we first import the Requests and Beautiful Soup libraries. We then define the URL we want to scrape and use the Requests library to send a GET request to that URL. We then pass the response text to Beautiful Soup to parse the HTML contents of the webpage. We then use Beautiful Soup to extract the title of the webpage and print it to the console. We also use a for loop to find all the links in the webpage and print their href attributes to the console. This is just a basic example, but

5 Essential IT Skills for Data Engineers

Data engineers need the following skills. These skills help you get nice job in any analytics company.
Data engineer skills
Photo Credit: Srini

Five Top Skills Need

Skill-1

Experience working with big data tools such as MapReduce, Pig, Spark, Kafka and NoSQL data stores such as MongoDB, Cassandra, HBase, etc.

Skill-2

Expertise in multi-structured data modeling, reporting on NoSQL & structured database technologies such as HBase and Cassandra, SQL.

Skill-3

Experience with languages such as Python, Perl, Ruby, Java, Scala, R etc.

Skill-4

Strong data & visual presentation skills and ability to explain insights using tools like tableau, D3 charts or other tools.

Skill-5

Basic knowledge and experience of statistical analysis tools such as R.

Comments

Popular posts from this blog

7 AWS Interview Questions asked in Infosys, TCS

How to Decode TLV Quickly