Featured Post

Scraping Website: How to Write a Script in Python

Image
Here's a python script that you can use as a model to scrape a website. Python script The below logic uses BeautifulSoup Package for web scraping. import requests from bs4 import BeautifulSoup url = 'https://www.example.com' response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') # Print the title of the webpage print(soup.title.text) # Print all the links in the webpage for link in soup.find_all('a'):     print(link.get('href')) In this script, we first import the Requests and Beautiful Soup libraries. We then define the URL we want to scrape and use the Requests library to send a GET request to that URL. We then pass the response text to Beautiful Soup to parse the HTML contents of the webpage. We then use Beautiful Soup to extract the title of the webpage and print it to the console. We also use a for loop to find all the links in the webpage and print their href attributes to the console. This is just a basic example, but

Data analysis report these are example queries to use on final data

Data analysis
ApplyAnalytics@twitter
The role of data analysis will come into picture, once you have cleaned and filter the raw unstructured data. The next stage is called analysis. Your success of data analysis project is based preparing highly informative final report.

Tip: 
What could you investigate with data

To prepare analysis report, you need to ask some intelligent questions. These are example questions you can use. Based on your questions, you  need to prepare SQL queries to get the desired report or dashboard from your final data or cleaned data. 

The report or dashboard should be such that it should improve client business.
Let us use some case study on world bank data, what are the questions come into mind:

  1.  How much (in USD) is spent on healthcare in total in each country? 
  2. How much (in USD) is spent per capita in each country?
  3.  In which country is the most spent per person?
  4.  In which country is the least spent? 
  5. What is the average for each continent?
  6. For the world?
  7. What is the relationship between public and private health expenditure in each country? 
  8. Where do citizens spend more (private expenditure)? 
  9. Where does the state spend more (public expenditure)?
  10.  Is there a relationship between expenditure on healthcare and average life expectancy? 
  11. Does it make any difference if the expenditure is public or private?  
Read more here

Comments

Popular posts from this blog

7 AWS Interview Questions asked in Infosys, TCS

How to Decode TLV Quickly