Featured Post

Scraping Website: How to Write a Script in Python

Image
Here's a python script that you can use as a model to scrape a website. Python script The below logic uses BeautifulSoup Package for web scraping. import requests from bs4 import BeautifulSoup url = 'https://www.example.com' response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') # Print the title of the webpage print(soup.title.text) # Print all the links in the webpage for link in soup.find_all('a'):     print(link.get('href')) In this script, we first import the Requests and Beautiful Soup libraries. We then define the URL we want to scrape and use the Requests library to send a GET request to that URL. We then pass the response text to Beautiful Soup to parse the HTML contents of the webpage. We then use Beautiful Soup to extract the title of the webpage and print it to the console. We also use a for loop to find all the links in the webpage and print their href attributes to the console. This is just a basic example, but

These Tips Helpful to Remove Python List and Dictionary Duplicates

In this post, I have shared top ideas to remove duplicates from the list. Those are with Append and Dictionary.


Python: How to Remove Duplicates From List

1. How to Remove Duplicates with Append

# Here is a list with duplicates

list_with_duplicates = [1,2,3,12,1,2,3,4,5,6,1,2,3,7,8,9]

It is simple if you follow the first-approach - brute force approach:

list_without_duplicates = []

for pd in list_with_duplicates:
  if pd not in list_without_duplicates:
      list_without_duplicates.append(pd)
print(list_without_duplicates)

Result:

[1, 2, 3, 12, 4, 5, 6, 7, 8, 9]

This method has performance issues when the list is bigger in size. 

Real-time.

Idea 1:  Remove Duplicates Using Append.



2. How to Remove Duplicates with Dictionary


# Here is you can convert a list to a dictionary

dict_without_duplicates = dict(zip(list_with_duplicates, list_with_duplicates))
print(dictionary_without_duplicates)

Result:

{1: 1, 2: 2, 3: 3, 12: 12, 4: 4, 5: 5, 6: 6, 7: 7, 8: 8, 9: 9}


Real-time.

Idea 2: Remove Duplicates Using Dictionary.


Once again, this works and has the advantage of taking less space than duplicating the entire list. 


Notes: Of course, we still need to convert it back to a list when we did, which will be somewhat painful since we must extract the keys and add them to a list.

Comments

Popular posts from this blog

7 AWS Interview Questions asked in Infosys, TCS

How to Decode TLV Quickly