Posts

Showing posts with the label List duplicates

Featured Post

How to Read a CSV File from Amazon S3 Using Python (With Headers and Rows Displayed)

-
Image
  Introduction If you’re working with cloud data, especially on AWS, chances are you’ll encounter data stored in CSV files inside an Amazon S3 bucket . Whether you're building a data pipeline or a quick analysis tool, reading data directly from S3 in Python is a fast, reliable, and scalable way to get started. In this blog post, we’ll walk through: Setting up access to S3 Reading a CSV file using Python and Boto3 Displaying headers and rows Tips to handle larger datasets Let’s jump in! What You’ll Need An AWS account An S3 bucket with a CSV file uploaded AWS credentials (access key and secret key) Python 3.x installed boto3 and pandas libraries installed (you can install them via pip) pip install boto3 pandas Step-by-Step: Read CSV from S3 Let’s say your S3 bucket is named my-data-bucket , and your CSV file is sample-data/employees.csv . ✅ Step 1: Import Required Libraries import boto3 import pandas as pd from io import StringIO boto3 is...
Post a Comment
Read more

Python Delete Duplicates in List Faster Way

-
Image
Removing duplicates in List simplified using SET method. It's a simple method. Just you need SET and Print to remove duplicates. Removing duplicates is common in Data science projects. What is list A list is a collection of elements. The elements can be duplicates or non-duplicates. Today's task is to remove duplicate elements in the List. Faster way to remove list duplicates Create a List Use SET Print the result List with duplicates my_list = ['The', 'unanimous', 'Declaration', 'of', 'the', 'thirteen','united', 'States', 'of', 'America,', 'When', 'in', 'the', 'Course', 'of', 'human'] Apply set method >>> non_dupes = set(my_list) Print Final list >>> print(non_dupes) Here, if you observe, there are no duplicates. The duplicates are now removed. It displays only non-duplicate values.  Here 'the' is a duplicate value. That'...
1 comment
Read more