Posts

Showing posts with the label remove duplicates

5 HBase Vs. RDBMS Top Functional Differences

Image
Here're the differences between RDBMS and HBase. HBase in the Big data context has a lot of benefits over RDBMS. The listed differences below make it understandable why HBASE is popular in Hadoop (or Bigdata) platform.  5 HBase Vs. RDBMS Top Functional Differences Here're the differences unlock now. Random Accessing HBase handles a large amount of data that is store in a distributed manner in the column-oriented format while RDBMS is systematic storage of a database that cannot support a random manner for accessing the database. Database Rules RDBMS strictly follows Codd's 12 rules with fixed schemas and row-oriented manner of database and also follows ACID properties. HBase follows BASE properties and implements complex queries. Secondary indexes, complex inner and outer joins, count, sum, sort, group, and data of page and table can easily be accessible by RDBMS. Storage From small to medium storage application there is the use of RDBMS that provides the solution with MyS

Python: How to Remove Duplicates From the List

Image
In this post, I have shared top ideas to remove duplicates from the list. Those are with Append and Dictionary. 1. How to Remove Duplicates Using Append? # Here is a list with duplicates list_with_duplicates = [1,2,3,12,1,2,3,4,5,6,1,2,3,7,8,9] It is simple if you follow the first-approach - brute force approach: list_without_duplicates = [] for pd in list_with_duplicates:   if pd not in list_without_duplicates:       list_without_duplicates.append(pd) print(list_without_duplicates) Result: [1, 2, 3, 12, 4, 5, 6, 7, 8, 9] This method has performance issues when the list is bigger in size.  Real-time. 2. How to Remove Duplicates Using Dictionary? # Here is you can convert a list to a dictionary dict_without_duplicates = dict(zip(list_with_duplicates, list_with_duplicates)) print(dictionary_without_duplicates) Result: {1: 1, 2: 2, 3: 3, 12: 12, 4: 4, 5: 5, 6: 6, 7: 7, 8: 8, 9: 9} Real-time. Once again, this works and has the advantage of taking less space than duplicating the entire lis