Posts

Showing posts with the label Data Quality

HBASE Vs. RDBMS Top Differences You can Unlock Now

Image
HBASE in the Big data context has a lot of benefits over RDBMS. The listed differences below make you understandable why HBASE is popular in Hadoop (or Bigdata) platform. Let us check one by one quickly. HBASE Vs. RDBMS Differences Random Accessing HBase handles a large amount of data that is store in a distributed manner in the column-oriented format while RDBMS is systematic storage of a database that cannot support a random manner for accessing the database. Database Rules RDBMS strictly follow Codd's 12 rules with fixed schemas and row-oriented manner of database and also follow ACID properties. HBase follows BASE properties and implement complex queries. Secondary indexes, complex inner and outer joins, count, sum, sort, group, and data of page and table can easily be accessible by RDBMS. Storage From small to medium storage application there is the use of RDBMS that provide the solution with MySQL and PostgreSQL whose size increase with concurrency and performance.  Codd'

Understand Data power why quality everyone wants

Information and data quality is new service work for data intense companies. I have seen not only in Analytics projects but in Mainframe projects, there is the Data Quality team. How incorrect data impact on us Information quality problems and their impact are all around us: A customer does not receive an order because of incorrect shipping information. Products are sold below cost because of wrong discount rates. A manufacturing line is stopped because parts were not ordered—the result of inaccurate inventory information. A well-known U.S. senator is stopped at an airport (twice) because his name is on a government "Do not fly" list. Many communities cannot run an election with results that people trust. Financial reform has created new legislation such as Sarbanes—Oxley.  Incorrect data leads to many problems. The role of Data Science is to use quality data for effective decisions. What is information Information is not simply data, strings of numbers, lis

Poor Data Quality New Job Roles in Data Quality

Image
Data quality is on rising and important to organizations today. Since in Experian research it has found that poor data quality causing losses to the companies. Experian research suggests companies in the UK, the US, Australia, and western Europe have poorer quality data this year than last. The credit information company’s 2015 Global Data Quality Research among 1,239 organizations found a dramatic lack of data quality “ownership”, and 29% of respondents were still cleaning their data by hand. The number of organizations that suspect inaccurate data has jumped from 86% in 2014 to 92%. Also, respondents reckoned 26% of their data to be wrong, up from 22% in 2014 and 17% in 2013. Some 23% of respondents said this meant lost sales, up from 19% in 2013. Boris Huard, managing director of Experian Data Quality, said: “Getting your data strategy right is vital if you want to be successful in this consumer-driven, digitalized age.  It is encouraging that companies are increasing