Posts

Showing posts with the label key-value-database

Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

-
Image
  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif
Post a Comment
Read more

RDBMS Vs Key-value Four Top Differences

-
Image
This post tells you differences between rdbms and distributed key-value storage. Rdbms is quite  different from key-value storage. RDBMS (Relational Database) You have already used a  r elational  d atabase  m anagement  s ystem — a storage product that's commonly referred to as  RDBMS .  It is basically a structured data. RDBMS systems are fantastically useful to handle moderate data. The BIG challenge is in scaling beyond a single server.  You can't maintain redundant data in rdbms. All the data available on single server. The entire database runs on single server. So when server is down then database may not be available to normal business operations. Outages and server downs are common in this rdbms model of database. Key-Value Database Key-value storage systems often make use of redundancy within hardware resources to prevent outages. This concept is important when you're running thousands of servers because they're bound to suffer hardware bre
Post a Comment
Read more