## Posts

Showing posts with the label sum

### 8 Ways to Optimize AWS Glue Jobs in a Nutshell

Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif

# Python Tuple: Here're 2 Ways to Calculate Sum Easily

Python tuple is nothing but a set of data. It can have an 'n' number of elements. Here, in my example, the tuple has 20 Elements. The below logic helps you to calculate the sum of its 20 Elements easily.  A tuple is simply a set, and it can have both positive and negative Elements. So, don't worry. You can calculate the sum even the tuple has negative numbers. Here are 2 Ways You can calculate Sum Display sum after adding each element Display sum at once   Python Logic: #1 Method - The Print Displays Sum in Vertcle after Adding Each Element my_tuple = (1,20, -30, 50, 10, 11, 6, 7, 22, 88, 10, 20, 565, 121, 211, 5, 2, 18, 20, 21) sum = 0 for index in my_tuple:             sum = sum+ index          print("sum of elements:", sum) Note*** Here the print statement is within the For Loop. You May Also Like: How to Use For Loop  in Python Complete Tutorial Python Logic: #2 Method - The Print Displays Total Sum at once my_tuple = (1,20, -30, 50, 10, 11, 6, 7, 22, 88, 10