Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif

9 Top Git Terms You Should have Read By now

9 Top Git Terms to Read now

GIT is version control system. That means it manages your code versions. However, I have given here most frequently asked terms in interviews.

1. Git Vs GitHub

This is the first question you ( even me also) might confuse about. Git is the version control system. Whereas GitHub is a repository framework. Also, you can say GitHub is Git hosting service.

2. What is Branch

Git is a lightweight version control system. In simple terms, a Branch is a separate line of development. You can have any number of branches in Git.

3. What is Topic

Each branch in Git refers to a particular purpose. So the topic tells about the purpose.

4. Clone

In easy terms, the Clone means copying an existing repository. So you can say it is just a copy of the existing repository.

5. What is Push

You can say Push means updating the existing repository. In other words, developers push their changes to a repository that you set up.

6. Merge

Merge unifies two or more commit history branches. That means it merges two or more committed branches.

7. What is Pull

Pull means fetch from and merge with another local branch.

8. Fetch

In simple words, it means, downloading the objects and refs (Hash id) from another repository.

9. Checkout

It is the scenario, if you want to work with another branch you need to issue checkout. So that you can work with the new branch. And you will not lose any information about the current branch.


  1. Useful Guide - How to work with Git 


Popular posts from this blog

How to Fix datetime Import Error in Python Quickly

How to Check Kafka Available Brokers

SQL Query: 3 Methods for Calculating Cumulative SUM