Posts

Showing posts with the label Terminology

Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

-
Image
  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif
Post a Comment
Read more

9 Top Git Terms You Should have Read By now

-
Image
GIT is version control system. That means it manages your code versions. However, I have given here most frequently asked terms in interviews. 1. Git Vs GitHub This is the first question you ( even me also) might confuse about. Git is the version control system. Whereas  GitHub is a repository framework . Also, you can say GitHub is Git hosting service. 2. What is Branch Git is a lightweight version control system. In simple terms, a Branch is a separate line of development. You can have any number of branches in Git. 3. What is Topic Each branch in Git refers to a particular purpose. So the topic tells about the purpose. 4. Clone In easy terms, the Clone means copying an existing repository. So you can say it is just a copy of the existing repository. 5. What is Push You can say Push means updating the existing repository. In other words, developers push their changes to a repository that you set up. 6. Merge Merge unifies two or more commit history branches. That means it merges two
Post a Comment
Read more

The Essential Guide to Blockchain Terminology

-
Image
Bitcoin was the first project developed by using blockchain. My post is to share Blockchain keywords by using an example of Bitcoin. Let us ready... Blockchain is new technology. Understanding its principles makes you helpful to apply in your projects.  Initially, the purpose of  Blockchain development was to carry mining. In general, mining means search and find value. Usually, mining processes are two types. Those are data mining and bitcoin mining . Blockchain Glossary Blockchain - only blocks involved. The data which was finalized stored in blocks. Bitcoin Ledger - It is a public ledger Ledger or Blockchain - The chain of blocks Functions of Blockchain - It validates each transaction, Keeps track, and verifies ownership Double Spending- It prevents duplicating the Cryptocurrency for using next time. Consensus mechanism - It is also called PoW (proof of work). This mechanism avoids double-spending Group of Transactions - When a new group of transactions created, t
Post a Comment
Read more

13 Cloud Computing Terminology Quick Read

-
Image
Cloud computing is a big ocean. Due to increased services, a developer must know the glossary ( keywords) involved. 1) AWS Amazon Web services 2) Content delivery network (CDN) It is a distributed system. Servers are located in remote locations. Customers feel that they are accessing the servers. 3) Cloud A global network to access the resources. 4) Cloud portability The feature to move data from one Cloud provider to another provider. 5)  Cloudsourcing Moving traditional IT operations to Cloud computing. 6) Cloud storage It is a service providing to users to store data using the internet or other private networks. 7) Cloudware It is Software that helps to run user applications in cloud computing. Terminology 8) Cluster A group of small computers connected together to form a Single big computer. High availability and load balancing are the main benefits. 9) Consumer cloud The cloud provider offers services to individual users. You can call it a consumer cloud. 10) Consumption-bas
Post a Comment
Read more