Posts

Showing posts with the label Agile Methodology

Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

-
Image
  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif
Post a Comment
Read more

5 Best Features and Development Model for Agile

-
Image
In Agile development model each sprint has phases of requirements, design, development and testing. In the development phase, development team concentrates on new features to be developed and unit testing around it. But it misses on the regression of existing working functionality. This leads to defect seepage from Development phase to Test phase. Consequence of it is late defect identification, reporting, fixing and re-verification of the defect. This defect cycle continues till it is fixed. Drawback of Agile The drawback of this approach is project teams put in extra effort of identifying defects and reporting. Late identification of defects also leads to risk of schedule slippage. Here in this article is a mechanism proposed to minimize defect leakage from development phase to testing phase in agile software development life cycle by moving the regressed automated scripts from testing phase to development phase. Related: Agile+Developer+Jobs The advantages of this approac
Post a Comment
Read more

What is the meaning of Agile

-
Image
Agile Vs Scrum Agile is a time boxed, iterative approach to software delivery that builds software incrementally from the start of the project, instead of trying to deliver it all at once near the end. It works by breaking projects down into little bits of user functionality called  user stories , prioritizing them, and then continuously delivering them in short two week cycles called  iterations . Agile scales like any other software delivery process. Not that well . Look - scaling is hard. There is no easy way to magically coordinate, communicate, and keep large groups of people all moving in the same direction towards the same cause. It's hard work. The one thing Agile does bring to the conversation, is instead of looking for ways to scale up your project, look for ways to scale things down.
Post a Comment
Read more