Posts

Showing posts with the label Array Types

Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

Image
  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif

How to Create an Array and Its Types in Python

Image
Python supports various array types. Here is a list of arrays and how to create examples for your reference.  What is an array? A  Python array  is a class that mimics the array type of other languages and offers efficiency in storage, exchanging that for flexibility. How to create an array Here is the syntax to create an array: data = array('f', [12.8, 5.4, 8.0, 8.0, 9.21, 3.14]) It creates an array of 6 floating point numbers; the type is indicated by the 'f' as the first parameter to the constructor. This concept is unlike the Python norm of types being dynamic and malleable. An array is an array of one kind of thing, and an array can only hold a restricted set of types. Types of arrays Here is a list of arrays: 'b' A C++ char type 'B' A C++ unsigned char type 'i': A C++ int type 'l': A C++ long type 'f': A C++ float type 'd': A C++ double type What is an array type? Arrays are class objects and are provided in the buil