Posts

Showing posts with the label internet-of-things

Featured Post

8 Ways to Optimize AWS Glue Jobs in a Nutshell

Image
  Improving the performance of AWS Glue jobs involves several strategies that target different aspects of the ETL (Extract, Transform, Load) process. Here are some key practices. 1. Optimize Job Scripts Partitioning : Ensure your data is properly partitioned. Partitioning divides your data into manageable chunks, allowing parallel processing and reducing the amount of data scanned. Filtering : Apply pushdown predicates to filter data early in the ETL process, reducing the amount of data processed downstream. Compression : Use compressed file formats (e.g., Parquet, ORC) for your data sources and sinks. These formats not only reduce storage costs but also improve I/O performance. Optimize Transformations : Minimize the number of transformations and actions in your script. Combine transformations where possible and use DataFrame APIs which are optimized for performance. 2. Use Appropriate Data Formats Parquet and ORC : These columnar formats are efficient for storage and querying, signif

IoT real concept for auto insurance

Image
IoT in insurance is a connected car which helps transforming how insurance premiums can be calculated. With the help of a small wireless device that plugs into the diagnostic port, Metromile offers a “per-mile” usage-based insurance. Often, low-mileage drivers overpay for insurance because they’re subsidizing those who drive the most. Insurance Calculation But since the number one risk indicator for drivers is time on the road, Metromile can offer insurance pro-rata by tracking the miles driven. #Mile-based insurance an application of IoT: According to wiki: Usage-based insurance (UBI) -also known as pay as you drive (PAYD) and pay how you drive (PHYD) and mile-based auto insurance   is a type of vehicle insurance whereby the costs are dependent upon the type of vehicle used, measured against time, distance, behavior, and place. This differs from traditional insurance, which attempts to differentiate and reward "safe" drivers, giving them lower premiums and/or a

Protocols: Top 6 Key Parts

Image
In telecommunications, a protocol is a system of rules that allow two or more entities of a communications system to transmit information. The medium can be any kind of entity.

IoT Architecture for very new developers: part 1 of 6

What is the architecture of internet of things -The three-layer DCM classification is more about the IoT value chain than its system architecture at run time. I hope you enjoyed with my previous  post-5  on IOT. For system architecture, some have divided the IoT system into as many as nine layers, from bottom to top: devices connectivity data collection communication device management. data rules administration applications integration While large companies such as IBM, Oracle, Microsoft, and others have comprehensive solutions, products, and services that cover almost the entire value chain. Recommendation for you:     Part-2  |  Part-1 Broadly IOT architecture can be classified as three layers: Device Layer Communication Layer Mangement Layer Device Layer: Devices or assets can be categorized as two groups: those that have inherent intelligence such as electric meters or heating, ventilation, and air-conditioning (HVAC) controllers, and those tha