Featured Post

How to Check Column Nulls and Replace: Pandas

-
Image
Here is a post that shows how to count Nulls and replace them with the value you want in the Pandas Dataframe. We have explained the process in two steps - Counting and Replacing the Null values. Count null values (column-wise) in Pandas ## count null values column-wise null_counts = df.isnull(). sum() print(null_counts) ``` Output: ``` Column1    1 Column2    1 Column3    5 dtype: int64 ``` In the above code, we first create a sample Pandas DataFrame `df` with some null values. Then, we use the `isnull()` function to create a DataFrame of the same shape as `df`, where each element is a boolean value indicating whether that element is null or not. Finally, we use the `sum()` function to count the number of null values in each column of the resulting DataFrame. The output shows the count of null values column-wise. to count null values column-wise: ``` df.isnull().sum() ``` ##Code snippet to count null values row-wise: ``` df.isnull().sum(axis=1) ``` In the above code, `df` is the Panda
Post a Comment

IoT Architecture for very new developers: part 1 of 6

-
What is the architecture of internet of things-The three-layer DCM classification is more about the IoT value chain than its system architecture at run time.

 I hope you enjoyed with my previous post-5 on IOT.

 For system architecture, some have divided the IoT system into as many as nine layers, from bottom to top:
  • devices
  • connectivity
  • data collection
  • communication
  • device management.
  • data rules
  • administration
  • applications
  • integration
While large companies such as IBM, Oracle, Microsoft, and others have comprehensive solutions, products, and services that cover almost the entire value chain.
Recommendation for you:  Part-2 | Part-1

 Broadly IOT architecture can be classified as three layers:
  • Device Layer
  • Communication Layer
  • Mangement Layer
Device Layer: Devices or assets can be categorized as two groups: those that have inherent intelligence such as electric meters or heating, ventilation, and air-conditioning (HVAC) controllers, and those that are inert and must be enabled to become smart devices (e.g., RFID tagged) such as furniture or animals that can be electronically tracked and monitored—things that "talk."

 Communication Layer: The communications layer is the foundational infrastructure of IoT. There are two major communication technologies: wireless and wired (or wireline). Each category has broadband and narrowband, packet and circuit switched, as well as short-range and long-range communications. The penetration and traffic of U.S. wireless data subscribers in 2013 will reach the same level of broadband wired household usage in 2008.

 The mobile Internet is catching up quickly, thanks to the development of the Internet of Things and the flexibility of wireless communications.

 Management Layer: This is the are where mining of data carried out to get business intelligence ideas
  • In the current customer-driven, technology-based environment, it is no longer enough to offer a service or product and expect it to satisfy your customers. Even if you have the best customer service in the industry, you have to be able to extend out your offerings to meet current demand to keep the customers satisfied. 
  • The Internet of Things brings enormous possibilities and potentials for creating new business value and generating new revenue ecosystems with data processing and managing rules that combine intelligence from remote assets unreachable before with your intelligent enterprise systems.
  • Examples: Disruptive applications beyond current imagination will appear. Smart grid, connected car, fleet control, mobile surveillance, and remote monitoring are listed as the top five disruptive applications out of a total of 65 identified, according to reports from the Boston Consulting Group.
All of the top five are IoT applications. For example, with the wide use of telematics, things like total vehicle life cycle management, refined used car price estimate, Pay as You Drive insurance policy, neighbor-to-neighbor car-sharing business such as those provided by startup RelayRides become possible, and the list goes on and on.

Comments

Post a Comment

Thanks for your message. We will get back you.

Popular posts from this blog

Explained Ideal Structure of Python Class

-
Image
When you are designing a class, you need to ensure that the classification of its critical parts is outlined at the beginning. The clearer the initial design, the more performant and scalable the class is. Some of the components in the order in which they should be defined in the class are mentioned as follows. Ideal structure of a class Class variables Constants or default variables are usually defined at the top of the class. For someone who is reading the code, it comes as an easy-to-view consolidated list, and for the interpreter it ensures that all such variables are processed before diving into the main logic of the class, including any other Instance method or constructor. The __init__ method The __init__ method provides information about inputs needed and how to instantiate the class. It is also the constructor of the class, which the very first method called while initializing the class . Special Python methods These methods change the functionality of the class or provide add
Read more

How to Check Kafka Available Brokers

-
Image
Here's the command to check the list of brokers present in a Kafka Cluster. You can say the Broker is the heart of the Kafka cluster. In simple terms, it works as a process. The main function is to receive messages from publishers and gives permission to access messages by consumers. How to Check Available Brokers in Kafka Here is the command: linux$  ./zookeeper-shell.sh zookeeper-IPaddress:2181 | "ls /brokers/ids" Just use the above command to get the number of brokers present in your host (Kafka Cluster). What is Default Broker-id in Kafka  The default broker id is -1 . When you create a new broker, it adds to -1. Then, it gives a new broker id. The broker ids will be generated from  reserved.broker.max.id + 1. Types of broker ids. Use assigned Zookeeper generated broker id. According to Wiki: Kafka runs on a cluster of one or more servers (called brokers), and the partitions of all topics are distributed across the cluster nodes.  Additionally, partitions are replicat
Read more

6 Python file Methods Real Usage

-
Image
Files always have data in them. For different purposes, you need methods to deal with them. These six file methods of use in this case. Related:  5 top file modes in python. Python file methods Below are the top six file methods in python: Tell() Seek() Flush() Fileno() truncate() isatty() 1. tell() The usage of tell method is it  returns the cursor-position of the file-pointer from the beginning of the file. It tells the current cursor position. The position starts from zero, which is same as of an index. Syntax:  fileobject.tell() 2. seek() The usage of seek  method is cursor position, from one position to the specified position from the beginning of the file, it moves. Here, the cursor will be sought to a particular location. Syntax:  fileobject.seek(position) 3. flush() The usage of flush  method is clean out the internal buffer. Before writing the text in the file, it is best practice to clear out that the internal buffer can be cleared. Syntax:  fileobject.flush() 4. fileno() The
Read more