Featured Post

How to Check Column Nulls and Replace: Pandas

-
Image
Here is a post that shows how to count Nulls and replace them with the value you want in the Pandas Dataframe. We have explained the process in two steps - Counting and Replacing the Null values. Count null values (column-wise) in Pandas ## count null values column-wise null_counts = df.isnull(). sum() print(null_counts) ``` Output: ``` Column1    1 Column2    1 Column3    5 dtype: int64 ``` In the above code, we first create a sample Pandas DataFrame `df` with some null values. Then, we use the `isnull()` function to create a DataFrame of the same shape as `df`, where each element is a boolean value indicating whether that element is null or not. Finally, we use the `sum()` function to count the number of null values in each column of the resulting DataFrame. The output shows the count of null values column-wise. to count null values column-wise: ``` df.isnull().sum() ``` ##Code snippet to count null values row-wise: ``` df.isnull().sum(axis=1) ``` In the above code, `df` is the Panda
Post a Comment

How to Use Chaid Useful for Data Science Developers

-
CHAID

The Chaid is one of the most asked skills for Data Science engineers. The CHAID Analysis (Chi-Square Automatic Interaction Detection) is a form of analysis that determines how variables best combine to explain the outcome in a given dependent variable.

Chaid Model


  • The model can be used in cases of market penetration, predicting and interpreting responses, or a multitude of other research problems.

  • CHAID analysis is especially useful for data expressing categorized values instead of continuous values.

  • For this kind of data, some common statistical tools such as regression are not applicable and CHAID analysis is a perfect tool to discover the relationship between variables. 

  • One of the outstanding advantages of CHAID analysis is that it can visualize the relationship between the target (dependent) variable and the related factors with a tree


1. CHAID Analysis for Surveys


Analysis

  • Most survey answers have categorized values instead of continuous values. 

  • Finding out the statistical relationship in this kind of data is a challenge. 



2. CHAID Analysis for Customer Profiling


Profiling


  • Based on historical customer data, CHAID Analysis can be used to analyze all characteristics within the file. 

  • For example, product/service purchased, the dollar amount spent, major demographics, and demography of the customers, and so on. 

  • A blueprint can be produced to provide an understanding of the customer profile: strong or weak sales of products/services; active or inactive customers; factors affecting customers’ decisions or preferences, and so on. 

  • Such a customer profile will give the Sales & Marketing Team a clear picture of which type of person is most likely to buy the products and services based on factual purchase history, geo-demographics, and lifestyle attributes.


3. CHAID Analysis for Customer Targeting


Customer Targetting


  • Recruiting new customers via direct contact (phone or mail) is a time-consuming and costly effort.

  • For most products or services, the hit rate is less than 1%. That means, in order to get a new customer, over one hundred contacts are required.

  • By mapping the current customer list to a general population database (e.g., SMR Residential Database that contains 12 million listed households), CHAID Analysis can find the household clusters that have much higher incidence rates than the average.

  • By concentrating on these household clusters, the actual hit rate can be dramatically raised. The result is “Fewer phone calls or mail pieces with higher sales returns!”.

Comments

Post a Comment

Thanks for your message. We will get back you.

Popular posts from this blog

Explained Ideal Structure of Python Class

-
Image
When you are designing a class, you need to ensure that the classification of its critical parts is outlined at the beginning. The clearer the initial design, the more performant and scalable the class is. Some of the components in the order in which they should be defined in the class are mentioned as follows. Ideal structure of a class Class variables Constants or default variables are usually defined at the top of the class. For someone who is reading the code, it comes as an easy-to-view consolidated list, and for the interpreter it ensures that all such variables are processed before diving into the main logic of the class, including any other Instance method or constructor. The __init__ method The __init__ method provides information about inputs needed and how to instantiate the class. It is also the constructor of the class, which the very first method called while initializing the class . Special Python methods These methods change the functionality of the class or provide add
Read more

How to Check Kafka Available Brokers

-
Image
Here's the command to check the list of brokers present in a Kafka Cluster. You can say the Broker is the heart of the Kafka cluster. In simple terms, it works as a process. The main function is to receive messages from publishers and gives permission to access messages by consumers. How to Check Available Brokers in Kafka Here is the command: linux$  ./zookeeper-shell.sh zookeeper-IPaddress:2181 | "ls /brokers/ids" Just use the above command to get the number of brokers present in your host (Kafka Cluster). What is Default Broker-id in Kafka  The default broker id is -1 . When you create a new broker, it adds to -1. Then, it gives a new broker id. The broker ids will be generated from  reserved.broker.max.id + 1. Types of broker ids. Use assigned Zookeeper generated broker id. According to Wiki: Kafka runs on a cluster of one or more servers (called brokers), and the partitions of all topics are distributed across the cluster nodes.  Additionally, partitions are replicat
Read more

6 Python file Methods Real Usage

-
Image
Files always have data in them. For different purposes, you need methods to deal with them. These six file methods of use in this case. Related:  5 top file modes in python. Python file methods Below are the top six file methods in python: Tell() Seek() Flush() Fileno() truncate() isatty() 1. tell() The usage of tell method is it  returns the cursor-position of the file-pointer from the beginning of the file. It tells the current cursor position. The position starts from zero, which is same as of an index. Syntax:  fileobject.tell() 2. seek() The usage of seek  method is cursor position, from one position to the specified position from the beginning of the file, it moves. Here, the cursor will be sought to a particular location. Syntax:  fileobject.seek(position) 3. flush() The usage of flush  method is clean out the internal buffer. Before writing the text in the file, it is best practice to clear out that the internal buffer can be cleared. Syntax:  fileobject.flush() 4. fileno() The
Read more