Posts

Showing posts with the label Kafka Performance

Featured Post

How to Compare Text in Python

Image
Python like other programming languages supports comparison operators. These primarily use to test the condition in the program. Here's a list of operators that you can use in python programs. Comparison operators List of operators < <= > >= == != Is is not How to use comparison operators Here, I have assigned 23 to a and 11 to b. Then, I did apply all the comparison operators. The output is self-explanatory, and If you are in doubt while programming, remember to visit this page. Examples a = 23 b = 11 print("Is a greater than b?", a > b)           #greater than print("Is a less than b?", a < b)              #less than print("Is a greater or equal to b?", a >= b)   #greater or equal print("Is a less or equal to b?", a <= b)      #less or equal print("Is a equal to b (option 1)?", a == b)         #test for equality print("Is a equal to b (option 2)?", a is b)         #test for equality print("I

How to Monitor Kafka-stream's Performance

Image
Kafka Streams API is a part of Kafka, it goes without saying that monitoring your application will require some monitoring of Kafka as well. Performance The consumer and producer performance is one of the fundamental performance concerns for a producer and consumer.   The Kafka data flow diagram What is lag For producers, we care mostly about how fast the producer is sending messages to the broker. Obviously, the higher the throughput, the better. For consumers, we’re also concerned with performance, or how fast we can read messages from a broker. we care about how much and how fast our producers can publish to a broker, and we simultaneously care about how quickly our consumers can read those messages from the broker. The difference between how fast the producers place records on the broker and when consumers read those messages is called consumer lag How to check consumer lag To check for consumer lag, Kafka provides a convenient command-line tool, kafka-consumer-groups.sh, found in