Posted on

Spring Cloud Stream With Kafka

Introduction

Spring Cloud Stream, is a mechanism by which you can decouple the implementation of your producers and consumers from the type of messaging infrastructure you want to use. This allows us to keep our consumers and producers to be broker agnostic and we can easily switch to a different kind of broker by changing the binder implementation. 

There are quite many binder implementations like e.g Kafka, RabbitMQ, AWS SNS, AWS SQS, etc. You can find a list of available binder implementations here.

Posted on

Spring Boot With Kafka Communication

In this article, we will be looking into how we can publish and subscribe to a Kafka topic. 

Introduction

Kafka over the years has gained a lot in popularity for its high throughput and real-time asynchronous messaging. It's considered a de facto standard for streaming of events and provides fault-tolerant storage that is stable, reliable, and scalable.

Posted on

Is Kafka the Next Big Thing in the Banking and Financial Sector?

Nowadays, businesses are seeking innovative methods to digitally transform themselves by utilizing key technologies to promote business intelligence and increase profitability. The terms "insights" and "data" carry much significance and are a crucial aspect to enhancing the customer experience. Technologies, such as Kafka, benefit organizations across industries in manifold methods.

With its real-time streaming data architecture and real-time analytics feature, Kafka is certainly the talk of the town. According to recent statistics, over one-third of Fortune 500 companies have leveraged Kafka.

Posted on

A Quick and Practical Example of Kafka Testing

1. Introduction

In this tutorial, we will quickly explore some basic to high-level approaches for testing microservices applications built using Kafka. Also, we will learn about the advantages of the declarative way of testing Kafka applications over the traditional/existing way of testing.

For everything explained here, you can find a running code example in the "Conclusion" section of this post.

Posted on

Apache Kafka Topics: Architecture and Partitions

What Is a Kafka Topic?

A Kafka topic is essentially a named stream of records. Kafka stores topics in logs. However, a topic log in Apache Kafka is broken up into several partitions. And, further, Kafka spreads those log’s partitions across multiple servers or disks. In other words, we can say a topic in Kafka is a category, stream name, or a feed.

In addition, we can say topics in Apache Kafka are a pub-sub style of messaging. Moreover, there can be zero to many subscribers called Kafka consumer groups in a Kafka topic. Basically, these topics in Kafka are broken up into partitions for speed, scalability, as well as size.