In the previous article, we saw how Pega can consume messages from an external Kafka server. It is recommended to visit the Kafka articles in order for a better understanding. https://myknowtech.com/tag/kafka In this article, we will see how Pega can produce Kafka messages to an external Kafka server. This tutorial is implemented using Pega personal […]
Kafka – Part 7 – Pega Consumes the External Kafka Messages
In the previous blog article, we saw how we can make a connection between Pega and an external Kafka server. It is recommended to visit the Kafka articles in order for a better understanding. https://myknowtech.com/tag/kafka In this blog article, we will see how Pega can consume the Kafka messages published in the external Kafka server. […]
Kafka – Part 6 – Configure Kafka Server instance in Pega
In another blog article on queue processor, we saw that Pega internally has its native Kafka server to perform stream processing. It is recommended to visit the Kafka articles in order for better understanding. https://myknowtech.com/tag/kafka In this blog article, we will see how Pega can make a connection to an external Kafka server. This tutorial […]
Kafka – Part 5 – Data flows in Pega
In this blog article, we will make use of data sets we created in the previous post and we will also verify how data flows can be used in Pega to process source data. This tutorial is implemented using Pega personal edition 8.4, but the core concepts remain the same in higher versions as well […]
Kafka – Part 4 – Data sets in Pega
In this blog article, we will see some basics about data set rule using YouTube as the data source. This tutorial is implemented using Pega personal edition 8.4, but the core concepts remain the same in higher versions as well It is recommended to go through previous blog articles on Kafka fundamentals before proceeding here. […]
Kafka – Part 3 – Stream service in Pega
In this blog article, we will see how Pega uses Kafka internally to process streams of data and also an overview of streams service. This tutorial is implemented using Pega personal edition 8.4, but the core concepts remain the same in higher versions as well It is recommended to go through previous blog articles on […]
Kafka – Part 2 – Server Setup and CLI tutorial
In this blog article, we will set up Kafka in Windows and start producers and consumers using CLI. We will also see how the messages get consumed. It is recommended to go through previous blog article on Kafka fundamentals before proceeding here. Let’s straightaway start downloading the binaries. Step 1: Make sure you have Java […]
Kafka – Part 1 – Fundamentals
Welcome to the first article on Kafka series. Here we will talk some theory concepts on Kafka fundamentals. What is Kafka? Kafka is a distributed streaming platform. Stream here refers to stream of data. Imagine an organization has around 3 source systems and 4 target systems. Each system needs to communicate with each other to […]