You create a new Apache Kafka event stream by providing the event stream's Topic, Consumer Group, Initial Position and Kafka Server. Afterwards you can then create a pipeline using relevant Connectors.
To add a Kafka event stream, follow these steps.
In a project select Home.
Click Kafka Event Stream.
In the New Kafka Event Stream, enter the following:
Topic: Name of category (feed) to which messages are published.
Consumer Group: Which Consumer Group to which Xapix should be subscribed.
Initial Position: Toggle between Earliest or Latest position for the initial offset of a Consumer.
Kafka Server: To add a new Kafka Server, click the + sign or select a Kafka Server from the dropdown.For a new Kafka Server, add the following:
Name: Name of server cluster on which Kafka is running.
Boot Servers: List of Kafka server addresses, separated by commas.
Save the new Kafka Server settings.
Click Create Stream to create a new Kafka Event Stream.
A new pipeline is created in the Pipeline dashboard.
After you have created the Kafka event stream, a basic pipeline appears with an Event unit. You can now build a pipeline as is done for REST endpoints.