Book a consultation

Solace Protocols and APIs: MQTT, JMS, AMQP, REST and Kafka on One Broker

Solace Kafka Integration: Bridging, the Wireline Proxy and Connectors

Solace Kafka integration explained: in-broker Kafka bridging, the Kafka wireline proxy, and connectors, with when each fits and the software-broker limit.

Vladimir Romanov


Solace Kafka integration exists because most enterprises that buy an event broker already run Kafka, and the two do different jobs. Solace offers three mechanisms to connect them: Kafka bridging built into the event broker (a Kafka Receiver and a Kafka Sender), the open-source Kafka wireline proxy that lets Kafka clients talk to Solace directly, and connectors, meaning the Kafka Connect source and sink connectors or Solace Micro-Integrations for Kafka. The limit to know first: Solace documents in-broker bridging as supported “only on software event brokers, and not appliance event brokers” (Kafka bridging).

This page explains each mechanism, when it fits, and what goes wrong. It belongs under Solace protocols and APIs in the Solace cluster.

Why integrate Solace and Kafka at all

Kafka is a distributed log: consumers pull, retention is long, and replay into analytics and stream processing is the point. Solace routes events by hierarchical topic, pushes them to consumers over many protocols, and links brokers across sites into an event mesh. Solace’s own comparison recommends a hybrid in which Kafka handles log retention and analytics and Solace handles distribution (Solace vs Kafka). That is a vendor view, but it matches the pattern we see in plants: MQTT and operational events at the edge, Kafka in the data platform. The full comparison is on Solace vs Kafka.

Since IBM completed its acquisition of Confluent in March 2026, some buyers also want the integration layer to stay vendor-neutral, which is another reason to keep it explicit and documented.

The three Solace Kafka mechanisms

Three ways to connect a Solace event mesh and a Kafka cluster A Solace Event Broker sits on the left and a Kafka cluster on the right. Path one runs inside the broker: a Kafka Receiver pulls records from Kafka topics and publishes them to Solace topics, and a Kafka Sender takes messages from Solace queues and writes them to Kafka topics; this path is marked software brokers only. Path two shows unchanged Kafka clients connecting to the Kafka wireline proxy, which translates the Kafka protocol into SMF for the Solace broker. Kafka clients sit outside the cluster. Path three shows a separate connector process, either Kafka Connect source and sink connectors or a Solace Micro-Integration, moving events between the two systems. Solace Event Broker 1. Kafka bridging Receiver: Kafka to Solace topics Sender: Solace queues to Kafka software brokers only topics, queues, SMF MQTT, JMS, REST clients Kafka cluster partitioned topics long retention, replay stream processing 2. Wireline proxy Kafka protocol to SMF unchanged Kafka clients 3. Connector Kafka Connect or MI 1 runs inside the broker. 2 and 3 run as separate processes you deploy and monitor. MI: Solace Micro-Integration for Kafka, Confluent, Redpanda, Amazon MSK or Azure Event Hubs.
Bridging removes a component but ties you to the software broker. The proxy and the connectors work with any form factor at the cost of one more process to run.

1. Kafka bridging inside the broker

Bridging configures two objects on the broker, and “message flow is possible in both directions” (Kafka bridging):

  • Kafka Receiver reads records from one or more Kafka topics, converts them to SMF messages and publishes them to Solace topics. The Solace topic is built with substitution expressions, for example replacing Kafka’s . separators with / so plant1.line3.oee becomes plant1/line3/oee.
  • Kafka Sender takes messages from one or more Solace queues, converts them to Kafka records and sends them to Kafka topics. The Kafka topic is “a single fixed value per queue binding”.

Fits when you run software brokers and want no extra moving parts. Does not fit on appliances, and Solace Cloud support is not stated on the page we read.

2. The Kafka wireline proxy

The Kafka wireline proxy, introduced in September 2025, presents a Kafka broker facade and translates to SMF, so Kafka clients connect “without changing a single line of application code”. Solace lists key-based partitioning, schema registry, headers, three acknowledgement modes and consumer groups. It is open source in SolaceLabs and runs on Kubernetes, Docker or as a standalone JAR.

Fits when Kafka-native applications should publish into or consume from the Solace mesh directly, without a Kafka cluster in between.

3. Connectors and Micro-Integrations

The older route is the open-source Kafka Connect source and sink connectors, which run in a Kafka Connect cluster. The newer one is Solace Micro-Integrations, launched in December 2024 with targets including Apache Kafka, Confluent, Redpanda, Amazon MSK and Azure Event Hubs (launch release), available cloud-managed or self-managed.

Fits when the Kafka team already runs Kafka Connect, when you need a managed Kafka service as the target, or when the broker is an appliance.

Rushing river with green water and white foamy rapids flowing past rocks
Bridge only the streams you need: every topic sent to Kafka is retained and paid for there, so choose topics deliberately rather than mirroring everything.

Choosing a Solace Kafka mechanism

Kafka bridgingWireline proxyConnectors / Micro-Integrations
RunsInside the brokerSeparate processKafka Connect or Micro-Integration runtime
Broker form factorSoftware only (appliance excluded)Any, per its designAny
DirectionBothKafka clients into SolaceSource, sink or both
Application changeNoneKafka client configurationNone
Operated byBroker teamIntegration teamKafka or integration team
SupportProduct featureOpen source in SolaceLabs; askProduct (Micro-Integrations) or open source (Connect)

A rule of thumb. If you run software brokers, start with bridging. If you run appliances or a managed Kafka service, use Micro-Integrations. Use the proxy when the goal is to remove a Kafka cluster that only exists to feed Solace, and test it hard first. Event Portal can discover Kafka topics and consumer groups through its Event Management Agent, which helps decide what to bridge.

Designing a Solace Kafka bridge

Whichever mechanism you choose, the design questions are the same, and they are easier to answer before the first topic moves:

  1. List the consumers in Kafka, not the producers in the plant. Bridge the topics a named analytics or data team will use. Everything else stays in Solace, where it costs nothing to leave.
  2. Agree the topic and key mapping. Decide how Solace levels become Kafka topic names and which field becomes the Kafka record key, since the key drives partitioning and ordering downstream.
  3. Decide the direction per flow. Plant events usually go Solace to Kafka. Model results or setpoint recommendations may come back the other way, and those need the same governance as any write to a plant system.
  4. Size the buffer. The Kafka Sender reads from Solace queues, so a Kafka outage fills those queues. Set quotas and alerts that give the operations team hours, not minutes.
  5. Register the schemas. Payload formats should be documented on both sides. Solace’s Schema Registry and Event Portal, or the Kafka team’s registry, both work; having none does not.

An illustrative case. A manufacturer with six plants publishes line states, downtime reasons and quality results over MQTT into Solace brokers at each site, linked by an event mesh to a software broker in the corporate data centre. The data team wants a year of downtime history in Kafka for a reliability model. A Kafka Sender on the central broker reads one queue subscribed to */*/*/downtime/> and writes to a single Kafka topic, keyed by line. The plants never learn Kafka exists, and the data team never connects to a plant network. That separation is also a security boundary, which our OT network assessment work treats as seriously as the data flow.

Where it gets hard

  • Two delivery models. Kafka consumers track offsets; Solace acknowledges per message. Duplicates appear at the boundary after failures, so consumers must be idempotent.
  • Ordering. Kafka orders within a partition, Solace within a queue. Keep keys stable, and look at partitioned queues where ordering per key matters.
  • Topic naming. Dotted Kafka names and /-separated Solace levels need one agreed mapping.
  • Fixed Sender topics. One Kafka topic per queue binding means more bindings as topics multiply.
  • Monitoring two systems. Queue depth on the Solace side and consumer lag on the Kafka side describe the same backlog. Put both on one dashboard, or each team will blame the other.
  • Message size and rate. Check the limits on both sides for your largest payloads and peak bursts.

Related: Kafka vs MQTT for the concepts, the sibling Solace MQTT page, and the Solace hub.

Frequently asked questions

How do you connect Solace to Kafka?

There are three main ways. Kafka bridging configures a Kafka Receiver and Kafka Sender inside a software event broker. The open-source Kafka wireline proxy lets Kafka clients connect to Solace as if it were a Kafka broker. Connectors, either the Kafka Connect source and sink connectors or Solace Micro-Integrations, run as separate processes between the two. The right one depends on direction, form factor and who operates it.

Does Kafka bridging work on the Solace appliance?

No. Solace's Kafka bridging documentation states the feature is only supported on software event brokers, and not on appliance event brokers. The page does not say whether Solace Cloud services support it, so confirm that with Solace for your service class. On an appliance, use a connector, a Micro-Integration or the wireline proxy instead.

What is the Solace Kafka wireline proxy?

It is an open-source proxy, published in Solace's SolaceLabs GitHub organisation and introduced in September 2025, that speaks the Kafka protocol to clients and SMF to the Solace broker. Kafka producers and consumers connect with configuration changes only. Solace lists support for key-based partitioning, headers, consumer groups, acknowledgement modes and schema registry. Confirm its support status before production use.

Should I replace Kafka with Solace?

Usually not. Kafka is built as a durable, replayable log for analytics and stream processing; Solace is built for routing events across protocols, sites and clouds with broker-managed delivery. Solace itself recommends a hybrid in which each does its own job. Integration exists precisely so a plant can keep both, with Solace at the edge and Kafka in the data platform.

Can Solace Event Portal see my Kafka topics?

Yes. The Event Management Agent, the open-source discovery component of Event Portal, discovers Apache Kafka and Confluent topics, consumer groups and Confluent Schema Registry schemas. Solace lists tested versions including Kafka 3.9.1 and 4.1.0. That lets one catalogue describe events on both sides, which helps when deciding which topics to bridge.

References and further reading

  1. Kafka Bridging overview · SolaceKafka Receiver, Kafka Sender, topic mapping and the software-broker-only limit.
  2. Introducing Kafka Wireline Proxy for Solace · Solace
  3. kafka-client-proxy-to-solace · SolaceLabs on GitHub
  4. Solace Kafka Connect source connector · SolaceProducts on GitHub
  5. Apache Kafka documentation · Apache Software Foundation
  6. Solace vs Kafka · SolaceThe vendor's own comparison, including its hybrid recommendation.

← Protocols and APIs

Have a project that needs technical ownership?

Send us the situation. If it is not something we should take on, we will say so.