I know there is a way to stream data out from Memsql to Kafka topic using
select ... into kafka, but I was wondering how the data produce stream is implemented.
I try to stream out the data from SingleStore using:
- 1 master aggregator
- 1 leaf in my cluster
- 5 partitions in my database where my table stored
- 5 partitions in my Kafka topic
- The data in the table stored in all the SingleStore partitions
I found out that all the rows from my query are sent to one Kafka partition.
Is there a way to distribute the result rows among all the Kafka topic partitions?