Kafka pipeline in SingleStore isuue

When we are creating Kafka pipeline in SingleStore we are getting the following error message. please help us

Error message

  • CREATE PIPELINE abcd AS LOAD DATA KAFKA ‘XXXXXXXXXXXx"/XXXXX’ skip constraint errors INTO table kafka_gup_t
    ERROR 1933 ER_EXTRACTOR_EXTRACTOR_GET_LATEST_OFFSETS: Cannot get source metadata for pipeline. Failed to get watermark offsets from Kafka with error Broker: Leader not available.

  • ERROR 1934 ER_EXTRACTOR_EXTRACTOR_EXTRACT: Leaf Error (ip-10-45-76-188.ec2.internal:3306): Cannot extract data for pipeline. Could not stream message (Are the Kafka brokers reachable from this node?)

Note: We were able to telnet and connect

Hello arunrampillai ! :wave:
I’m sorry this error is getting in the way of your productivity. I’m working on getting an expert to address this issue. Thank you for your patience.
In the meantime, can you let me know if you are on a managed or self-hosted service & what version number you’re running?

Hello Arunrampillai,

Thank you for reaching out. Is this for the self managed deployments or the cloud deployment?

Regards,
Manish Kumar

1 Like