Leaf Node went offline,How to restart and connect this node to the cluster

Help Connectors and Pipelines
1

Hi,
I am having 5 Nodes SS Cluster with 4 Nodes: Leaf and 1 Node:Aggregator.
Yesterday 1 Leaf Node went offline.
How to restart leaf node and bring it online. No Config changes happened.

Some Snaps-

image
image1124×447 38.7 KB

I need to connect a leaf node which is disconnected , connect to cluster.

image
image1303×312 30.8 KB

2

Hi divyn1! :wave: Welcome to our community forums.
Sorry you are experiencing this issue.
Can you tell me what service you are running on (managed or self0hosted) and the version number?

3

Hi @MariaSilverhardt ,
SS version is 7.5.19, it can be seen in above snap.
Service is self-hosted installed in linux.

Yesterday 1 leaf node went offline,no activity/config changes performed.Logs in above snaps.

Tried Stopping and Starting all Nodes, Able to connect on nodes but 1 leaf node which is currently in offline state is not able to communicate with Aggregator node.

4

For more help, you should submit a support ticket to provide more details as this is hard to know what brought this node down.

Here is a recommendation from the information that we have:

  • Make sure that the host is online and there was no change to the firewall (e.g. blocked ports). Are you able to SSH into the host with the leaf with the same user configured through Toolbox? If you are not able to connect at all, it means that you might have an issue with that server.
  • This can happen if you have changed the root password on a node through a client rather than toolbox but since you said that no config change happened, it’s probably not that case.
5

I found this issue,

My disk space in offline node was full, so its not able to connect with cluster and went offline.
Once I cleared logs dir , some space is freed and node went online again.

image
image1150×219 16.6 KB

1 Like
6

Congrats! Glad it worked out :tada:

7

did the node go back online by itself after you cleared the space or did you have to restart the leaf node?

8

It came back online by itself once cleared the space.

2 Likes
9

thanks for the reply!

1 Like