`CREATE DATABASE` failed

ERROR 1772 ER_DISTRIBUTED_PARTITION_MOVE_FAILED: CREATE PARTITION DATABASE for operation CREATE DATABASE failed with error 1883:Leaf Error (172.31.46.158:3306): Available disk space is below the value of ‘minimal_disk_space’ global variable (100 MB). This query cannot be executed.

I have 13GB free on each node (5).

/opt/memsql-server-7.1.8-43a12901be$ df -kh
Filesystem Size Used Avail Use% Mounted on
udev 7.9G 0 7.9G 0% /dev
tmpfs 1.6G 784K 1.6G 1% /run
/dev/xvda1 15G 2.4G 13G 17% /
tmpfs 7.9G 0 7.9G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 7.9G 0 7.9G 0% /sys/fs/cgroup
/dev/loop0 97M 97M 0 100% /snap/core/9804
/dev/loop1 29M 29M 0 100% /snap/amazon-ssm-agent/2012
tmpfs 1.6G 0 1.6G 0% /run/user/1001

(5) nodes are t2.xlarge EC2 instances.
(2) nodes as master/child aggregators
(3) nodes each with two leafs

memsql> show aggregators;
±--------------±-----±-------±-------------------±-----------------------------±------------------±-------+
| Host | Port | State | Opened_Connections | Average_Roundtrip_Latency_ms | Master_Aggregator | NodeId |
±--------------±-----±-------±-------------------±-----------------------------±------------------±-------+
| 172.31.43.73 | 3306 | online | 2 | NULL | 1 | 1 |
| 172.31.41.174 | 3306 | online | 3 | 0.475 | 0 | 8 |
±--------------±-----±-------±-------------------±-----------------------------±------------------±-------+
2 rows in set (0.00 sec)

memsql> show leaves;
±--------------±-----±-------------------±--------------±----------±-------±-------------------±-----------------------------±-------±------------------------+
| Host | Port | Availability_Group | Pair_Host | Pair_Port | State | Opened_Connections | Average_Roundtrip_Latency_ms | NodeId | Grace_Period_In_seconds |
±--------------±-----±-------------------±--------------±----------±-------±-------------------±-----------------------------±-------±------------------------+
| 172.31.39.18 | 3306 | 1 | 172.31.39.65 | 3306 | online | 17 | 0.455 | 2 | NULL |
| 172.31.39.65 | 3306 | 2 | 172.31.39.18 | 3306 | online | 17 | 0.405 | 3 | NULL |
| 172.31.46.158 | 3306 | 1 | 172.31.39.18 | 3307 | online | 17 | 0.429 | 4 | NULL |
| 172.31.39.18 | 3307 | 2 | 172.31.46.158 | 3306 | online | 17 | 0.331 | 5 | NULL |
| 172.31.39.65 | 3307 | 1 | 172.31.46.158 | 3307 | online | 17 | 0.330 | 6 | NULL |
| 172.31.46.158 | 3307 | 2 | 172.31.39.65 | 3307 | online | 17 | 0.348 | 7 | NULL |
±--------------±-----±-------------------±--------------±----------±-------±-------------------±-----------------------------±-------±------------------------+
6 rows in set (0.00 sec)

memsql> show databases;
±-------------------+
| Database |
±-------------------+
| cluster |
| information_schema |
| memsql |
±-------------------+
3 rows in set (0.00 sec)

Deployment done with the UI

Hi,

If you connect to the leaf which is out of disk and run:

select @@datadir
select @@tracelogsdir
select @@plancachedir

The disk those directories are on are the disk(s) that need to remain above minimal_disk_space.