We are using 4.0.7 cratedb version
In my scenario, we are using days (current day midnight epoch) as a partition for table and we have configured 8 shards and table retention is 15-45 days for records.
So due to partition and retention, It will create around 1400-2500 shards for single table
Can I choose days column for partition?
Does this multiple shards create bad impact on read/write performance?
I have read https://crate.io/docs/crate/howtos/en/latest/performance/sharding.html
We have 2 core cpu, 8 gb ram around 3-4 nodes.
As per guide, shard count should be equal to cpu count.
Is it over allocation for table?
What should I need to do to avoid this over allocation?
What is the difference between Configured shards vs Started shards?
Regarding the more partition, How can I delete partitions from the table?
We have just find the workaround using close partition by below query.
Is there any performance impact if we close partition using below query?
ALTER TABLE my_table PARTITION (days=epoch) CLOSE;