We have a 20-nodes cluster on AWS; we are planning to add another 20-nodes. We have two options: 1. build another cluster and separate tables into two clusters; 2. add into current cluster and do rebalance (We have 1.2TB data in each node of 2.6TB max).
Any recommendations? Thanks.
Adding more nodes to current cluster
Moderator: NorbertKrupa
-
- GURU
- Posts: 527
- Joined: Tue Oct 22, 2013 9:36 pm
- Location: Chicago, IL
- Contact:
Re: Adding more nodes to current cluster
Depends on your business requirements. Would you use this as a production cluster, or for DR?
Without knowing much details, it's hard to say. However, having two separate clusters would make more sense from the high availability standpoint.
Without knowing much details, it's hard to say. However, having two separate clusters would make more sense from the high availability standpoint.
Checkout vertica.tips for more Vertica resources.
Re: Adding more nodes to current cluster
Agreeing with Norbert that it depends on your business requirements.
What are the current performance characteristics of your current cluster? Are your CPUs maxed out, do you have iowait? How is individual query performance versus your SLA? Doubling the size of the cluster will result in 2x the query speed in general.
What are the current performance characteristics of your current cluster? Are your CPUs maxed out, do you have iowait? How is individual query performance versus your SLA? Doubling the size of the cluster will result in 2x the query speed in general.
Sharon Cutter
Vertica Consultant, Zazz Technologies LLC
Vertica Consultant, Zazz Technologies LLC
Re: Adding more nodes to current cluster
Thanks for your replies!
Our data size increases dramatically and we are expecting more increase during holiday season. So We are planning to distribute data to more nodes.
Today, we are loading aggregated data from netezza. We are considering loading from log servers into Vertica directly.
Our data size increases dramatically and we are expecting more increase during holiday season. So We are planning to distribute data to more nodes.
Today, we are loading aggregated data from netezza. We are considering loading from log servers into Vertica directly.
-
- GURU
- Posts: 527
- Joined: Tue Oct 22, 2013 9:36 pm
- Location: Chicago, IL
- Contact:
Re: Adding more nodes to current cluster
So there's a requirement to have this data active and not moved off to long term storage?weikang wrote:Our data size increases dramatically and we are expecting more increase during holiday season. So We are planning to distribute data to more nodes.
Checkout vertica.tips for more Vertica resources.
Re: Adding more nodes to current cluster
Hi norbertk,
yes, we are expecting to handling larger size of data.
yes, we are expecting to handling larger size of data.
-
- GURU
- Posts: 527
- Joined: Tue Oct 22, 2013 9:36 pm
- Location: Chicago, IL
- Contact:
Re: Adding more nodes to current cluster
Have you estimated the expected growth and thus came up with 20 nodes?weikang wrote:yes, we are expecting to handling larger size of data.
Checkout vertica.tips for more Vertica resources.