Hi all,
Recently I've been asked to perform some research into moving our DB into AWS. Has anyone here successfully done so? If so, could you please recommend which AWS instance types are appropriate for Vertica? Not too much documentation on this.
Thanks in advance!
Recommended AWS Instance Type for Vertica???
Moderator: NorbertKrupa
Recommended AWS Instance Type for Vertica???
Everyday is an adventure!
- JimKnicely
- Site Admin
- Posts: 1825
- Joined: Sat Jan 21, 2012 4:58 am
- Contact:
Re: Recommended AWS Instance Type for Vertica???
The biggest ones you can afford?
I am working on a POC now using 3 instances of the type r3.8xlarge. Be careful with the disks you chose for your data. We are using 8 EBS General Purpose (gp2) SSD drives for storage. We noticed that they work well in burst mode, but throttle down after you've used your burst credits... Maybe the better option is the EBS Provisioned IOPS SSD (io1) SSDs.
Read about them here:
https://aws.amazon.com/ebs/details/
I am working on a POC now using 3 instances of the type r3.8xlarge. Be careful with the disks you chose for your data. We are using 8 EBS General Purpose (gp2) SSD drives for storage. We noticed that they work well in burst mode, but throttle down after you've used your burst credits... Maybe the better option is the EBS Provisioned IOPS SSD (io1) SSDs.
Read about them here:
https://aws.amazon.com/ebs/details/
Jim Knicely
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.
Re: Recommended AWS Instance Type for Vertica???
Sharon Cutter
Vertica Consultant, Zazz Technologies LLC
Vertica Consultant, Zazz Technologies LLC
Re: Recommended AWS Instance Type for Vertica???
Hi,
We have 2 clusters (3 nodes) on AWS.
They are working well.
Veronica
We have 2 clusters (3 nodes) on AWS.
They are working well.
Veronica
- JimKnicely
- Site Admin
- Posts: 1825
- Joined: Sat Jan 21, 2012 4:58 am
- Contact:
Re: Recommended AWS Instance Type for Vertica???
Veronica,
Are you using a software RAID configuration? I see a HUGE performance hit when doing a RAID 0 config in AWS.
Thanks!
Are you using a software RAID configuration? I see a HUGE performance hit when doing a RAID 0 config in AWS.
Thanks!
Jim Knicely
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.
Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.
Re: Recommended AWS Instance Type for Vertica???
Hi,
Volumes with the same configuration - (SSD/gp2), size, IOPS, EBS - on the same instance had different I/O performances ( read/write per second, latency).
So, we tried to put some volumes from AWS in RAID configuration but didn't obtain an increase of performance. I think due to network involved.
We tried to replace a 1 Tb (maximum at that moment) with 5 volumes x 200 Gb in RAID. I mentioned that 1 TB was the maximum size for a volume, that guaranteed unique access to volume. A volume lower than 1Tb, meant to share it with someone else.
Veronica
Volumes with the same configuration - (SSD/gp2), size, IOPS, EBS - on the same instance had different I/O performances ( read/write per second, latency).
So, we tried to put some volumes from AWS in RAID configuration but didn't obtain an increase of performance. I think due to network involved.
We tried to replace a 1 Tb (maximum at that moment) with 5 volumes x 200 Gb in RAID. I mentioned that 1 TB was the maximum size for a volume, that guaranteed unique access to volume. A volume lower than 1Tb, meant to share it with someone else.
Veronica