Recommended AWS Instance Type for Vertica???

Moderator: NorbertKrupa

Post Reply
User avatar
janice
Intermediate
Intermediate
Posts: 51
Joined: Wed May 30, 2012 1:14 pm

Recommended AWS Instance Type for Vertica???

Post by janice » Wed Apr 20, 2016 9:23 pm

Hi all,

Recently I've been asked to perform some research into moving our DB into AWS. Has anyone here successfully done so? If so, could you please recommend which AWS instance types are appropriate for Vertica? Not too much documentation on this.

Thanks in advance!
Everyday is an adventure!

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: Recommended AWS Instance Type for Vertica???

Post by JimKnicely » Fri Apr 22, 2016 12:17 am

The biggest ones you can afford? :lol:

I am working on a POC now using 3 instances of the type r3.8xlarge. Be careful with the disks you chose for your data. We are using 8 EBS General Purpose (gp2) SSD drives for storage. We noticed that they work well in burst mode, but throttle down after you've used your burst credits... Maybe the better option is the EBS Provisioned IOPS SSD (io1) SSDs.

Read about them here:
https://aws.amazon.com/ebs/details/
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

scutter
Master
Master
Posts: 302
Joined: Tue Aug 07, 2012 2:15 am

Re: Recommended AWS Instance Type for Vertica???

Post by scutter » Fri Apr 22, 2016 1:21 pm

See this blog entry on the new SC1 volumes.

http://eng.localytics.com/amazon-ebs-sc ... pressions/
Sharon Cutter
Vertica Consultant, Zazz Technologies LLC

vcarusi
Beginner
Beginner
Posts: 29
Joined: Mon Apr 20, 2015 11:03 am

Re: Recommended AWS Instance Type for Vertica???

Post by vcarusi » Fri May 20, 2016 7:33 am

Hi,
We have 2 clusters (3 nodes) on AWS.
They are working well.
Veronica

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: Recommended AWS Instance Type for Vertica???

Post by JimKnicely » Fri May 20, 2016 5:45 pm

Veronica,

Are you using a software RAID configuration? I see a HUGE performance hit when doing a RAID 0 config in AWS.

Thanks!
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

vcarusi
Beginner
Beginner
Posts: 29
Joined: Mon Apr 20, 2015 11:03 am

Re: Recommended AWS Instance Type for Vertica???

Post by vcarusi » Mon May 23, 2016 1:34 pm

Hi,
Volumes with the same configuration - (SSD/gp2), size, IOPS, EBS - on the same instance had different I/O performances ( read/write per second, latency).
So, we tried to put some volumes from AWS in RAID configuration but didn't obtain an increase of performance. I think due to network involved.
We tried to replace a 1 Tb (maximum at that moment) with 5 volumes x 200 Gb in RAID. I mentioned that 1 TB was the maximum size for a volume, that guaranteed unique access to volume. A volume lower than 1Tb, meant to share it with someone else.
Veronica

Post Reply

Return to “Vertica Database Administration”