Partial online backup

[heatlamp]

I’m new to Vertica, but not to RDBMs.

For whatever reason, our 20TB Vertica database frequently falls over, and management would like to create a backup environment that only includes data specific to this division (less than 5% of the complete database). The backup system would only be used when the production system is down, and would not be collocated with production.

The question is how best to do this. In a traditional RDBMS, something like materialized views over a database link might be used.

The backup environment need not be Vertica, but it could be if that’s the most efficient solution. A primary concern is the performance impact on the production environment, which is often stretched.

Any options appreciated.

Thx, Jim

[scutter]

HI Jim,

Have you looked into the root cause for why your cluster is falling over? Seems like you might be better off resolving that rather than creating a mirror of a subset of the Vertica data.

--Sharon

[heatlamp]

Thanks for the reply. I have no control over the production environment, but other people are looking into it.

My mandate is to create a backup solution.

Jim

[JimKnicely]

Hello heatlamp,

How many tables are involved? Have you looked into how to EXPORT data via a SELECT statement (see the "Moving Data Between Vertica Databases" section of the Admin. Guide). You could export the 5% of data off to another Vertica database on a regular basis. You can add a SELECT AT EPOCH LATEST expression to include data from the latest committed DML transaction. Although keep in mind that they'll be a lag in the data in PROD and the data available in your backup database since you may only move the data once a day.

[JimKnicely]

heatlamp,

Out of curiosity, what version of Vertica is running in your PROD environment? And how many nodes are in the cluster? I'm with scutter in that we'd all like to help you figure out why the cluster maybe failing. And what no you mean by failing? Are nodes leaving the cluster? Sorry about all the questions...

[heatlamp]

Thanks again, but I really don't want to get off topic. Perhaps I or another will post RE our production issues.

Jim

[JimKnicely]

Ok, but what do you think about the EXPORT idea?