AWS Vertica timeout exceptions

Moderator: NorbertKrupa

Post Reply
chenshaulian
Intermediate
Intermediate
Posts: 51
Joined: Wed Sep 09, 2015 9:34 am

AWS Vertica timeout exceptions

Post by chenshaulian » Mon Apr 18, 2016 9:30 am

Hi,

I have a problem on my AWS Vertica (7.1.1-10) cluster site on CentOS 6.
I did a copy cluster from Vertica (7.1.1-10) to AWS Vertica site (CentOS-6 too)… and now I'm getting timeout exceptions only on AWS site (thing that doesn't happening on the source cluster)
I'm connecting to Vertica with DBeaver, DataGrip and Jenkins… and in all programs I'm getting the following error after several minutes:
[HY000][100024] [Vertica][VJDBC](100024) IOException while communicating with server: null. Refer to the inner exception for more detail. java.io.EOFException

I tried to set some parameters (set them to be same as the source cluster):
# cat /proc/sys/net/ipv4/tcp_keepalive_time
120
# cat /proc/sys/net/ipv4/tcp_keepalive_intvl
120
# cat /proc/sys/net/ipv4/tcp_keepalive_probes
45
But it didn't helped… Still having the problem :(

Do you know what can cause that?
How on one environment I'm not getting this error and in AWS environment I do?

Thanks
Chen

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: AWS Vertica timeout exceptions

Post by JimKnicely » Mon Apr 18, 2016 7:50 pm

Hi,

Is there a firewall running on the cluster you cannot connect? Also, make sure port 5433 is open.

Thanks!
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

chenshaulian
Intermediate
Intermediate
Posts: 51
Joined: Wed Sep 09, 2015 9:34 am

Re: AWS Vertica timeout exceptions

Post by chenshaulian » Tue Apr 19, 2016 8:40 am

Hi Jim,

thank you for your answer.
All the firewalls are closed and the port is open.

I can connect to the cluster and run queries... the problem is that after some time (1-2 min) the connection closed and I need to reconnect.

Thanks
Chen

chenshaulian
Intermediate
Intermediate
Posts: 51
Joined: Wed Sep 09, 2015 9:34 am

Re: AWS Vertica timeout exceptions

Post by chenshaulian » Tue Apr 19, 2016 3:59 pm

Fixed

We are having DNS Cname on AWS Vertica cluster, we increased idle timeout to 5 min from 30 sec

Thanks
Chen

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: AWS Vertica timeout exceptions

Post by JimKnicely » Tue Apr 19, 2016 5:35 pm

Did that work?

Also, check you ssh setting in the /opt/vertica/config/admin.conf file. There are timeout parameters there too.

Example:

[SSHConfig]
ssh_user =
ssh_ident =
ssh_options = -oConnectTimeout=30 -o TCPKeepAlive=no -o ServerAliveInterval=15 -o ServerAliveCountMax=2 -o StrictHostKeyChecking=no -o BatchMode=yes
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

chenshaulian
Intermediate
Intermediate
Posts: 51
Joined: Wed Sep 09, 2015 9:34 am

Re: AWS Vertica timeout exceptions

Post by chenshaulian » Wed Apr 20, 2016 8:26 am

Increasing the idle timeout fixed my problem :)

User avatar
JimKnicely
Site Admin
Site Admin
Posts: 1825
Joined: Sat Jan 21, 2012 4:58 am
Contact:

Re: AWS Vertica timeout exceptions

Post by JimKnicely » Wed Apr 20, 2016 9:21 pm

Nice!
Jim Knicely

Image

Note: I work for Vertica. My views, opinions, and thoughts expressed here do not represent those of my employer.

Post Reply

Return to “Vertica Database Administration”