Page 1 of 1

Slow inserts through Informatica

Posted: Fri Oct 26, 2012 2:38 pm
by sean
Hi,

I'm using Vertica plugin for Informatica 9.1 to insert data. The speed is generally good. But every once in a while its slows down to a trickle and I see the informatica session logs fill up with this message:

[INFO] accepted 104 rejected 0 144537824

Anybody know what would cause this? Could this be the WOS getting filled up and spilling over into ROS?

Thanks

Re: Slow inserts through Informatica

Posted: Fri Oct 26, 2012 3:30 pm
by jpcavanaugh
Can I ask what you have for the commit level in Informatica? I believe the default is 10k rows.

Re: Slow inserts through Informatica

Posted: Fri Oct 26, 2012 4:07 pm
by gvalerio
The default commit level of 10,000 within Informatica is typically too low if you are loading 100s of millions, billions, or even trillions of rows. In my experience using Informatica and Vertica to load over 35B rows, a commit level of 10M decreased a 6-hour load job to less than 60-minutes.

Re: Slow inserts through Informatica

Posted: Fri Oct 26, 2012 7:45 pm
by sean
Thanks

However, I notice this issue only occasionally. I have other jobs running with 10k commit interval which run without issues.
I'll try with the commit interval change anyway.

Thanks,
Sean

Re: Slow inserts through Informatica

Posted: Wed Feb 13, 2013 4:34 pm
by sean
Hi,

I see this error occasionally when loading data into Vertica through Informatica 9.

Severity: INFO
Timestamp: 2/13/2013 7:31:29 AM
Thread: WRITER_1_*_1
Process ID: 30245
Message Code: VERTICA_WRITER_1762
Message: [DEBUG] No response from the backend

Can anyone please shed some light on what might be the issue and how to fix it?

Thanks,
Sean