Slow inserts through Informatica

Moderator: NorbertKrupa

Post Reply
sean
Newbie
Newbie
Posts: 11
Joined: Mon Sep 10, 2012 6:52 pm

Slow inserts through Informatica

Post by sean » Fri Oct 26, 2012 2:38 pm

Hi,

I'm using Vertica plugin for Informatica 9.1 to insert data. The speed is generally good. But every once in a while its slows down to a trickle and I see the informatica session logs fill up with this message:

[INFO] accepted 104 rejected 0 144537824

Anybody know what would cause this? Could this be the WOS getting filled up and spilling over into ROS?

Thanks

jpcavanaugh
Intermediate
Intermediate
Posts: 149
Joined: Mon Apr 30, 2012 10:04 pm
Location: New York
Contact:

Re: Slow inserts through Informatica

Post by jpcavanaugh » Fri Oct 26, 2012 3:30 pm

Can I ask what you have for the commit level in Informatica? I believe the default is 10k rows.

gvalerio
Newbie
Newbie
Posts: 1
Joined: Fri Oct 26, 2012 3:55 pm

Re: Slow inserts through Informatica

Post by gvalerio » Fri Oct 26, 2012 4:07 pm

The default commit level of 10,000 within Informatica is typically too low if you are loading 100s of millions, billions, or even trillions of rows. In my experience using Informatica and Vertica to load over 35B rows, a commit level of 10M decreased a 6-hour load job to less than 60-minutes.

sean
Newbie
Newbie
Posts: 11
Joined: Mon Sep 10, 2012 6:52 pm

Re: Slow inserts through Informatica

Post by sean » Fri Oct 26, 2012 7:45 pm

Thanks

However, I notice this issue only occasionally. I have other jobs running with 10k commit interval which run without issues.
I'll try with the commit interval change anyway.

Thanks,
Sean

sean
Newbie
Newbie
Posts: 11
Joined: Mon Sep 10, 2012 6:52 pm

Re: Slow inserts through Informatica

Post by sean » Wed Feb 13, 2013 4:34 pm

Hi,

I see this error occasionally when loading data into Vertica through Informatica 9.

Severity: INFO
Timestamp: 2/13/2013 7:31:29 AM
Thread: WRITER_1_*_1
Process ID: 30245
Message Code: VERTICA_WRITER_1762
Message: [DEBUG] No response from the backend

Can anyone please shed some light on what might be the issue and how to fix it?

Thanks,
Sean

Post Reply

Return to “Informatica PowerCenter”