Hi,
I am writing data from Hadoop to Vertica.
Vertica Table Structure is like this
Table Name : STUDENT_TB
Schema | Table | Column | Type | Size | Default | Not Null | Primary Key | Foreign Key
--------+------------+------------------+--------------+------+-------------+----------+-------------+-------------
SAMPLE | STUDENT_TB | STUD_ID | int | 8 | | t | t |
SAMPLE | STUDENT_TB | INSERT_DATE | date | 8 | "sysdate"() | t | f |
SAMPLE | STUDENT_TB | DELETE_DATE | date | 8 | | f | f |
SAMPLE | STUDENT_TB | STUD_NAME | varchar(30) | 30 | | t | f |
Hadoop connector would load only the STUD_ID AND STUD_NAME
i have the VerticaOutputFormat and VerticaRecord as shown below.
VerticaOutputFormat.setOutput(job, "DB.SAMPLE.STUDENT_TB", true, "STUD_ID int", "STUD_NAMErecord.set(0, 1);
record.set(0, 1);
record.set(1, "JACKSON");
When i execute the code, it gives me the following error
java.io.IOException: java.sql.BatchUpdateException: [Vertica][VJDBC](100172) One or more rows were rejected by the server.
at com.vertica.hadoop.VerticaRecordWriter.close(VerticaRecordWriter.java:90)
But when i mention all the column of the table in the VerticaOutputFormat and VerticaRecord, it works fine. I would require vertica to insert sysdate in the INSERT_DATE column and DELETE_DATE should be empty.
Would you please provide me a solution to proceed further.Do let me know if additional information is required.
Thanks,
Vinodh
Writing data from Hadoop to Vertica
Moderator: NorbertKrupa
-
- Newbie
- Posts: 1
- Joined: Wed Aug 07, 2013 2:49 pm
Jump to
- General
- ↳ Welcome to vertica-forums.com!
- ↳ Board Announcements
- ↳ Request for New Forums Categories
- ↳ Announcements, Events and Activities
- ↳ Vertica Links
- ↳ General
- ↳ Employment
- ↳ Vertica Certification
- Newbie
- ↳ New to Vertica
- ↳ New to Vertica Database Administration
- ↳ New to Vertica Database Development
- ↳ New to Vertica SQL
- Using Vertica
- ↳ Vertica Database Administration
- ↳ Vertica Database Development
- ↳ Vertica SQL
- ↳ Vertica SQL Functions
- ↳ Vertica Database Designer (DBD)
- ↳ Vertica User Defined Functions (UDFs)
- ↳ Vertica External Procedures
- ↳ Vertica Analytics
- ↳ Vertica Management Console
- ↳ Vertica Error Codes
- ↳ Vertica Backup & Recovery
- ↳ Vertica Installation
- ↳ Vertica Security
- ↳ Vertica Performance Tuning
- ↳ Vertica Administration Tools
- ↳ Vertica Upgrade
- ↳ Vertica Migration
- ↳ Vertica and the Operating System
- ↳ Vertica Data Load
- ↳ Vertica Tips, Lessons and Examples
- ↳ Vertica "How to..."
- Connecting to Vertica
- ↳ ADO.NET
- ↳ Cognos
- ↳ DBeaver
- ↳ dbVisualizer
- ↳ HDFS Connector
- ↳ Hadoop Connector
- ↳ HCatalog Connector
- ↳ Informatica PowerCenter
- ↳ JDBC
- ↳ Microsoft SQL Server Analysis Services (SSAS)
- ↳ MicroStrategy
- ↳ Microsoft SQL Server Integration Services (SSIS)
- ↳ ODBC
- ↳ Perl
- ↳ PHP
- ↳ Python
- ↳ R Language Integration
- ↳ Rhapsody Interface Engine
- ↳ SQL Workbench/J
- ↳ SQuirreL SQL Client
- ↳ Talend
- ↳ Tableau
- ↳ Toad for Data Analysts
- ↳ Vertica SDK API
- ↳ VoltDB
- ↳ vSQL
- Vertica Portfolio
- ↳ Vertica Premium Edition
- ↳ Vertica Express Edition
- ↳ Vertica Community Edition
- ↳ Vertica SQL on Hadoop
- ↳ Vertica in the AWS Cloud
- ↳ Vertica on Microsoft Azure
- All times are UTC+01:00
- Top
- Delete all board cookies
Powered by phpBB ® | phpBB3 theme by KomiDesign