Hui Liao

US Patent:

8099725, Jan 17, 2012

Filed:

Oct 11, 2006

Appl. No.:

11/548659

Inventors:

Qi Jin - San Jose CA, US
Hui Liao - Santa Clara CA, US
Lin Xu - San Jose CA, US

Assignee:

International Business Machines Corporation - Armonk NY

International Classification:

G06F 9/44
G06F 9/45

US Classification:

717151, 717106, 717153, 717154, 717159

Abstract:

Methods, computer program products, and system for generating code for an extract, transform, and load (ETL) data flow are provided. In one implementation, the method includes receiving an ETL data flow representing a logical transformation and flow of data, placing a staging table at a pre-determined location in the ETL data flow to reduce a total number of staging tables required by the transformation, and generating code for the transformation based on the ETL data flow including the staging table placed at the pre-determined location.

US Patent:

8160999, Apr 17, 2012

Filed:

Dec 13, 2006

Appl. No.:

11/610480

Inventors:

Qi Jin - San Jose CA, US
Hui Liao - Santa Clara CA, US
Sriram K. Padmanabhan - San Jose CA, US
Lin Xu - San Jose CA, US

Assignee:

International Business Machines Corporation - Armonk NY

International Classification:

G06F 7/00

US Classification:

707602, 707798

Abstract:

Methods and systems for implementing a splitter operation in an extract, transform, and load (ETL) process are provided. In one implementation, the method includes receiving a data flow including a splitter operation, and generating an execution plan graph based on the data flow. The execution plan graph includes structured query language (SQL) code for implementing the splitter operation, in which the structured query language (SQL) code is respectively executable among database servers associated with different vendors.

US Patent:

8219518, Jul 10, 2012

Filed:

Jan 9, 2007

Appl. No.:

11/621521

Inventors:

Qi Jin - San Jose CA, US
Hui Liao - Santa Clara CA, US
Sriram Srinivasan - Sunnyvale CA, US
Lin Xu - San Jose CA, US

Assignee:

International Business Machines Corporation - Armonk NY

International Classification:

G06F 7/00

US Classification:

707602, 707798

Abstract:

Methods, systems, and computer program products for generating code from a data flow associated with an extract, transform, and load (ETL) process. In one implementation, the method includes identifying a data exchange requirement between a first operator and a second operator in the data flow. The first operator is a graphical object that represents a first data transformation step in the data flow and is associated with a first type of runtime engine, and the second operator is a graphical object that represents a second data transformation step in the date flow and is associated with a second type of runtime engine. The method further includes generating code to manage data staging between the first operator and the second operator in the data flow. The code exchanges data from a format associated with the first type of runtime engine to a format associated with the second type of runtime engine.

US Patent:

20070214111, Sep 13, 2007

Filed:

Mar 10, 2006

Appl. No.:

11/372540

Inventors:

Qi Jin - San Jose CA, US
Hui Liao - Santa Clara CA, US
Sriram K. Padmanabhan - San Jose CA, US
Lin Xu - San Jose CA, US

Assignee:

International Business Machines Corporation - Armonk NY

International Classification:

G06F 17/30

US Classification:

707 3

Abstract:

A computer implemented method, apparatus, and computer usable program code for generating code for an integrated data system. A mixed data flow is received. The mixed data flow contains mixed data flow operators, which are associated with multiple runtime environments. A graph is generated containing logical operators based on the mixed data flow in response to receiving the mixed data flow. The logical operators are independent of the plurality of runtime environments. The graph is converted to a model. The logical operators are converted to model operators associated with the multiple runtime environments. The model operators allow for analysis of operations for the mixed data flow. The model is converted into an execution plan graph. The execution plan graph is executable on different runtime environments.

US Patent:

20120271865, Oct 25, 2012

Filed:

Jun 14, 2012

Appl. No.:

13/523217

Inventors:

Qi Jin - San Jose CA, US
Hui Liao - Santa Clara CA, US
Sriram Srinivasan - Sunnyvale CA, US
Lin Xu - San Jose CA, US

Assignee:

INTERNATIONAL BUSINESS MACHINES CORPORATION - Armonk NY

International Classification:

G06F 17/30

US Classification:

707810, 707E17124

Abstract:

Methods, systems, and computer program products for generating code from a data flow associated with an extract, transform, and load (ETL) process. In one implementation, the method includes identifying a data exchange requirement between a first operator and a second operator in the data flow. The first operator is a graphical object that represents a first data transformation step in the data flow and is associated with a first type of runtime engine, and the second operator is a graphical object that represents a second data transformation step in the data flow and is associated with a second type of runtime engine. The method further includes generating code to manage data staging between the first operator and the second operator in the data flow. The code exchanges data from a format associated with the first type of runtime engine to a format associated with the second type of runtime engine.