Sybase Replication Server Real — Time Loading into Sybase IQ

EXECUTIVE SUMMARY
Sybase has developed a new, innovative and dynamic staging technology, allowing full use of the native, high-speed data load mechanism Sybase IQ offers . . . Real Time Loading (RTL).

RTL addresses the need to have another system prepare the data for load by taking real time data movement from the source database, and applying staging technology to the data transfer in the background.

Up until now, the only option for loading data from an Online Transaction Processing (OLTP) database . . . airline reservation systems, financial transactions, etc., into a Sybase IQ data warehouse was a so-called staging process. Staging means that the OLTP is isolated from the data warehouse loading process to ensure data integrity, due to the rapidly changing data content in the OLTP database systems.

Direct replication into Sybase IQ was limited to low data movement environments. The reason lies in the fundamental differences on how Sybase IQ processes data, and data movement strategies Sybase Replication Server applies.

Sybase IQ is a column vector database. Retrieving a single row requires assembling the row from each column component. This process makes row by row processing ineffective, and the so- called “trickle feed” loading of Sybase IQ nearly impossible. The advantage of a column vector database is in the unmatched speed for complex data retrieval operations and data aggregation on huge data sets.

Click here to view the complete document (PDF).