Web Data Integration - Center of Financial Technologies, Inc.

Center of Financial Technologies, Inc.’s Web Data Integration solution allows corporations to scrape data from the Internet and Intranet, and clean, normalize and integrate it into the corporate database. It uses unique algorithms for data parsing along leading technologies available on the market. Data collected can be used for:

Corporate Reporting
Business Intelligence and Decision Support
Market Monitoring
Sales Performance Analysis

The system can be easily scaled for high data volume by adding servers to the system cluster. The system framework allows load distribution automatically across the servers to achieve optimal performance.

The Web Data Integration solution consists of the following sub-systems:

System Framework

Scheduler
Module Launcher

Modules
- Download Modules
- Parsing Modules
- Normalization Data Cleansing Module
- Reporting Module
- Report Publisher
- Report Delivery Module
- Normalized Database
- System Management Interface

System Framework

The core of the integration system is the scheduler and the module launcher. These two modules coordinate process execution, and unify logging and administrative control.

Parsing

Data parsing is performed by Pervasive djCosmos software (formerly Data Junction), a leading ETL product.

Customization Flexibility

The system uses several XML dialects to store metadata that describes where to get data and how it should be parsed, cleaned and normalized. A person without programming skills can easily customize the system.

Reporting

Various report formats are supported, including RTF, MS Word, MS Access and comma-delimited. The system allows interoperability with OLAP tools, such as SQL Server Analysis Services and MS Excel for creating multi-dimensional aggregate reports.

System Management Interface (SMI)

SMI provides an easy way to monitor and administer the whole integration system remotely. It features a secure web browser-based interface that provides access to the current system’s status, processes, schedule and logs. It allows the administrator to perform specific tasks on system processes.