DATA INGESTION

QUALITY DATA VIA DATA PROFILER

.

Loading and integrating data represents the most important task from Big Data to Enterprise Application project, simply because the accuracy and completeness of data will determine the quality of the analysis produced. Speedminer Data Ingestion comes with Data Quality module to ensure high data quality.

.

Speedminer is capable of ingesting data in the form of PDF, MS Project, Excel, web sites, social media, SOAP/Web Services/ XML/ JSON, databases, TCP/IP or machines and equipment interface including IoT. Regardless of the sources, Speedminer is able to crawl and merge them for your Big Data and BI analytics and reports.

.

Most ETL leverages on parallel processing to scale up on performance, but Speedminer further extends on scalability to multi-servers, distributing the burden of data loading so huge volumes of data can be processed within shorter timeframe.

.

Speedminer Rules Engine supports complex transformation of large volumes of data. Speedminer has successfully assisted Department of Statistics, Malaysia to migrate their extremely complex data cleansing rules and processes from mainframe to Speedminer System. The result is higher efficiency with process time down from 12 days to 2 days.

.

.

FEATURES
  • Speedminer is not only able to send status and data loading error messages, but can monitor data to send Business Activity Monitoring alerts via email and online messaging.
    .
  • Speedminer innovates and enhances the Slowly Changing Dimension to a new level that save space, making it more efficient and practical.
    .
  • Speedminer supports real time data loading to minimize the need for scheduled downtimes. Users can actively use the system even while Speedminer is loading and updating the data in the background.
    .
  • Wizards makes data loading tasks easier and faster.