#syncsort

Time to put the “T” back into ETL?

Extract, Transform and Load (ETL) is a data integration approach that was supposed to make data integration quicker, easier and reusable.

In practise, many of us may have found that ETL did not solve our data integration challenges – tools being highly inefficient and overly complex.

I remember working on a project some years back to create a single view of the citizen by combining hundreds…

Is a lack of trust inhibiting adoption of AI in South Africa

A recent study by World Wide Worx shows slow adoption of artificial intelligence solutions in Southern Africa. A lack of skills is certainly one barrier, but increasingly studies are also showing that poor quality data and a lack of local (South African) data sets are also factors that drive up the risk of AI failure, and are inhibiting adoption.

Syncsorts 2019 State of Enterprise Data Quality…

Best Practices for Bringing Mainframe Data to Hadoop

Shift Mainframe Data and Batch Processing to Hadoop

Syncsort’s Mainframe Access & Integration for Hadoop Solution brings together decades of mainframe expertise with state-of-the-art Hadoop capabilities to provide a painless and seamless approach to offload mainframe data and workloads:

Access – get mainframe data into Hadoop and Apache Spark – in a mainframe format – and work with it…

Simplify Big Data Development – Design Once, Deploy Anywhere

It’s certainly not a new refrain, but in recent years IT managers are increasingly being told to do more with less – even as the number of new projects and requirements increase. Data is the fuel that powers most new business initiatives, but each project needs a slightly different blend of data sources and data formats. Clearly data integration and ETL development can be a bottle-neck that takes…

Big data use case: Offloading the data warehouse to Hadoop

The true cost of ELT

Today’s business world is demanding more from the data warehouse, because more than ever an organisation’s survival depends on its ability to transform data into actionable insights.

However, ELT data integration workloads are now consuming up to 80% of database capacity, resulting in:

Rising infrastructure costs

Increasing batch windows

Longer development cycles

Slower user…

What is data integration? (building a single view of the truth)

Join 1,547 other followers

Subscribe

Data integration defined

Data integration is a common industry term referring to the…

ETL defined

Extract, Transform and Load  or ETL is a standard information management term used to describe a process for the movement and transformation of data. ETL is commonly used to populate data warehouses and datamarts, and for data migration, data integration and business intelligence initiatives.

ETL processes can be built by manually writing custom scripts or code, with the trade-off that…