32 lines
1 KiB
Markdown
32 lines
1 KiB
Markdown
|
---
|
||
|
|
id: topic-etl
|
||
|
|
name: ETL
|
||
|
|
artifact_type: content
|
||
|
|
description: Topic definition for ETL (Extract, Transform, Load)
|
||
|
|
version: 1.0.0
|
||
|
|
tags:
|
||
|
|
- data-engineering
|
||
|
|
- data-integration
|
||
|
|
- topic
|
||
|
|
---
|
||
|
|
|
||
|
|
# ETL (Extract, Transform, Load)
|
||
|
|
|
||
|
|
A three-phase computing process where data is extracted from source systems, transformed (including validation, cleaning, enrichment, and aggregation), and loaded into a target data store or data warehouse.
|
||
|
|
|
||
|
|
ETL is a fundamental pattern in data integration and analytics pipelines, enabling organizations to consolidate data from heterogeneous sources into a unified format suitable for analysis and reporting.
|
||
|
|
|
||
|
|
**Key Characteristics:**
|
||
|
|
- Sequential batch-oriented processing
|
||
|
|
- Data quality enforcement during transformation
|
||
|
|
- Schema mapping and normalization
|
||
|
|
- Support for diverse source and target systems
|
||
|
|
- Typically scheduled and automated
|
||
|
|
|
||
|
|
**Common Use Cases:**
|
||
|
|
- Data warehouse population
|
||
|
|
- Business intelligence reporting
|
||
|
|
- Data migration projects
|
||
|
|
- Master data management
|
||
|
|
- Regulatory compliance reporting
|