- Design, develop, and implement robust data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
- Collaborate with stakeholders to understand requirements and translate them into technical specifications.
- Perform data profiling and analysis to identify data quality issues and develop strategies for data cleansing and transformation.
- Develop and maintain ETL processes for extracting, transforming, and loading data from diverse sources into a unified data warehouse or data lake.
- Monitor and optimize data integration workflows to ensure high performance and reliability.
- Troubleshoot data integration issues, perform root cause analysis, and implement corrective actions.
- Collaborate with database administrators, data architects, and developers to ensure data integrity, security, and compliance.
- Document data integration processes, configurations, and troubleshooting steps for knowledge sharing and future reference.
- Stay updated with emerging trends and advancements in data integration technologies and recommend improvements or new solutions.
Bachelor’s degree in computer science, Information Systems, or a related field.Proven work experience as a Data Integration Engineer or similar role.Strong understanding of data integration concepts, methodologies, and best practices.Proficient in data management, ETL (Extract, Transform, Load) processes, and data quality management.Experience with data integration tools and technologies (e.g., ODI, IBM DataStage, Talend).Familiarity with relational databases (e.g., Oracle, SQL Server, MySQL) and data warehouse concepts.Knowledge of scripting languages (e.g., Python, Shell scripting) for data manipulation and automation.Excellent problem-solving and troubleshooting skills with the ability to analyze complex data integration issues.Strong communication and collaboration skills to work effectively with cross-functional teams.