Mô Tả Công Việc
● Design, develop, and maintain scalable and efficient data pipelines and ETL processes.
● Collaborate with cross-functional teams to gather and understand data requirements.
● Implement data models, including dimensional models or data vault models, to support efficient data storage and retrieval.
● Utilize Python for data manipulation, transformation, and analysis tasks.
● Develop and maintain ETL workflows using tools like Airflow, Dagster, DBT, ODI, etc.
● Ensure data quality and integrity through data validation and cleansing techniques.
● Perform data profiling and analysis to identify data quality issues and implement appropriate solutions.
● Work with various banking data sources, such as core-banking systems, T24, Card, mobile banking, etc., to extract, transform, and load data.
● Collaborate with stakeholders to define data requirements and ensure data solutions meet business needs.
● Implement data validation processes and rules to ensure accurate and consistent data.
● Establish data lineage and tracking mechanisms to ensure data traceability and compliance.
● Monitor and optimize data pipelines for performance, scalability, and reliability.
● Collaborate with the team to ensure adherence to data engineering best practices and standards.
Yêu Cầu Công Việc
● Strong experience with Python and SQL for data manipulation, transformation, and analysis.
● Solid understanding of data modeling principles, with experience in dimensional models or data vault models.
● Proficiency in working with ETL tools like Airflow, Dagster, DBT, ODI, etc.
● Familiarity with banking data and systems, such as core-banking, T24, Card, Mobile banking, etc., is a plus.
● Knowledge of data validation, data quality, and data lineage concepts and techniques.
● Strong problem-solving and analytical skills to identify and resolve data-related issues.
● Excellent communication and collaboration skills to work effectively with cross-functional teams.
● Ability to handle multiple tasks and prioritize effectively in a dynamic environment.
● Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.