Mô Tả Công Việc
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
- Develop and maintain data pipelines using ETL processes.
- Work closely with data science team to implement data analytics pipelines.
- Maintain security and data privacy, working closely with data protection officer.
- Implement scalable architectural models for data processing and storage.
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode.
- Help in scoping, estimation, and planning to for various projects in the enterprise.
- Provide technical support to project teams as needed.
Yêu Cầu Công Việc
Must have Technical Requirements / Qualifications
- B.S. in Computer Science, related fields or commensurate work experience.
- 5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig… and ETL with large amounts of data.
- Experience on complex regulatory data integration projects.
- Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
- Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
- Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
- Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
- Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
- Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
- Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
- Agile based delivery knowledge
- Excellent English communication – verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
- Strong teambuilding skills and teamwork orientation.
- Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
- Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
- AZ-900: Microsoft Azure Fundamentals.
- Azure Data Engineer – Associate.
Hình thức
Quyền Lợi
- Competitive salary, health insurance covered for employee and dependents
- Working on international projects. Professional and dynamic working environment
- Achieving valuable experience with variety projects, new technologies and hundreds of talents
- Receiving training opportunities including many technical seminars and soft skill training courses
- Good opportunity for promotion through regular performance review system
- Hybrid work