Mô Tả Công Việc
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP ‘big data’ technologies.
- Build and maintain Data Model, Data Dictionary and Optimize Data Pipeline architecture.
- Assemble large, complex data sets that meet functional/ non-functional business requirements.
- Explore ways to enhance data quality and reliability; Identify opportunities for data acquisition.
- Keep our data separated and secure with appropriate access right and policies.
- Prepare data for prescriptive and predictive modeling.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Provide ad-hoc data and analytics support to the business and perform other related duties as assigned.
Yêu Cầu Công Việc
- 3+ years of experience as a data engineer or in a similar role.
- 1+ year experience working with Big Data on Cloud Platform. GCP/BigQuery is a plus.
- Proficient in SQL and variety of databases; Hands-on experience with SQL database design.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Great numerical and analytical skills.
- Knowledge of programming languages (e.g. Java and Python) is a plus.
- Degree in Computer Science, Statistics, Informatics, Information Systems or similar field; a Master’s is a plus.
- Experience with big data tools: Hadoop, Spark, Kafka, etc; and pipeline/ workflow management tools like Airflow is a plus.
Hình thức
Quyền Lợi
- Attractive salary
- Meal + Phone + Parking allowance
- Laptop provided
- 13th salary
- Performance bonus
- Health insurance after probation
- Social insurance deduction 100% on gross salary
- 100% of salary on probation
- Team building