Mô Tả Công Việc
- Implement the DataOps philosophy in everything you do
- Maintain best practices to facilitate optimized software development and continuous improvement/continuous delivery (CI/CD)Work on full scale Data Lake implementations based on Cloudera Platform (Spark, Hadoop, Hive, Impala, YARN).
- Assist with data architecture, automation and planning
- Develop end to end data pipeline to ELT data from multiple source system (Kafka, Database, API, File System, CDC) to Data Lake that follow best practices
- Improve development and deployment flow, including building, testing, deploying, etc.
- Deliver medium to large data features independently
- Design and implement Kimball data model for serving layer for BU
- Guide junior member on best practice
Yêu Cầu Công Việc
- 2+ years hands-on experience on Big Data Engineering.
- Professional experience using Python, Scala for data processing
- Demonstrably deep understanding of SQL and analytical data warehouses
- Hands-on experience implementing ETL (or ELT) and data pipeline practice best practices at scale
- Hands-on experience with data tools (Airflow, dbt, Spark, Kafka, Hadoop, Hive)
- Strong data modeling skills and familiarity with the Kimball methodology
- Expertise in designing and developing distributed data pipelines using big data technologies on large scale data sets demonstrated with years of proven experience.
- Hands-on experience with CDC solution (preferred Oracle Golden Gate) for data ingestion/integration
- Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
Hình thức
Quyền Lợi
Understanding candidates' expectations of the ideal workplace, we always put the people element at the top of our priorities.
Compensation programs and employees' development opportunities for employees are always significantly invested in, bringing you:
Primary benefits:
- 13th-month Salary and performance- based KPI Bonus
- 15+ Annual Leaves
- Full Social Insurance, Premium Healthcare, Annual Medical Check- up
- Team Building and CSR activities: Year- end Party, New-year Party, Company trip, Charity activities, Blood donation
- Learning workshops: Udemy E-learning, English courses, Senior management development training programs
Our culture fosters your career development through:
1. Strategy
- Thinking Big: We focus on creating meaningful and sustainable opportunities for the company.
- Customer Obsession: We try to understand future customer needs, trends, and the impact of digital transformation.
2. Implementation
- Digital Savviness: We seek to understand the technological aspects of the business to enhance efficiency and customer experience.
- Entrepreneurship: We communicate the company's strategy and purpose to others, inspire and lead them effectively.
- Risk in mind: We consider risks and their possible effects before making decisions.
- Operational Excellence: We stay focused on the goal, disciplined in tightening tasks to the end.
3. Building the organization
- People Centricity: We sustain focus on the development of team members through meaningful development plans and learning opportunities.
- Integrity: We always stay focused on the goal you need to achieve, refrain from getting into personal conflicts.