Mô Tả Công Việc
- Participate in Requirements Analysis & Technical Specification in the Agile/Scrum development process.
- Design, develop, and maintain scalable data pipelines and ETL processes to collect, clean, and process large datasets. The system is built on the microservice architecture and deployed Kubernetes (use AWS EKS service) across 3 AWS regions globally (US, HK, SG).
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop data solutions that meet business needs. Use BI tools for data analytics, such as Grafana, AWS QuickSight, or Excel (Google Sheets).
- Develop and implement data integration strategies and data transformation logic, ensuring high-quality and accurate data in the data warehouse. Use Kafka and Nifi tech-stack & eco-system to build data flow.
- Optimize and improve the performance, efficiency, and reliability of data pipelines, data models, and data storage solutions. Use database or object storage services like PostgreSQL, ElasticSearch, Redis, and AWS S3.
- Monitor and troubleshoot data pipeline issues, ensuring data integrity and timely data delivery. Use tools for monitoring logs and issues such as Sentry, Grafana, or alerts Slack.
Yêu Cầu Công Việc
- Bachelor's degree in Computer Science or a related field.
- 1+ years of experience in Backend development or Data engineering, ETL development, or a similar role.
- Understanding of microservice architecture.
- Proficiency one of langue in C#, Java, or Python for data processing and scripting.
- Experience working with relational databases, such as one of the database types: PostgreSQL, MySQL, Oracle, or MS SQL Server.
- Understanding of document databases, such as one the database types: Elasticsearch, Redis, MongoDB, or Apache Solr.
- Excellent communication and collaboration skills, especially in an Agile culture environment.
- Experience with container orchestration, such as AWS EKS or Kubernetes
- Experience with databases, and object storage services, such as PostgreSQL, ElasticSearch, Redis, and AWS S3.
- Experience with data streaming platforms, such as Apache Kafka or Apache Nifi.
- Knowledge of data integrated from various sources, such as web services, APIs, and file systems.
- Strong problem-solving skills, attention to detail, and the ability to work independently and as part of a team.
- English proficiency
Hình thức
Quyền Lợi
At Crossian, our people are the key to our success. We believe in creating an attractive total compensation package (TCP) that not only retains employees but allows them to excel in their profession. These include:
- Competitive gross salary (Up To 20.000.000 VND depending on what you bring to the table)
- Full salary during probation
- 20 days work-from-home & 12 days of paid annual leave
- Global health insurance package for yourself and direct family members
- Guaranteed 13th month salary
- Quarterly bonus & Year-end bonus as part of our profit sharing program
- A Pantry & a Crossian Cafe stocked with goodies, ready to serve
- Lots of other company benefits including 5-star annual company trip, budget for frequent team building activities and other monthly / quarterly / annual company events
- General company T&D Program + dedicated T&D budget for managers
- Other benefits in accordance to Company's Policy and Vietnam Labor Laws