Mô Tả Công Việc
As a Big Data Platform in ZaloPay, we are developing a high-quality data warehouse that can address business problems, provide data insight to each business aspect, transform product to Data-driven decision making manner. We are looking for an Engineer who will join our team to be responsible for building out the data pipelines (data ingestion framework and ETL processing) that are scalable and reusable. This role will work with other cross functional teams to help build and support the next generation of data platform.
Responsibilities:
- Possess an understanding of the data structures and governance.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Design and maintain optimal data pipeline architecture.
- Assemble large, complex data sets to build data mart that meet functional/non-functional business requirements.
- Communicate effectively with Developers and Business users to understand and clarify requirements.
- Support internal training and proper documentation ensuring the successful onboarding of new team members
- Implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases built on the platform
Yêu Cầu Công Việc
- Bachelor’s degree in computer science, engineering, mathematics, or a related technical discipline.
- 3+ years’ experience working as a Data Engineer role, ETL with large amounts of data.
- Experience with data warehousing architecture and data modeling, ETL data pipeline.
- Experience with using the following software/tool in big data field.
- Big data tool: Hadoop, Apache Spark, Presto, Kafka, etc.
- NoSQL and OLAP database: MongoDB, Clickhouse, Elastic search, etc.
- Data pipeline and workflow management tools: Luigi, Airflow, etc.
- Good at programming languages: Scala, Python, Java.
- Data governance: Apache Atlas.
- Experience with SRE, Patching & Automation: Kubernetes or Docker & Containerization
- Experience in data testing process.
- Experience in performing root cause analysis, identify problems and propose recommendations for improvement.
- Strong organizational and multitasking skills with ability to balance competing priorities
- Fundamental knowledge of modern cloud computing platforms and concepts is a plus.
Hình thức
Quyền Lợi
We hope VNG is a place where you build your career. Whether you want to pursue to be a manager or focus on professional development, we acknowledge and appreciate your talents. Therefore, we open up to you more promotion opportunities in VNG, and designed program to help you succeed in every single career path.
NO SUIT, NO TIE: At VNG, we do not have many rules because we respect you and want to make comfortable atmosphere to help employees perform their jobs well.
Company “pay” for you: Lunch, parking, swimming, learning English or gym for free and you know you are really in care.
NO BARRIERS: Office of VNG is an open space because we always try to remove all barriers to help members easily shares with each other.
Being a big family: Like a gift for family day. A party for the kids. We know how much your family matters.
NO RANK At VNG, members are encouraged to contribute ideas and debate with the others.
Be explored: Ph.D., un-academic guy, bookish girl, fashion designers ... VNGers are different and this diversity makes life more colorful.
NO "OFFICE": Office is like your home. You can hang paintings, plant trees, even feed aquarium on the desk.
Be showed your best: VNGers like to "mortification" with the group games such as: Fansipan climbing, waterfall rafting, go over heat mats; there activities not only are tightening friendship, but also practice their bravery.
GAMING: Even if you do not make the game, stealing beans in the boss’s garden or versusing with your colleagues in a sword competition play online is also an interesting way to relax.
Changing the world: Creating an entertainment channel, building a social network and developing a game. On the Internet world, every single thing you did can change the lives of many people.
Let’s join VNG to share our mission: 'MAKE THE INTERNET CHANGE VIETNAMESE LIVES'