Mô Tả Công Việc
Reporting to the Manager, Data Engineer you will be responsible for :
● Collaborate in an agile Squad to understand analytics needs of business and Data Analysts, assist with all data-related technical issues and support their data infrastructure needs.
● Assemble large, complex data sets from 1 st , 2 nd and 3 rd party data sources to meet analytics needs, using appropriate technology solutions including web data scrapper, RESTful API, and/or ETL/ELT tools
● Implement data lake, data warehouse and data marts in accordance to the approved data pipeline design and architecture
● Build infrastructure and tools required for optimal extraction, transformation, and loading of data from a wide variety of data sources
● Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and stability, etc.
Yêu Cầu Công Việc
In order to succeed in the role, you should ideally have:
● Degree in Computer Science, Computer Engineering, Information Systems or another quantitative field
● Up to 2-3 years experience working as Data Engineer
● Working SQL knowledge and experience working with relational databases and query authoring (SQL)
● Working experience with 1 or more languages / frameworks: Python, Java, JavaScript, Selenium
● Strong interest to learn and develop skills in analyzing and implementing data pipelines for structured and unstructured data.
● Experience with AWS (EC2, S3, Lambda, RDS, EMR, Redshift, Glue) is an added advantage
● Experience with RDBMS (PostgreSQL) and NoSQL (Dynamo) databases is an added advantage
● Experience with Big Data tools (Hadoop, Spark, Kafka) is an added advantage
● Experience with ETL tools (Airflow, Airbyte, Talend) is an added advantage
Hình thức
Quyền Lợi
Hone your creativity, invent and innovate, and set your own highest standards within a nurturing, equal opportunity environment. With our tremendous growth, we seek dynamic, entrepreneurial and broad-minded individuals to join us.