Mô Tả Công Việc
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
- Develop and maintain data pipelines using ETL processes.
- Work closely with data science team to implement data analytics pipelines.
- Maintain security and data privacy, working closely with data protection officer.
- Implement scalable architectural models for data processing and storage.
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode.
- Help in scoping, estimation, and planning to for various projects in the enterprise.
- Provide technical support to project teams as needed.
Yêu Cầu Công Việc
Must have Technical Requirements / Qualifications
- B.S. in Computer Science, related fields or commensurate work experience.
- 5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig… and ETL with large amounts of data.
- Experience on complex regulatory data integration projects.
- Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
- Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
- Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
- Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
- Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
- Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
- Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
- Agile based delivery knowledge
- Excellent English communication – verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
- Strong teambuilding skills and teamwork orientation.
- Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
- Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
- AZ-900: Microsoft Azure Fundamentals.
- Azure Data Engineer – Associate.
Hình thức
Quyền Lợi
Life at Capgemini is dynamic and fun, a place where people love to work. A career with freedom, full of learning and development opportunities and the support to help you achieve your best.
A career at Capgemini is rewarding and constantly transforming. Here are the top ten reasons why people love working at Capgemini.
1. Your values are our values:
We’re guided by seven core values: honesty, boldness, trust, freedom, team spirit, modesty, and fun. If you share those values, then you’ll find your place with us.
2. People come first
Through our People Charter, we encourage free exchange of ideas, respect for differences, and wellbeing in the workplace for everyone.
3. Never stop learning
At the Capgemini Group University, you’ll learn via classroom-based and virtual courses, e-learning modules and rich-media online resources.
4. Feel free to grow
Over the course of your career, your goals may shift. Want to change your focus? Switch tracks? We’re here to help.
5. Get inspired by your colleagues
Our cultural diversity means you’ll always have something to learn from those around you.
6. Forget the notion of the “typical day”
Challenge and variety are constants here. From the work you do to the people you meet to the places you travel, we’ll keep you on your toes.
7. Strike a balance that works for you
You’re human—and so are we! We strive to make sure our employees achieve a healthy, happy work-life balance.
8.Count on us for career growth
We’re always growing and so should you. We prioritize the personal development of our team members with our Capgemini Group University.
9.Your Love for Travel
We have 300 offices in 40 countries around the world. You’ll have opportunities to travel or work in different locations.
10.Dig in your first day
Whether you join us as a recent graduate or a seasoned professional, you’ll start to work directly on challenging projects from day one.