Senior/Lead Data Engineer (Python, SQL, NoSQL)

We are seeking a highly skilled and motivated Senior and Lead Data Engineer with a strong background in Google Cloud Platform (GCP) to join our dynamic team. As a Lead Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and infrastructure to support data ingestion, processing, and analysis. Your expertise in GCP technologies will be critical in shaping our data engineering strategy and ensuring the scalability, reliability, and performance of our data infrastructure.

Responsibilities:

• Lead and manage a team of data engineers, providing technical guidance, mentorship, and fostering a collaborative environment for driving innovation
• Design and implement robust data pipelines to ingest, process, and transform large volumes of data from various sources into usable formats for analytics and business insights
• Optimize and tune data pipelines for performance, efficiency, and cost-effectiveness on GCP, ensuring seamless data flow across systems
• Work closely with data analysts, data scientists, and stakeholders to understand data requirements and translate them into technical solutions
• Stay up-to-date with the latest advancements in GCP data engineering tools and services, and recommend appropriate technologies to improve the overall data engineering landscape
• Establish and enforce best practices, coding standards, and data governance policies for the data engineering team
• Collaborate with cross-functional teams to integrate data engineering solutions into data warehousing, business intelligence, and data visualization platforms
• Troubleshoot and resolve data pipeline issues, ensuring high availability and reliability of data processing workflows
• Monitor system performance, data integrity, and security measures, proactively identifying and resolving potential risks
• Participate in planning and executing data migration projects to transfer data from legacy systems to GCP infrastructure