Data Engineer Lead
Data Engineer Lead
Overview We are looking for a Lead Data Engineer who will help in implementing data analytics products using on-prem and cloud data platforms. Position Responsibilities:
As a Lead Data Engineer, you will:
• Design and build scalable, cloud-native data platforms for modern data engineering practices.
• Mentor and guide other engineers, sharing knowledge, reviewing code, and fostering a culture of curiosity, growth, and continuous improvement.
• Create robust, maintainable ETL/ELT pipelines that integrate with diverse systems and serve business-critical use cases.
• Lead by example—write high-quality, testable code and participate in architecture and design discussions with a long-term view in mind.
• Decompose complex problems into modular, efficient, and scalable components that align with platform and product goals.
• Support data governance and quality efforts, ensuring data lineage, cataloging, and access management are built into the platform.
• Participate in architectural discussions, iteration planning, and feature sizing meetings
SKILLS:
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and cloud data platforms - databricks).
• High proficiency in using Python, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi), SQL to build Big Data products.
• Hands-on experience with cloud data platforms such as databricks, snowflake (databricks preferred)
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, or Talend.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Experience developing Java based applications is an added advantage
hybrid GDL offices techM
remote
- Client
- Engineering
- Estado remoto
- Completamente remoto
- Cliente
- Techmahindra
Acerca de Valce Talent Solutions
We help our clients enhance their talent attraction capacities, especially in technological profiles.
We constantly innovate and actively seek to find the best solutions for clients and professionals. We understand the needs of our customers and aim to be the industry specialists.
We offer consulting services to technology companies in various areas, including IT, software development, cybersecurity, and project management. Our employees are the reason for the company's existence, and their satisfaction translates into that of our customers.