Senior Data Engineer – Spark/Scala/Python – Yulu

We are a forward-thinking Energy-as-a-Service company dedicated to shaping a sustainable future where transportation is accessible, affordable, and carbon-free. With the backing of leading mobility technology firm Magna and India’s premier shared electric micro-mobility player, Yulu, we proudly offer the largest Battery-as-a-Service (BaaS) platform in India for two-wheelers. Our platform revolutionizes urban mobility by providing reliable, convenient, and efficient access to energy.

Role Summary:

We are seeking a Senior Data Engineer to join our dynamic team. In this role, you will play a pivotal part in designing, building, testing, and maintaining scalable data platform solutions. Your expertise in crafting custom-built ETL solutions will be instrumental in addressing complex and challenging business problems.

Key Responsibilities:

• Design, construct, and uphold efficient and scalable data pipelines for collecting, transforming, and loading data.
• Develop both Logical and Physical Data Models, encompassing data warehouse and data mart designs.
• Implement various tests to identify data quality issues such as duplicates, null counts, and data drifts.
• Proactively seek opportunities to optimize pipelines for enhanced performance.
• Collaborate with multiple stakeholders to gather requirements and understand project scopes.
• Coordinate with upstream and downstream teams to ensure seamless execution of data pipelines.
• Maintain various dashboards containing business-critical metrics.

Key Requirements:

• Bachelor’s degree in Computer Science or equivalent, with a minimum of 3 years of relevant experience.
• Proficiency in one or more programming languages such as Python, Go, or Scala.
• Familiarity with frameworks like Hive, Presto, Spark, PySpark, and Apache Airflow.
• Strong understanding of large-scale distributed systems, including multi-tier architectures, application security, monitoring, and storage systems.
• Exposure to streaming data use cases, such as Kafka or structured streaming.
• Solid grasp of algorithms and data structures.
• Excellent communication skills.

Mandatory Skills:

• Proficiency in Spark, Scala/Python, SQL, and AWS.

We Assure You:

• A supportive and collaborative work culture where your ideas and opinions are valued.
• Exciting opportunities for growth and development in a rapidly expanding and sustainable industry.