Job Description Senior Associate Data Engineering Level 2

As a Senior Associate L2 in Data Engineering, your role is pivotal in translating client requirements into technical designs and implementing components for data engineering solutions. Your impact spans across various stages of data processing, including ingestion, integration, transformation, storage, computation frameworks, analytics, visualizations, infrastructure, and cloud computing Big Data technologies. You will be responsible for building functionality for data ingestion from heterogeneous sources, analytics, search, and aggregation.

Your Skills & Experience:

  • Proficient with the Hadoop stack, including HDFS, Sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, Hive, Oozie, Airflow, and other essential components for developing end-to-end data pipelines.
  • Strong programming skills in at least one language: Java (preferred), Scala, Python.
  • Working knowledge of NoSQL and MPP data platforms such as Hbase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery.
  • Proficiency in data platform-related services on AWS.
  • 6 to 8 years of work experience with a Bachelor’s degree or equivalent combination of education, training, and experience.

Set Yourself Apart With:

  • Familiarity with traditional ETL tools (Informatica, Talend) and databases (Oracle, MySQL, SQL Server, Postgres) with hands-on experience.
  • Understanding of data governance processes (security, lineage, catalog) and tools like Collibra, Alation.
  • Knowledge of distributed messaging frameworks (ActiveMQ, RabbitMQ, Solace), search & indexing, and Microservices architectures.
  • Expertise in performance tuning and optimization of data pipelines.
  • Cloud data specialty and relevant Big Data technology certifications.

Benefits of Working Here:

  • Gender-Neutral Policy.
  • 18 paid holidays annually.
  • Generous parental leave and new parent transition program.
  • Flexible work arrangements.
  • Employee Assistance Programs for wellness and well-being.

More Information

Apply for this job
Share this job