Job Description:
- Collaborate with execution teams throughout the project lifecycle, providing technical expertise to deploy medium to large-scale data solutions using modern data and analytics technologies on both on-premise and cloud platforms.
- Develop comprehensive technical, security, data, and operational architecture and design frameworks utilizing modern data technologies and cloud data services to support modernization initiatives.
- Demonstrate proficiency in presenting technical topics to various audiences.
- Evaluate solution alternatives based on technical and business parameters to support cost-effective and service-oriented outcomes.
- Stay updated on emerging technologies, methodologies, and market offerings relevant to client needs.
- Design appropriate data models for transactional and big data environments to support Machine Learning processes.
- Mandatory strong experience in Scala/Python development.
- Possess 5-7+ years of experience in Data Engineering, including distributed architectures, ETL, EDW, and Big Data technologies.
- Highly desired experience with Big Data Stack (Hadoop, HBase, Hive, Zookeeper, Yarn), streaming tools like Kafka, orchestration tools like Airflow, and Nifi.
- Mandatory demonstrable knowledge and experience using Google Cloud BigQuery.
- Highly desired experience with DataProc and DataFlows on Google Cloud Platform.
- Familiarity with DWBI modeling and ingestion framework highly regarded.
- Extensive experience working with SQL across various databases.
- Experience with structured and unstructured data sources using cloud analytics platforms like Cloudera, Hadoop, etc.
- Familiarity with Data Mapping, Modeling, and Analytics tools.
- Proficiency in one or more programming or scripting languages such as Scala, Python, JavaScript, Java, R, UNIX Shell.
- Experience with Google Cloud Services such as Streaming + Batch, Cloud Storage, Cloud Dataflow, DataProc, DFunc, BigQuery, and BigTable.
- Exceptional interpersonal and teamwork skills, with experience in collaboration using tools like Jira, Confluence, and others.
- Excellent written and verbal communication skills, coupled with intellectual curiosity, problem-solving passion, and a focus on consulting and customer service.
More Information
- Experience 5-10 Years