Azure Data Engineer – ETL Tools – QBrainX

Job Description

Position: Senior Azure Data Engineer
Experience Level: 10 to 12 years
Location: Coimbatore / Remote / Work From Home

Role Overview:

As a Senior Azure Data Engineer, you will design, implement, and maintain efficient and secure data solutions using Azure Data Factory. This role demands strong business acumen and exceptional communication skills, with the ability to articulate complex technical concepts to stakeholders at all levels.

Key Responsibilities:

• Azure Data Factory Development: Design and develop data pipelines using Azure Data Factory (ADF) to facilitate the efficient and secure transfer of data across various platforms.
• Stored Procedure Writing: Create and optimize SQL Server stored procedures to support data transformation, loading, and retrieval processes.
• SQL Server Tables & View Design: Design and implement robust SQL Server tables and views, ensuring they meet business requirements and performance standards.
• Performance Optimization: Continuously monitor and optimize the performance of SQL queries, stored procedures, and ADF pipelines to ensure optimal efficiency and speed.
• ETL Pipeline Construction: Develop and manage end-to-end ETL (Extract, Transform, Load) processes, ensuring data accuracy, completeness, and timeliness.
• PowerShell Scripting: Write and optimize PowerShell scripts for data extraction, transformation, and loading (ETL) processes. Automate data refresh and other routine tasks using PowerShell.
• Power BI Data Modeling: Design and optimize data models and handle data-related queries within Power BI.
• Business Acumen: Utilize strong business acumen to understand company objectives and how data solutions can support these goals, providing strategic advice and insights.
• Communication Skills: Employ articulate communication skills to effectively convey complex technical information to non-technical stakeholders, ensuring clarity and understanding.
• Continuous Learning & Adaptation: Stay abreast of the latest developments in Azure data platform technologies. Continuously learn and adapt to new tools and techniques to maintain a competitive edge.

Requirements:

• Experience: Minimum of 10 years managing and developing solutions on the Azure data platform.
• Technical Skills: Extensive experience with Azure Data Factory, SQL Server database design, and ETL processes. Proven track record of performance optimization in data management systems.
• Analytical Skills: Strong analytical skills and business acumen.
• Communication: Excellent communication and interpersonal skills.
• Performance: Demonstrated ability to deliver high-quality results swiftly and efficiently.
• Availability: Committed to meeting project deadlines and achieving excellence.

Role Competencies:

• Collaboration: Collaborate with team members and support the team effectively.
• Leadership Engagement: Work with the Leadership team to meet expectations based on value delivered and data feasibility.
• Product Development: Work closely with the Product Owner and Scrum Master to ensure the product delivers quality and value as expected by Leadership.
• Frequent Demos: Share frequent demos regarding the status, concerns, and questions from the team to the leadership for better clarity.