Manager - Data Engineering Majid Al Futtaim

Responsibilities:

• Transform and improve performance of existing reporting & analytics use cases with more efficient and state of the art data engineering solutions
• Contribute to business analysis of the OLTP and OLAP data and in decision support with extensive database programming
• Understand business requirements in BI context and design data models to transform raw data into meaningful insights

Data Warehouse Architecture & Tools

• Build and maintain a scalable data lineage system to improve data infrastructure reliability and efficiency
• Build the infrastructure required for optimal ETL of data from a wide variety of data sources using SQL and big data technologies
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• Identify opportunities for data acquisition and build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
• Ensure the architecture will support all the business needs to drive actionable insights

Data Pipeline ETLs & Monitoring:

• Own end-to-end ETL process to build data pipelines, from planning to collection to analysis, including writing custom queries, data cleaning and manipulation, and the ability to work with large datasets
• Acquire data from primary or secondary data sources and maintain databases / data systems and in charge of ensuring consistent data quality on a continuous basis
• Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements
• Design, develop, test, and deploy scalable Power BI dashboards and develop real-time database solutions and pipeline to Power BI Dashboard
• Design ETL using SSIS Packages to reprocess any date data at any time using Reprocess Logic

Automation of Financial & Operations Reporting

• Write T-SQL Stored procedures for performing automation tasks, Performed and fine-tuned Stored Procedures and SQL Queries and User Defined Functions, and for Triggers, Constraints, and Indexes using various DDL and DML commands
• Maintain the Log and Audit information in SQL tables, experienced in providing Logging, Error Handling by using Event Handler for SSIS Packages
• Develop SQL queries /scripts to validate the data such as checking duplicates, null values, truncated values and ensuring correct data aggregations
• Perform data quality analysis using advanced SQL skills as well as Count Validation, Dimensional Analysis, Statistical Analysis and Data Quality Validation in Data Migration. Extensive SQL querying on Staging, Data warehouse and Data Mart
• Develop C# scripts in SSIS and automating tasks using C#

Coordination and Communication

• Ensure regular information exchange with all relevant stakeholders and update them on the acquired knowledge from the business intelligence analysis
• Build relationships and maintain strong partnerships with key personnel to help achieve organisational goals

Audit and Reporting

Perform ad-hoc BI analysis reports, proposing and presenting recommendations to senior management on strategic decisions, and planned future initiatives