Head of Data Engineering ZainTech

Responsibilities:

• Own the end-to-end architecture and evolution of data platforms, including on prem (e.g., Cloudera / Hadoop), private cloud, and public cloud (e.g., Azure, AWS, GCP).
• Define and champion reference architectures for: o Data lakes, data warehouses, and lake houses. o Real-time and batch data integration. o Metadata, lineage, and observability.
• Collaborate with Enterprise / Solution Architects to: o Evaluate and select technologies, tools, and services. o Ensure scalability, performance, reliability, and cost-efficiency.
• Design hybrid data patterns (e.g., PII kept on-prem, analytics/AI in cloud, edge to-cloud integration) to meet local regulatory and data residency requirements.

Leadership & Collaboration

• Build, lead, and mentor a high-performing data engineering team, including hiring, performance management, career development, and succession planning.
• Foster a culture of engineering excellence, continuous learning, and innovation within the team.
• Collaborate closely with: o Cloud, Cybersecurity, and Infrastructure teams (environment, access, security). o Digital Solutions and Application teams (APIs, integration with apps and services). o Sales and Presales (feasibility checks, solution design, effort estimation for RFPs).
• Promote strong collaboration with client and partner teams, ensuring clear communication of technical decisions, risks, and trade-offs.

Delivery, Operations & Reliability

• Lead the end-to-end delivery of data engineering projects and workstreams, from design and build through testing, deployment, and transition to operations.
• Oversee the implementation of CI/CD and automation for data pipelines, including testing, deployment, and monitoring.
• Ensure data platforms and pipelines meet defined SLAs, SLOs, and non functional requirements (performance, availability, security, resilience).
• Implement and monitor data observability and quality controls (e.g., data validation, anomaly detection, lineage tracking).
• Work with Operations teams to establish runbooks, incident management, and continuous improvement of platform reliability.

Technology & Innovation

• Stay up-to-date with industry trends and emerging technologies in big data, cloud data services, real-time analytics, and MLOps.
• Evaluate and recommend new tools, platforms, and approaches that improve speed, quality, and cost of data delivery.
• Drive innovation initiatives, PoCs, and accelerators (e.g., new ingestion patterns, real-time data mesh, metadata-driven pipelines).
• Provide input into productization and packaging of ZainTECH data offerings (e.g., reusable blueprints, managed data platform services).

Opportunity & Solution Shaping

• Work closely with Sales and Account Managers to qualify opportunities and identify client challenges across data platforms, data governance, analytics, and AI.
• Lead solution discovery workshops with customers to understand business objectives, current architecture, constraints (e.g., data residency, security, PII on-prem), and success criteria.
• Translate business requirements into high-level and detailed solution designs, covering:
• Data ingestion and integration (batch, real-time/streaming). o Data lake / data warehouse / lakehouse architectures.
• BI & self-service analytics.
• AI/ML workloads and MLOps.
• Data governance, catalog, and quality.

RFP / RFI / Proposal Leadership

• Own the technical sections of RFP/RFI responses for data and AI solutions across multiple technologies (on-prem and cloud).
• Analyze RFP requirements, scope, and scoring criteria; design winning strategies and answer templates for technical, functional, and non-functional requirements.
• Coordinate with internal teams (Data Engineering, Architecture, Delivery, Finance) to: o Estimate efforts and timelines.
• Define implementation phases and milestones.
• Prepare BoQ/BOM, licensing estimates, and cost assumptions.
• Prepare clear, structured proposal content including solution overviews, architectures, implementation plans, assumptions, risks, and value propositions.
• Ensure proposals are aligned with ZainTECH standards, reusable accelerators, and partner best practices.

Architecture & Technology (On Prem and Cloud)

• Design hybrid architectures leveraging both on-premise platforms (e.g., Cloudera, Hadoop ecosystem) and cloud (Azure, AWS, GCP), depending on client constraints and preferences.
• Define reference architectures for:
• On-prem data platforms (e.g., Cloudera CDP, Hadoop/Spark, on-prem object storage).
• Cloud-native data platforms (e.g., Azure Synapse/Fabric, AWS Redshift/EMR, GCP BigQuery/Dataproc).
• Hybrid scenarios (data gravity on-prem, analytics or AI in cloud, PII data residency, etc.).
• Collaborate with Delivery and Architecture teams to validate feasibility, performance, and scalability of proposed solutions.

Demonstrations, PoCs, and Client Engagement

• Prepare and deliver technical presentations, live demos, and tailored PoCs for data platforms, governance, analytics, and AI use cases.
• Build or supervise PoC architectures and quick prototypes showcasing:
• Ingestion from key source systems (ERP, CRM, billing, sensors, logs, etc.).
• Data models and curated layers.
• Analytics dashboards and AI/ML use cases (e.g., churn, recommendation, anomaly detection).
• Collect client feedback and incorporate into solution refinement and product/offer roadmap.

Collaboration with Vendors and Partners

• Work closely with strategic partners (e.g., Microsoft, Cloudera, Informatica, Databricks, etc.) to:
• Align on recommended architectures and best practices.
• Validate sizing, licensing, and deployment patterns (on-prem, IaaS, PaaS, SaaS).
• Prepare joint presentations, PoCs, and reference architectures.
• Ensure ZainTECH s proposals leverage partner programs, incentives, and co selling frameworks where applicable.