Data Solution Architect

Overview

Data Solution Architect Jobs in Riyadh, Saudi Arabia at Silver Edge Arabia

Role: Data Solution Architect

Location: Kingdom of Saudi Arabia (Onsite)

Salary: up to 40,000 SAR pm dependent on experience

Engagement Type: Full-Time, 12 month Contract

About Our Client

Our client is a leading organization undertaking a massive, mission-critical data transformation. On their behalf, we are seeking an elite Data Solution Architect to pioneer the design, implementation, and hardening of a massive enterprise on-prem Data Lakehouse. This is a high-visibility role for a true visionary who thrives in deep-tech enterprise environments, blending advanced architectural strategy with hands‑on technical governance.

Role Summary

As the Data Solution Architect, you will lead the end-to-end architecture of a production-grade, on-prem Data Lakehouse utilizing Cloudera CDP 7.3.1. You will define the Target State Architecture (TSA) across platform, data, integration, and security layers. Your core mission will be establishing a structured Medallion model (Bronze/Silver/Gold) and a robust Lambda Architecture that converges high-throughput batch processes with low-latency streaming paths.

Additionally, you will architect a custom, metadata-driven Declarative Rules Engine for enterprise-wide business validations and design a highly secure, audit‑ready Data Governance framework utilizing Cloudera Shared Data Experience (SDX).

Core Responsibilities

• Architecture & Platform Topology (CDP 7.3.1): Lead the HLD/LLD for the Lakehouse. Size clusters, define storage/compute topologies (HDFS/Ozone, YARN), and strategically select table formats/engines based on workload fits (
  Iceberg, Hudi, Kudu, HBase, and Phoenix
  ). Establish performance guardrails against small-file issues and optimize compaction.
• Medallion & Data Modeling: Define data contracts, schema evolution rules, folder/table naming conventions, and DQ checkpoints across Bronze, Silver, and Gold layers. Unify serving models for OLAP (Impala) and low‑latency lookups (Phoenix).
• Lambda Architecture (Batch + Speed): Design batch pipelines using Informatica BDM (DEI) and Spark/Hive for bulk ingestion and SCD Type 1/2 processing. Concurrently, design real‑time streaming paths using NiFi/Kafka, Hudi (for incremental upserts), and Kudu/HBase for sub‑second access.
• Declarative Rules Engine: Architect a JSON/YAML or DB‑driven rules engine to manage validations, survivorship, and PII handling. Ensure the runtime engine is seamlessly callable via Informatica maplets, Spark, and streaming processors.
• Enterprise Governance & Security: Harden perimeter security via Knox, Kerberos, TLS, and AD/LDAP. Implement Ranger RBAC, tag‑based policies, and row/column masking. Stand up Apache Atlas for end‑to‑end lineage capture and data classifications.
• Dev Ops, Observability & DR: Establish CI/CD pipelines for cluster configs and rules packs. Build comprehensive SLA/SLO dashboards in Cloudera Manager. Architect a resilient Disaster Recovery plan using BDR/Replication Manager and lead semi‑annual DR drills.
• Stakeholder Leadership: Act as the technical authority at Architecture Review Boards (ARB). Collaborate with Domain SMEs, Security, and Platform Teams. Mentor and guide engineering teams on SQL optimization and pipeline best practices.

Required Qualifications (Must-Haves)

• Experience: 10+ years of dedicated data architecture/engineering experience, with at least 3–5+ years specifically architecting production‑grade environments on Cloudera (CDH/CDP).
• Lakehouse Delivery: Proven track record of designing and delivering on‑prem Lake houses leveraging Medallion and Lambda architectures.
• Informatica Expertise: Deep understanding of Informatica DEI (BDM) suite for framework design, parameterization, and pushdown execution to Spark/Hive.
• Storage & Query Engines: Practical, deep technical exposure to Apache Iceberg, Apache Hudi, Apache Kudu, HBase + Phoenix, Hive 3, and Impala (including partitioning, compaction, and cost‑based tuning).
• Security & SDX: Expert‑level knowledge of Kerberos, TLS, AD/LDAP, Ranger policies, and Atlas lineage tracking within the Cloudera SDX ecosystem.
• Rules & Frameworks: Experience designing metadata‑driven rules engines and DQ frameworks for both streaming and batch…

Title: Data Solution Architect

Company: Silver Edge Arabia

Location: Riyadh, Saudi Arabia

Category: