Distributed Systems Architect: Bare-Metal and High-Scale

You will own the architectural blueprints for Analog’s on-premises open-source infrastructure, designing the clustering, replication, and failover topologies across messaging, streaming, and database layers that our DevOps team then automates at scale across client deployments. This is a hands-on, implementation-grade architecture role where the quality of your output directly determines whether a physically isolated or air-gapped client environment survives hardware failure at petabyte scale. What You’ll Do Open-Source Infrastructure Mapping • Map Analog’s Azure PaaS components to open-source equivalents: Event Hub to Kafka/Redpanda, IoT Hub to EMQX, ADX to ClickHouse or Apache Druid, and Blob Storage to Ceph/MinIO • Produce side-by-side equivalence assessments documenting feature gaps, operational differences, and migration risk for each component transition • Validate client hardware specifications and assess compliance with air-gap security requirements prior to each deployment Cluster and Topology Design • Design multi-node clustering, rack-aware replication, and quorum topologies for bare-metal Kafka/Redpanda and PostgreSQL (Patroni) clusters • Design resilience protocols for hardware and network switch failures in physically isolated or air-gapped client environments • Architect RocksDB state backend tuning for stateful Apache Flink workloads, including compaction strategy, block cache sizing, and write-ahead log configuration Linux and Hardware Optimization • Tune Linux kernel parameters, NUMA bindings, network ring buffers, and NVMe I/O scheduler configurations to eliminate hardware bottlenecks under petabyte-scale write workloads • Define CPU affinity, IRQ balancing, and huge page configurations for latency-sensitive broker and database processes • Author reproducible benchmark harnesses to validate configuration changes against client hardware before production rollout Blueprints and DevOps Enablement • Deliver precise, implementation-ready configuration blueprints and runbooks for Terraform and Ansible automation, documents the DevOps team can execute without architectural interpretation • Maintain a library of parameterized reference architectures covering single-rack, multi-rack, and geographically distributed bare-metal topologies • Conduct pre-deployment reviews of client hardware specs and provide go/no-go assessments with remediation guidance What You’ll Bring • 10+ years architecting and operating distributed infrastructure at TB to PB scale in production environments • Expert-level Kafka or Redpanda clustering: partitioning strategy, ISR tuning, consumer group management, compaction policies, and operational lifecycle at scale • Deep Linux systems engineering: kernel networking subsystems (TCP buffer tuning, interrupt coalescing), storage fabrics, and NUMA-aware process binding • Proven track record deploying HA database clusters without cloud load balancers: Patroni, Pacemaker, or equivalent in production • Experience deploying software-defined storage (Ceph, MinIO) on physical hardware in production, including CRUSH maps, erasure coding, and performance tuning • Ability to produce implementation-ready blueprints and runbooks; your output must be directly actionable by a DevOps automation team without architectural interpretation About Analog Analog builds industrial intelligence infrastructure for the physical world. We deliver high-throughput data pipelines, real-time analytics, and edge-to-cloud connectivity for mission-critical environments where cloud dependency is not an option. Our clients operate in regulated, air-gapped, and physically demanding settings and they depend on us to get the infrastructure right from day one. This is a full-time, on-site role. Show more Show less

10+ years architecting and operating distributed infrastructure at TB to PB scale in production environments. Expert-level Kafka or Redpanda clustering: partitioning strategy, ISR tuning, consumer group management, compaction policies, and operational lifecycle at scale. Deep Linux systems engineering: kernel networking subsystems (TCP buffer tuning, interrupt coalescing), storage fabrics, and NUMA-aware process binding. Proven track record deploying HA database clusters without cloud load balancers: Patroni, Pacemaker, or equivalent in production. Experience deploying software-defined storage (Ceph, MinIO) on physical hardware in production, including CRUSH maps, erasure coding, and performance tuning. Ability to produce implementation-ready blueprints and runbooks; your output must be directly actionable by a DevOps automation team without architectural interpretation.

Open-Source Infrastructure Mapping: Map Azure PaaS components to open-source equivalents (Event Hub to Kafka/Redpanda, IoT Hub to EMQX, ADX to ClickHouse or Apache Druid, Blob Storage to Ceph/MinIO); produce side-by-side equivalence assessments documenting feature gaps, operational differences, and migration risk; validate client hardware specs and assess air-gap security requirements. Cluster and Topology Design: design multi-node clustering, rack-aware replication, and quorum topologies for bare-metal Kafka/Redpanda and PostgreSQL (Patroni) clusters; design resilience protocols for hardware and network switch failures in isolated or air-gapped environments; architect RocksDB state backend tuning for stateful Apache Flink workloads. Linux and Hardware Optimization: tune Linux kernel parameters, NUMA bindings, network ring buffers, NVMe I/O scheduler configurations; define CPU affinity, IRQ balancing, and huge page configurations; author reproducible benchmark harnesses. Blueprints and DevOps Enablement: deliver implementation-ready configuration blueprints and runbooks for Terraform and Ansible; maintain a library of parameterized reference architectures for single-rack, multi-rack, and geographically distributed bare-metal topologies; conduct pre-deployment hardware reviews with go/no-go remediation guidance.