Principal AI Platform Architect

1 day ago


Muscat, Muscat, Oman Orki Full time

About Orki

Orki is an AI-native SaaS company on a mission to revolutionize operations for online businesses in the MENA region. We provide a powerful platform that allows businesses to deploy and orchestrate a team of specialized AI agents across their entire operation. From AI Personal Account Executives (PAEs) that supercharge sales and customer service to agents that manage marketing campaigns , competitor monitoring , and back-office tasks , Orki digitizes the "dream team" for any online business. Our core goal is to transform fragmented outreach into a continuous, personalized relationship, enabling true 1:1 relationship marketing at scale.

The Opportunity

We are seeking a visionary Principal AI Platform Architect to be the mastermind behind the entire cloud and AI infrastructure that powers Orki. This is not a role for maintaining legacy systems; you will be building the highly scalable, resilient, and multi-cloud foundation for our next generation of AI agents from the ground up. You will architect the core platform that will handle millions of customer interactions, power our AI/LLM serving capabilities, and enable us to scale to tens of thousands of businesses across the MENA region.

What You'll Drive:

  • Core AI Cloud Platform Architecture: Design and implement our primary cloud platform as a distributed, event-driven system capable of processing millions of real-time transactions. This platform is the backbone of our AI Agents.
    • LLM & Agentic Systems Infrastructure: Lead the architecture for our AI/LLM serving stack (e.g., vLLM, TGI), RAG pipelines, and agent orchestration frameworks. You will build the environment where our hyper-specialized and voice-based agents will operate.
      • Hybrid & Multi-Cloud Strategy: Architect a multi-region, multi-cloud (GCP, AWS, on-prem, etc.) strategy with seamless failover and data consistency to ensure 24/7 availability for our e-commerce clients. Design deployment models that support both cloud-native and on-premises Kubernetes.
        • Scalable Developer Platforms: Champion GitOps and DevOps best practices to create a self-service developer platform with "golden paths," enabling our teams to build, deploy, and scale new features and AI capabilities rapidly and securely.
          • Observability and Performance Excellence: Engineer a world-class observability framework using OpenTelemetry, distributed tracing, and advanced monitoring to ensure our platform meets stringent SLIs/SLOs for latency and reliability. Implement chaos engineering and automated performance optimization.
            • FinOps & Cost Optimization: Build and automate sophisticated cost optimization systems for both cloud infrastructure and AI/LLM inference workloads, ensuring operational efficiency as we scale.

Core Technical Requirements

  • Must-Have Expertise:
  • 8+ years in distributed systems architecture with proven, enterprise-scale implementations.
  • Deep, hands-on expertise in cloud platforms (e.g. GCP and AWS) with multi-cloud experience.
  • Production mastery of Kubernetes at scale (GKE/EKS, operators, CRDs, multi-tenancy).
  • Expert-level knowledge of event-driven architectures (Kafka, Pub/Sub, EventBridge, NATS).
  • Proven experience implementing service mesh technologies (Istio, Linkerd, Consul).
  • Deep understanding of distributed databases (e.g., Spanner, DynamoDB, CockroachDB).
  • Excellence in Infrastructure as Code (Terraform/Pulumi) and GitOps (ArgoCD/Flux).
  • Strong programming skills in Python or C# (expertise in both is highly valued).
    • Essential AI/LLM Infrastructure Experience:
    • Experience building and scaling RAG pipelines with vector databases.
    • Familiarity with agent orchestration frameworks and MLOps principles.
    • Experience managing GPU clusters and optimizing inference workloads is a significant advantage.
      • Proven Experience:
      • Architecting systems handling 100K+ RPS with sub-second latency.
      • Implementing zero-trust security architectures.
      • Building scalable developer platforms that accelerate engineering velocity.

Why Join Orki?

  • Build from the Ground Up: This is a rare greenfield opportunity to architect a cutting-edge AI platform without the constraints of technical debt.
    • Massive Impact: Your work will be the foundation of our entire company and will directly empower thousands of businesses.
      • Lead the Market: We are hyper-focused on the MENA region with a unique, culturally-aware AI, giving us a powerful competitive advantage.
        • Elite Partnerships & Traction: We are partnered with global tech leaders, have secured our initial funding round, and have a rapidly growing list of businesses signed up.
          • Experienced Leadership: You will work alongside a proven leadership team with deep expertise in AI, management, and software architecture.

If you are a visionary architect passionate about building from the ground up and this role excites you, we encourage you to apply, even if your experience doesn't perfectly match every requirement on our list. We value a builder's mindset and a passion for innovation above all else.

To Apply:

Please click the "Apply" button on this post to begin the application process.

  • Ensure your resume is submitted in PDF format only. Applications with resumes in other formats may not be reviewed.
  • While not mandatory, we highly recommend including a brief cover letter (as a PDF) that highlights your specific experience architecting large-scale cloud and AI/ML infrastructure.

Orki is a proud equal opportunity employer. We are committed to building a diverse and inclusive team that will redefine e-commerce in the MENA region. With the support of key partners like Omantel, NVIDIA, and Huawei, we are on a rapid growth trajectory and look forward to reviewing your application.

#J-18808-Ljbffr

  • Muscat, Muscat, Oman beBeeSoftware Full time 12,000 - 15,000

    Job TitleSenior Software Architect - AI Driven Telecom PlatformAbout the RoleWe are seeking an experienced Senior Software Architect to lead the development of our cutting-edge AI-driven telecom platform. As a key member of our team, you will be responsible for defining and driving the technical vision, architecture, and development strategy for our...


  • Muscat, Muscat, Oman TAT IT Technolgies Full time

    Urgent Requirement: Technology Architect – Data Platform Implementation (Financial Services)We are seeking an experienced Technology Architect to lead the architecture and implementation of integrated data platforms for a banking client in Oman.Key Responsibilities:Architect and implement highly integrated data platforms aligned with business needs and IT...


  • Muscat, Muscat, Oman beBeeMachineLearning Full time 9,750 - 11,250

    About the RoleOur organization seeks a skilled expert to lead AI-first deep infrastructure analytics tool development.Key Responsibilities:Design, architect, and develop an AI-first platform combining front-end and back-end technologies.Develop and deploy advanced AI models and algorithms using machine learning, deep learning, and reinforcement learning...

  • Senior AI Engineer

    1 day ago


    Muscat, Muscat, Oman Orki Full time

    About OrkiOrki is an AI-native SaaS company on a mission to revolutionize operations for online businesses in the MENA region. We provide a powerful platform that allows businesses to deploy and orchestrate a team of specialized AI agents across their entire operation. From AI Personal Account Executives (PAEs) that supercharge sales and customer service to...


  • Muscat, Muscat, Oman Elile Full time

    We are seeking an experienced AI Expert and Consultant to join our National Large Language Model (LLM) Project, replacing ChatGPT usage in the workplace. As a key technical advisor, you will provide expertise across the full LLM stack, from model training and fine-tuning to deployment and RAG implementation.Key Responsibilities:Provide strategic guidance and...


  • Muscat, Muscat, Oman Canonical Full time

    Join to apply for the IoT Platform Engineer role at Canonical1 month ago Be among the first 25 applicantsJoin to apply for the IoT Platform Engineer role at CanonicalCanonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough...

  • Lead AI

    4 weeks ago


    Muscat, Muscat, Oman Byanat Full time

    We are looking for a dynamic and hands-on Lead AI & Engineering professional to spearhead our efforts in developing the next generation of AI-first deep infrastructure analytics tools. In this role, you will lead the architecture and development of our AI-first platform, ensuring the seamless integration of front-end and back-end technologies while guiding a...

  • Enterprise Architect

    3 weeks ago


    Muscat, Muscat, Oman Migrate Full time

    Enterprise Architect (EA) – Job DescriptionJob Title: Enterprise Architect (EA)Location: Oman (Hybrid/On-Site based on client needs)Employment Type: Full-timeKey ResponsibilitiesDesign enterprise architectures aligned with Oman Vision 2040 and the Oman eGovernance Framework.Optimize and modernize legacy systems for cloud-readiness and system...


  • Muscat, Muscat, Oman beBee Careers Full time 9,000 - 11,000

    Enterprise Architect OpportunityWe are seeking an Enterprise Architect to join our team. As an Enterprise Architect, you will be responsible for designing and optimizing enterprise architectures.This role involves working closely with business units to ensure seamless system integration and collaboration on architecture models and repositories.The ideal...

  • AI Quality Engineer

    4 days ago


    Muscat, Muscat, Oman Elile Full time

    We are seeking a highly skilled AI Quality Engineer to join our National Large Language Model (LLM) Project. This key role will focus on establishing and implementing robust data quality frameworks, evaluation methodologies, and quality gates throughout the LLM development lifecycle. The ideal candidate will ensure our Arabic LLM meets the highest standards...