
Principal AI Platform Architect
3 weeks ago
About Orki
Orki is an AI-native SaaS company on a mission to revolutionize operations for online businesses in the MENA region. We provide a powerful platform that allows businesses to deploy and orchestrate a team of specialized AI agents across their entire operation. From AI Personal Account Executives (PAEs) that supercharge sales and customer service to agents that manage marketing campaigns , competitor monitoring , and back-office tasks , Orki digitizes the "dream team" for any online business. Our core goal is to transform fragmented outreach into a continuous, personalized relationship, enabling true 1:1 relationship marketing at scale.
The Opportunity
We are seeking a visionary Principal AI Platform Architect to be the mastermind behind the entire cloud and AI infrastructure that powers Orki. This is not a role for maintaining legacy systems; you will be building the highly scalable, resilient, and multi-cloud foundation for our next generation of AI agents from the ground up. You will architect the core platform that will handle millions of customer interactions, power our AI/LLM serving capabilities, and enable us to scale to tens of thousands of businesses across the MENA region.
What You'll Drive:
- Core AI Cloud Platform Architecture: Design and implement our primary cloud platform as a distributed, event-driven system capable of processing millions of real-time transactions. This platform is the backbone of our AI Agents.
- LLM & Agentic Systems Infrastructure: Lead the architecture for our AI/LLM serving stack (e.g., vLLM, TGI), RAG pipelines, and agent orchestration frameworks. You will build the environment where our hyper-specialized and voice-based agents will operate.
- Hybrid & Multi-Cloud Strategy: Architect a multi-region, multi-cloud (GCP, AWS, on-prem, etc.) strategy with seamless failover and data consistency to ensure 24/7 availability for our e-commerce clients. Design deployment models that support both cloud-native and on-premises Kubernetes.
- Scalable Developer Platforms: Champion GitOps and DevOps best practices to create a self-service developer platform with "golden paths," enabling our teams to build, deploy, and scale new features and AI capabilities rapidly and securely.
- Observability and Performance Excellence: Engineer a world-class observability framework using OpenTelemetry, distributed tracing, and advanced monitoring to ensure our platform meets stringent SLIs/SLOs for latency and reliability. Implement chaos engineering and automated performance optimization.
- FinOps & Cost Optimization: Build and automate sophisticated cost optimization systems for both cloud infrastructure and AI/LLM inference workloads, ensuring operational efficiency as we scale.
- Observability and Performance Excellence: Engineer a world-class observability framework using OpenTelemetry, distributed tracing, and advanced monitoring to ensure our platform meets stringent SLIs/SLOs for latency and reliability. Implement chaos engineering and automated performance optimization.
- Scalable Developer Platforms: Champion GitOps and DevOps best practices to create a self-service developer platform with "golden paths," enabling our teams to build, deploy, and scale new features and AI capabilities rapidly and securely.
- Hybrid & Multi-Cloud Strategy: Architect a multi-region, multi-cloud (GCP, AWS, on-prem, etc.) strategy with seamless failover and data consistency to ensure 24/7 availability for our e-commerce clients. Design deployment models that support both cloud-native and on-premises Kubernetes.
- LLM & Agentic Systems Infrastructure: Lead the architecture for our AI/LLM serving stack (e.g., vLLM, TGI), RAG pipelines, and agent orchestration frameworks. You will build the environment where our hyper-specialized and voice-based agents will operate.
Core Technical Requirements
- Must-Have Expertise:
- 8+ years in distributed systems architecture with proven, enterprise-scale implementations.
- Deep, hands-on expertise in cloud platforms (e.g. GCP and AWS) with multi-cloud experience.
- Production mastery of Kubernetes at scale (GKE/EKS, operators, CRDs, multi-tenancy).
- Expert-level knowledge of event-driven architectures (Kafka, Pub/Sub, EventBridge, NATS).
- Proven experience implementing service mesh technologies (Istio, Linkerd, Consul).
- Deep understanding of distributed databases (e.g., Spanner, DynamoDB, CockroachDB).
- Excellence in Infrastructure as Code (Terraform/Pulumi) and GitOps (ArgoCD/Flux).
- Strong programming skills in Python or C# (expertise in both is highly valued).
- Essential AI/LLM Infrastructure Experience:
- Experience building and scaling RAG pipelines with vector databases.
- Familiarity with agent orchestration frameworks and MLOps principles.
- Experience managing GPU clusters and optimizing inference workloads is a significant advantage.
- Proven Experience:
- Architecting systems handling 100K+ RPS with sub-second latency.
- Implementing zero-trust security architectures.
- Building scalable developer platforms that accelerate engineering velocity.
Why Join Orki?
- Build from the Ground Up: This is a rare greenfield opportunity to architect a cutting-edge AI platform without the constraints of technical debt.
- Massive Impact: Your work will be the foundation of our entire company and will directly empower thousands of businesses.
- Lead the Market: We are hyper-focused on the MENA region with a unique, culturally-aware AI, giving us a powerful competitive advantage.
- Elite Partnerships & Traction: We are partnered with global tech leaders, have secured our initial funding round, and have a rapidly growing list of businesses signed up.
- Experienced Leadership: You will work alongside a proven leadership team with deep expertise in AI, management, and software architecture.
- Elite Partnerships & Traction: We are partnered with global tech leaders, have secured our initial funding round, and have a rapidly growing list of businesses signed up.
- Lead the Market: We are hyper-focused on the MENA region with a unique, culturally-aware AI, giving us a powerful competitive advantage.
- Massive Impact: Your work will be the foundation of our entire company and will directly empower thousands of businesses.
If you are a visionary architect passionate about building from the ground up and this role excites you, we encourage you to apply, even if your experience doesn't perfectly match every requirement on our list. We value a builder's mindset and a passion for innovation above all else.
To Apply:
Please click the "Apply" button on this post to begin the application process.
- Ensure your resume is submitted in PDF format only. Applications with resumes in other formats may not be reviewed.
- While not mandatory, we highly recommend including a brief cover letter (as a PDF) that highlights your specific experience architecting large-scale cloud and AI/ML infrastructure.
Orki is a proud equal opportunity employer. We are committed to building a diverse and inclusive team that will redefine e-commerce in the MENA region. With the support of key partners like Omantel, NVIDIA, and Huawei, we are on a rapid growth trajectory and look forward to reviewing your application.
#J-18808-Ljbffr-
Senior/Staff/Principal Engineer
1 week ago
Muscat, Muscat, Oman Canonical Full timeJoin to apply for the Senior/Staff/Principal Engineer role at Canonical3 days ago Be among the first 25 applicantsJoin to apply for the Senior/Staff/Principal Engineer role at CanonicalGet AI-powered advice on this job and more exclusive features.Canonical is a leading provider of open source software and operating systems to the global enterprise and...
-
AI Engineer
2 weeks ago
Muscat, Muscat, Oman PhazeRo Full timeAbout UsPhazeRo stands at the forefront of AI innovation, dedicated to bridging the gap between advanced technology and business solutions. We work across various sectors, such as Energy, Finance, and BioAI, to empower our clients with intelligent automation and data-driven insights. Our team is made up of visionary thinkers and expert engineers who are...
-
Senior AI Engineer
3 weeks ago
Muscat, Muscat, Oman Orki Full timeAbout OrkiOrki is an AI-native SaaS company on a mission to revolutionize operations for online businesses in the MENA region. We provide a powerful platform that allows businesses to deploy and orchestrate a team of specialized AI agents across their entire operation. From AI Personal Account Executives (PAEs) that supercharge sales and customer service to...
-
IoT Platform Engineer
4 weeks ago
Muscat, Muscat, Oman Canonical Full timeJoin to apply for the IoT Platform Engineer role at Canonical1 month ago Be among the first 25 applicantsJoin to apply for the IoT Platform Engineer role at CanonicalCanonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough...
-
Systems Integration Architect
3 weeks ago
Muscat, Muscat, Oman Byanat Full timeAs a Systems Integration Architect, you will be responsible for designing, developing, and managing the overall integration strategy of our observability platform. You will work closely with cross-functional teams—including engineering, data science, AI/ML, and telecom integration—to develop robust interfaces and middleware that connect disparate systems...
-
Senior System Architect
2 weeks ago
Muscat, Muscat, Oman NTG Full timeSenior System Architect Location: On-site (Oman) Salary: $6,000 USD/month*We are looking for a Senior System Architect with 10+ years of experience in system architecture, including 5+ years in a senior role. The ideal candidate will have expertise in TOGAF architecture, designing and implementing on-premise and multi-tenancy architectures, and working...
-
IT Solutions Architect
7 days ago
Muscat, Muscat, Oman beBeeDynamics Full time €75,000 - €90,000Senior Technical Architect RoleThis position involves collaborating with our client's Microsoft Business Solutions team, a renowned partner and leader in Microsoft software implementations for medium to large organisations.The successful candidate will be responsible for designing and implementing Dynamics CE & Power Platform solutions, ensuring seamless...
-
Enterprise Architect Opportunity
7 days ago
Muscat, Muscat, Oman beBee Careers Full time 9,000 - 11,000Enterprise Architect OpportunityWe are seeking an Enterprise Architect to join our team. As an Enterprise Architect, you will be responsible for designing and optimizing enterprise architectures.This role involves working closely with business units to ensure seamless system integration and collaboration on architecture models and repositories.The ideal...
-
Software Architect
3 weeks ago
Muscat, Muscat, Oman Canonical Full timeSoftware Architect - Containers, VirtualisationBachelor of Technology/Engineering (Automobile)Nationality: Any NationalityVacancy: 1 VacancyJob DescriptionWe are hiring a software architect for Canonical LXD and MicroCloud.Our goal is to make clusters of compute, with system containers or virtual machines, "just work". It should be trivial to stand up a...
-
AI Quality Engineer
4 weeks ago
Muscat, Muscat, Oman Elile Full timeWe are seeking a highly skilled AI Quality Engineer to join our National Large Language Model (LLM) Project. This key role will focus on establishing and implementing robust data quality frameworks, evaluation methodologies, and quality gates throughout the LLM development lifecycle. The ideal candidate will ensure our Arabic LLM meets the highest standards...