Senior Big Data Engineering Specialist

2 days ago

Muscat, Muscat, Oman beBeeBigDataExpert Full time 100,000 - 120,000
Job Title: Big Data Expert

We are seeking a highly skilled Senior Big Data Engineer with deep expertise in on-premises Big Data platforms, specifically the Cloudera ecosystem. The ideal candidate will have 12–15 years of experience building and managing large-scale data lakes, developing batch and real-time pipelines, and working with distributed data systems.

The primary focus is on on-premises Cloudera-based data lakes, but familiarity with cloud data services (AWS, Azure, or GCP) is considered an added advantage.

  • Data Pipeline Design: Design, build, and maintain on-premises data pipelines using Apache Spark, Hive, and Python on Cloudera.
  • Data Ingestion Workflows: Develop real-time data ingestion workflows using Kafka, tailored for telecom datasets (e.g., usage logs, CDRs).
  • Job Orchestration: Manage job orchestration and scheduling using Oozie, with data access enabled via Hue and secured through Ranger.
  • Data Security: Implement and manage data security policies (Kerberos, Ranger) to ensure compliance and controlled access.
  • API Development: Develop and expose REST APIs for downstream integration and data access.
  • Platform Performance: Ensure performance tuning, resource optimization, and high availability of the Cloudera platform.
  • Collaboration: Collaborate with data architects, engineers, and business stakeholders to deliver end-to-end solutions in a telecom context.
Required Skills & Experience:
  • 12–15 years of experience in Big Data engineering, with hands-on focus on on-premises data lake environments.
  • Extensive Telecom domain knowledge – including data models and pipelines related to CDRs, BSS/OSS, customer and network data.
  • Strong practical experience with:
  • Cloudera (CDH/CDP) components: Spark, Hive, HDFS, HBase, Impala
  • Kafka: configuration, topic management, producer/consumer setup
  • Python for data transformations and automation
  • Job orchestration via Oozie
  • Access control and metadata management using Ranger
  • Proficient in performance tuning, resource management, and security hardening of Big Data platforms.
  • Experience with API development and integration for data services.
  • Optional/Added Advantage: Exposure to cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc), hybrid architecture understanding.
Preferred Qualities:
  • Strong problem-solving and troubleshooting skills in distributed data systems.
  • Ability to work independently in a fast-paced project environment.
  • Effective communicator with both technical and business teams.
  • Experience in mentoring junior engineers or leading small technical teams is a plus.

  • Senior Infrastructure Specialist

    2 weeks ago

    Muscat, Muscat, Oman Oman Data Park Full time

    ROLE OBJECTIVEThe Redhat Senior Specialist focuses on exploring, implementing, and maintaining Infrastructure and systems solutions within the organization and customers' promises. Identifies appropriate Infrastructure and systems solutions that support ODP's business processes, estimating costs and timelines, and the subsequent oversight of projects that...

  • Engineering Manager

    4 weeks ago

    Muscat, Muscat, Oman Canonical Full time

    Join to apply for the Engineering Manager - Data Platform role at Canonical1 month ago Be among the first 25 applicantsJoin to apply for the Engineering Manager - Data Platform role at CanonicalCanonical is building a comprehensive suite of multi-cloud and on-premise data solutions for the enterprise. We want to make it easy to operate any database on any...

  • Data Systems Engineer

    2 weeks ago

    Muscat, Muscat, Oman beBeeData Full time 13,640 - 18,370

    Job OpportunityWe are seeking a seasoned data professional with in-depth expertise in on-premises big data platforms, specifically the Cloudera ecosystem. The ideal candidate will have a strong background in large-scale data management and distributed systems.The primary focus is on building and managing data lakes using Cloudera technologies. Familiarity...

  • Senior Data Engineer

    3 weeks ago

    Muscat, Muscat, Oman JOY IT Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Employment Type: Contract (1 Year and extendable)Job Description:Senior Data Engineer with strong expertise in Informatica (DEI, EDC, CDC), API development, and cloud platforms to support scalable, secure data integration in a telecom environment.We are looking for Oman Candidates and Middle East...

  • Advanced Data and Machine Learning Leader

    1 week ago

    Muscat, Muscat, Oman beBeeData Full time 90,000 - 125,000

    We are seeking a seasoned leader to oversee the development and deployment of our cutting-edge data and machine learning strategy. As Data Lead / ML Architect, you will define and execute the vision for scalable data pipelines and advanced ML models.Key ResponsibilitiesData & ML StrategyData Pipeline DevelopmentML Model ArchitectureTechnical...

  • Senior Data Center Solutions Expert

    1 week ago

    Muscat, Muscat, Oman beBeeDataCenter Full time 2,500 - 4,000

    Senior Data Center Solutions ExpertThis position involves providing technical and strategic support throughout the customer engagement process from pre-sales to delivery. Your primary responsibility will be to conduct in-depth presentations and demonstrations showcasing data center solutions' features and benefits to potential customers.Required Skills &...

  • Software Engineer

    4 weeks ago

    Muscat, Muscat, Oman Canonical Full time

    Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to...

  • Senior Data Integration Specialist

    2 weeks ago

    Muscat, Muscat, Oman beBeeDataIntegration Full time 800,000 - 1,000,000

    Job Title: Senior Data EngineerDevelop scalable, secure data integration solutions in a telecom environment. This role is ideal for experienced professionals who can design and implement robust data pipelines using Informatica tools.Key Responsibilities:Design and develop data pipelines using Informatica DEI, EDC, and CDC.Build and manage RESTful APIs for...

  • Data Infrastructure Specialist

    1 week ago

    Muscat, Muscat, Oman beBeeData Full time 10,000 - 12,000

    We are seeking a skilled and experienced Data Architect to join our team. This role involves designing, building, and maintaining scalable data infrastructure solutions that support large-scale data processing and analytics.Key Responsibilities:Develop and implement data architecture strategies to support business growth and improve operational...

  • Data Governance Engineer

    4 weeks ago

    Muscat, Muscat, Oman canonical Full time

    Bachelor of Technology/Engineering (Automobile)Nationality: Any NationalityVacancy: 1 VacancyJob DescriptionWe are hiring a Data Governance Engineer with focus on data governance policies, processes, standards, and monitoring in compliance with internal policies and applicable regulatory frameworks, e.g., GDPR, DPA, ISO, etc. A successful candidate will...