Data Engineer

4 weeks ago

Muscat, Muscat, Oman Oman Data Park Full time

ROLE OBJECTIVE:

The Data Engineer is responsible for designing, implementing, and optimizing data pipelines and architectures to support our AI and machine learning initiatives. The candidate will play a crucial role in enabling scalable, reliable, and efficient data processing.

RESPONSIBILITIES:

  • Design, build, and maintain scalable and efficient data pipelines to efficiently extract, transform, and load (ETL) data from various sources to support various data processing and analytics needs.
  • Integrate structured and unstructured data from diverse sources, ensuring high data quality, availability, and consistency.
  • Deploy and manage data solutions on ODP cloud platforms with a focus on performance, cost-efficiency, and security.
  • Develop and implement feature engineering techniques to transform raw data into meaningful input for machine learning models.
  • Collaborate with ML engineers and domain experts to annotate and label datasets, ensuring that the data is accurately categorized for training LLMs and other AI models.
  • Perform thorough data cleaning and preprocessing tasks, including handling missing values, removing duplicates, and normalizing data to ensure consistency and reliability in data pipelines.
  • Establish and enforce data quality standards, conducting regular audits and validations to maintain the integrity and accuracy of datasets used for training and inferencing.
  • Work closely with data scientists, ML engineers, software engineers, and other stakeholders to ensure alignment on project goals, timelines, and deliverables.
  • Create and maintain comprehensive documentation for data pipelines, systems, and processes to ensure knowledge transfer and continuity.

ROLES REQUIREMENTS:

  • Bachelor's or master's degree in Computer Science, Computer Engineering, Data Science, AI/ML, or a related field.
  • Any ML/AI certification from a recognized entity such as AWS, IBM, etc. is preferred
  • A minimum of 3 years of experience as a Data Engineer with a proven track record of designing and implementing data pipelines.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery).
  • Experience with automation tools, CI/CD pipelines, and containerization (e.g., Docker, Kubernetes).
  • Familiarity with big data technologies (Hadoop, Spark, Kafka) is a plus.
  • Experience with processing natural language processing datasets for NLP and LLM-based applications.
  • Understanding of machine learning concepts and their application to data engineering tasks.
  • Strong proficiency in SQL, Python, and other relevant programming languages.
  • Strong understanding of data warehousing, ETL processes, and data modelling.
  • Strong problem-solving skills and the ability to work in a fast-paced, dynamic environment.
  • Excellent communication skills, with the ability to convey technical concepts to both technical and non-technical audiences.
  • Passion for learning and staying updated with emerging technologies.
#J-18808-Ljbffr

  • Data Engineer Specialist

    2 weeks ago

    Muscat, Muscat, Oman beBee Careers Full time

    ROLE OBJECTIVE:We are seeking a highly skilled Data Engineer to design, implement, and optimize data pipelines and architectures that support our AI and machine learning initiatives.The ideal candidate will play a crucial role in enabling scalable, reliable, and efficient data processing.RESPONSIBILITIES:Design, build, and maintain scalable and efficient...

  • Data Governance Engineer

    2 weeks ago

    Muscat, Muscat, Oman beBee Careers Full time

    **Job Description**We are seeking a highly skilled Data Governance Engineer to join our team. The successful candidate will be responsible for defining, monitoring, and executing data governance policies, as well as designing, implementing, and maintaining data labeling and quality metrics in the data catalog.The role entails:Defining data governance...

  • Data Infrastructure Engineer

    2 days ago

    Muscat, Muscat, Oman Byanat Full time

    This role is exclusively for Omani nationals and requires candidates to be Omani citizens.We are looking for a talented and experienced Data Infrastructure Engineer to join our team. This role focuses on building, deploying, maintaining, and optimizing data infrastructure that supports our data-driven operations. You will work with large-scale data...

  • Data Governance Engineer

    2 weeks ago

    Muscat, Muscat, Oman canonical Full time

    Bachelor of Technology/Engineering (Automobile)Nationality: Any NationalityVacancy: 1 VacancyJob DescriptionWe are hiring a Data Governance Engineer with focus on data governance policies, processes, standards, and monitoring in compliance with internal policies and applicable regulatory frameworks, e.g., GDPR, DPA, ISO, etc. A successful candidate will...

  • Data Infrastructure Engineer

    2 weeks ago

    Muscat, Muscat, Oman Byanat Full time

    Get AI-powered advice on this job and more exclusive features.We are building a next-generation AI-powered platform designed for comprehensive observability of digital infrastructure, including mobile networks and data centers. By leveraging advanced analytics, automation, and real-time monitoring, we empower businesses to optimize performance, enhance...

  • Data Engineering Leader

    2 weeks ago

    Muscat, Muscat, Oman beBee Careers Full time

    We are looking for a talented and experienced Data Infrastructure Engineer to join our team. This role focuses on building, deploying, maintaining, and optimizing data infrastructure that supports our data-driven operations.ResponsibilitiesDesign, develop, and maintain scalable data infrastructure solutions to support large-scale data processing and...

  • Data Governance Engineer

    7 days ago

    Muscat, Muscat, Oman beBee Careers Full time

    Job DescriptionWe are seeking a skilled Data Governance Engineer to join our team. As a key member, you will be responsible for developing and maintaining data governance policies, processes, and standards in compliance with internal policies and applicable regulatory frameworks.The ideal candidate will have experience with data quality, governance, and...

  • Scalable Data Solutions Engineer

    2 weeks ago

    Muscat, Muscat, Oman beBee Careers Full time

    Job Description: Scalable Data Solutions EngineerWe seek an experienced engineer to design, develop, and maintain scalable data infrastructure solutions that support our data-driven operations. The ideal candidate will have strong technical skills in building, deploying, and managing distributed data systems.Main Responsibilities:Design and implement data...

  • Data Compliance Engineer

    5 days ago

    Muscat, Muscat, Oman beBee Careers Full time

    **Job Summary:**We are seeking a Data Compliance Engineer to join our Commercial Systems unit. In this role, you will be responsible for defining, monitoring, and executing data governance policies, as well as designing and implementing data labeling and quality metrics.A strong background in data quality, governance, and security processes and tools is...

  • Senior Data Platform Engineer

    4 weeks ago

    Muscat, Muscat, Oman Petroleum Development Oman Full time

    Job DescriptionAbout the CompanyPetroleum Development Oman is the leading exploration and production company in the Sultanate of Oman. The Company delivers the majority of the country's crude oil production and natural gas supply.Purpose of the JobThe role of a Senior Data Platform Engineer is to design, develop, optimize, and maintain data architecture and...