Senior Big Data Engineer

ONE NORTH CONSULTING PTE. LTD.
  • Job Category
    Information Technology
  • Job level
    Senior Executive
  • Contract type
    Contract, Full Time
  • Location
    Islandwide
  • Salary
    S$6500 - S$8000

Job Description

One North Consulting is currently hiring Senior Big Data Engineers with about 5+ years of experience as per details given below:


Roles & Responsibilities

As Senior Big Data Engineer, you will focus on managing the Hadoop cluster, Implementing data ingestion framework & designing data models. Your primary role will be to implement data lake & transform the data for business use.


PRIMARY RESPONSIBILITIES

  • Deliver big data solutions based on premise Hadoop or cloud-based systems like AWS. Manage Hadoop cluster, participate in scale out planning & implementation.
  • Design ingestion layer for structured & unstructured data (text, voice, xml etc) & implement insurance specific data model for business & analytics use.
  • Deliver ELT solution including data extraction, transformation, cleansing, data integration and data management. Implement batch & near real time data ingestion pipelines based on reference architecture like Lambda.
  • Ability to augment with new sources of data including internal/external untapped data. Contribute to the establishment and maintenance of cloud computing platform and big data services.
  • Operationalize analytics models for production usage with big data workflows, proper security & access control.
  • Ability to provide support for analytics tools & environment like RServer etc & debug performance issues.

Core COMPETENCIES

  • Databases: RDBMS, SQL programming
  • ETL and Data Integration Tools: Azure Data Factory (ADF), Microsoft SQL Server Integration Service (SSIS), SAS Data Integration
  • Big Data: Hadoop (Hortonworks), Hive, Spark, Sqoop, etc
  • Programming and Scripting: Linux/Unix Shell Scripting, Java, Scala, Hive QL
  • BI/Dashboarding: SAS Visual Analytics, Qliksense

Working Experience:

  • 5+ years in data engineering and modelling.
  • Hands-on in managing data mapping, data quality and integrity, performance in data processing, etc
  • Experience in insurance domain (e.g. LifeAsia system) is an advantage
  • Experience in Agile software development

Education

  • Bachelor in Computer Science, Computer Engineering or equivalent

Personal Traits

  • Proactive with can-do attitude
  • Independent and self-motivated
  • Able to work under pressure to meet tight timeline
  • Able to provide regular updates

If Interested, please email us your CV to jit@OneNorthConsulting.com


Closing on 05 Oct 2021