#SGUnitedJobs Data Engineer (DCUBE - LifeSG)

GOVERNMENT TECHNOLOGY AGENCY
  • Job Category
    Information Technology, Public / Civil Service
  • Job level
    Middle Management
  • Contract type
    Full Time

Job Description

What to expect:

  • Design, build, and maintain data pipelines for reliable batch and real-time data processing
  • Drive enterprise data foundation requirements for Data Warehousing, Data Lake, Data Mart
  • Collaborate with Project Manager, Frontend Developers, UX Designers and Data Analyst to build scalable data products for analytics and performance reporting
  • Collaborate with engineering team to build and maintain data components driving product features

 

Experiences we look out for:

  • Good knowledge of big data technology landscape and concepts related to distributed storage and computing
  • Experience in the following would be advantageous:
    • Programming in SQL, Python, Java, Scala
    • Running and maintaining large ETL/ELT jobs to ingest and process data
    • NoSQL databases such as Elasticsearch, DynamoDB, Cassandra
    • Event sourcing systems such as Kafka, Kinesis and the associated APIs such as Kafka Connect, Kafka Streams, KCL, Spark Structured Streaming
  • Familiarity with the following will be an added bonus:
    • AWS infrastructure and its managed service
    • Management of cloud-based MPP such as Redshift, BigQuery
    • DevOps practices and maintaining infrastructure-as-code and data-pipeline-as-code
    • High-level understanding of data-science model development topics such as training and deployment
  • At least 3 years of relevant working experience as a data engineer in a product team/organisation context is preferred

 

Character traits we look out for:

  • Drive for learning and self-discovery
  • Openness to new ideas
  • Strong sense of ownership and proactiveness in ‘making things happen’
  • Willingness and capability to share and impart knowledge

Closing on 06 Sep 2021