Data Engineer – TmZ Blog

Knowledge Engineer #Knowledge #Engineer Welcome to TmZ Weblog, right here is the brand new job we’ve got for you at the moment:

If This Job doesn’t curiosity You,
click on right here to make use of our automated job finder to search out extra related jobs.

Job title: Knowledge Engineer

Firm: Singtel

Job description: Duties * Design and implement knowledge pipelines in Hadoop platform * Perceive enterprise requirement and answer design to develop and implement options that adhere to huge knowledge archite Duties Design and implement knowledge pipelines in Hadoop platform Perceive enterprise requirement and answer design to develop and implement options that adhere to huge knowledge architectural pointers and deal with enterprise necessities Wonderful-tuning of recent and current knowledge pipelines Schedule and preserve knowledge pipelines Drive optimization, testing and tooling to enhance knowledge high quality Assemble massive, complicated knowledge units that meet practical / non-functional enterprise necessities. Determine, design, and implement inner course of enhancements: automating handbook processes, optimizing knowledge supply, and so on Construct sturdy and scalable knowledge infrastructure (each batch processing and real-time) to help wants from inner and exterior customers Work with knowledge scientist and enterprise analytics staff to help in knowledge ingestion and knowledge associated technical points Work with Group IT domains and outsourced distributors to ship and implement options from requirement until submit go-live. Guarantee distributors to ship options on-time, on-budget that fulfill enterprise necessities and performance, operational and scalable We’re dedicated to a protected and wholesome surroundings for our workers & prospects and would require all potential workers to be totally vaccinated. Necessities Bachelor’s diploma in IT, Laptop Science, Software program Engineering, Enterprise Analytics or equal. Minimal 4 years of expertise in knowledge warehousing / distributed system similar to Hadoop Expertise with relational SQL and NoSQL DB Expertise in constructing and optimizing ‘huge knowledge’ knowledge pipelines, architectures and knowledge units Wonderful expertise in Scala or Python Expertise in ETL and / or knowledge wrangling instruments for giant knowledge surroundings Capability to troubleshoot and optimize complicated queries on the Spark platform