Data Engineer
Telenor Group Malaysia - Digi, Malaysia
Job Description
You are:
Mature and strong analytical in nature
An action-oriented person who demonstrate consideration for the feelings and needs of others
Willing to help co-workers learn and develop, and assist when required
Able to work in a team environment and highly self-motivated.
Proactive to ensure all possible concerns are managed
Strong analytical skill
Your Responsibilities:
Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity.
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for stakeholders and business processes that depend on it.
Writes unit/integration tests, contributes to engineering wiki, and documents work.
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.
Designs data integrations and data quality framework.
Designs and evaluates open source and vendor tools for data lineage.
Works closely with all division units and engineering teams to develop strategy for long term data platform architecture.
Job Specification
Your Merits: (these are must haves in terms of qualifications & experience & specific technical /professionals’ skills that you want from the applicant)
Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field.
Master's degree in a relevant field is advantageous.
Proven experience as a Data Engineer, Software Developer, or similar.
Expert proficiency in Python, C++, Java, R, and SQL.
Familiarity with Hadoop or suitable equivalent.
Excellent analytical and problem-solving skills.
A knack for independent and group work.
Scrupulous approach to duties.
Capacity to successfully manage a pipeline of duties with minimal supervision.
Added advantage for those having experience in Telecommunication industry
Knowledge and experience of either products would be added advantage: (Cloudera CDP, Microfocus Vertica EDW, Denodo data virtualization, Talend Data Ingestion, Qlik Sense reporting tools, Microfocus Voltage)