Data Engineer

Keyrus is looking for a Data Engineer to join an exciting data-driven environment where you'll help build scalable data platforms, enable real-time business insights, and drive data quality across the organization.

Responsibilities
Data Engineering & Integration

• Design and implement data pipelines to extract, transform, and load data from various sources to enable real-time visibility and decision-making
• Optimise data models to support efficient reporting and analysis
• Integrate data from various sources, including structured and unstructured data
• Automate data cleansing and validation processes to improve overall data quality  

Cloud Infrastructure and Deployment

• Assist in design of cloud architecture for data storage and processing
• Implement authentication, authorization, and API security best practices in accessing the data

Data Analysis & Reporting

• Collaborate with business functions to define reporting and visualisation requirements
• Work with business functions to ensure data accuracy and consistency
• Perform root cause analysis of data discrepancies and recommend corrective actions

Data Governance & Quality

• Establish data standards, governance frameworks, and best practices for data management
• Identify data quality issues and implement solutions to enhance reliability
• Support audits and compliance activities by providing accurate datasets and reports

Requirements

• At least 2 years of experience in data engineering or related roles
• Good understanding of database concepts and data modelling principles
• Hands-on experience with ETL processes and data pipeline tools (e.g. Google Cloud Dataflow, Apache Kafka, AWS Glue)
• Familiarity with cloud platforms such as AWS and GCP, and services including S3, Redshift, BigQuery, or Snowflake
• Proficient in programming with Python, SQL, Scala, or Java
• Understanding of data warehouse design and data lake architecture
• Experience with APIs, data integration methods, and data visualization tools like Tableau, Power BI, or Google Looker Studio
• Knowledge of data security and governance best practices