Job Description
More than just a recruitment company. At PRTR, we have been a part of our customer's success for 30 years as their total HR solutions partner. With 550 dedicated professionals and over 15,000 outsourced staff, we will continue to carry out our mission to develop a better career, a better life, and a better society, and thrive to become the No.1 people solutions organization in Southeast Asia.
Job Summary
We are seeking an experienced Senior Data Engineer to design, implement, and maintain our data infrastructure and pipelines. The ideal candidate will have a strong background in data engineering, big data technologies, and cloud platforms. You will work closely with data scientists, analysts, and other stakeholders to ensure efficient and reliable data processing and storage solutions.
Key Responsibilities
- Designing, developing, and maintaining scalable data pipelines and ETL processes.
- Implementing and optimising data storage solutions, including data warehouses and data lakes.
- Collaborating with data scientists and analysts to understand data requirements and provide efficient data access.
- Ensuring data quality, consistency, and reliability across all data systems.
- Developing and maintaining data models and schemas.
- Implementing data security and access control measures.
- Optimizing query performance and data retrieval processes.
- Evaluating and integrating new data technologies and tools.
- Mentoring junior data engineers and providing technical leadership.
- Collaborating with cross-functional teams to support data-driven decision-making.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or related roles.
- Strong programming skills in Python, Java, or Scala.
- Extensive experience with big data technologies such as Hadoop, Spark, and Hive.
- Proficiency in SQL and experience with both relational and NoSQL databases.
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
- Knowledge of data modelling, data warehousing, and ETL best practices.
- Familiarity with data visualization tools (e.g., Tableau, Power BI).
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Preferred Qualifications
- Experience with stream processing technologies (e.g., Kafka, Flink).
- Knowledge of machine learning and AI technologies.
- Familiarity with data governance and compliance requirements.
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Contributions to open-source projects or relevant certifications.
- Experience in Azure big data platform (ADF, Databrick).
- Experience in PowerBI.