Job Description
More than just a recruitment company. At PRTR, we have been a part of our customer's success for 30 years as their total HR solutions partner. With 550 dedicated professionals and over 15,000 outsourced staff, we will continue to carry out our mission to develop a better career, a better life, and a better society, and thrive to become the No.1 people solutions organization in Southeast Asia.
We are looking for an experienced Senior Data Engineer (GCP) to join our team and support a leading global retail company. In this role, you will be responsible for developing and maintaining robust data solutions, ensuring seamless data integration, security, and reliability within a cloud-based infrastructure. You will work closely with various teams to optimize data workflows and enable efficient data-driven decision-making.
Key Responsibilities:
- Developing and optimizing ETL pipelines to ensure smooth data processing and integration within the GCP ecosystem.
- Designing and managing database structures to support efficient data retrieval and manipulation.
- Implementing and overseeing data pipelines using Airflow, dbt, and a suite of GCP services.
- Automating workflows with scripting languages like Python and Bash.
- Utilizing containerization technologies such as Docker and orchestration tools like Kubernetes for streamlined deployment.
- Working closely with data scientists, analysts, and other stakeholders to understand and fulfill data requirements.
Qualifications:
- 5+ years of experience in data engineering, big data management, and data warehousing.
- Strong proficiency in Python and SQL for data transformation and automation.
- Experience with data workflow and pipeline tools such as Airflow and dbt.
- In-depth knowledge of data storage, processing techniques, and database design.
- Hands-on experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Storage, and Dataflow (preferred).
- Fluency in English.