Mô tả công việc
Key Responsibilities:
- Design, build, and optimize scalable and resilient data pipelines to ingest data from multiple sources.
- Develop and maintain robust ETL/ELT processes to clean, transform, and integrate data into enterprise-grade data lakes and warehouses.
- Implement data scoring frameworks (Data Green Score & Quality Score) to measure completeness, consistency, and timeliness across shared datasets.
- Manage and maintain large-scale storage systems, ensuring data integrity, performance, and accessibility across teams.
- Collaborate with Data Scientists, Backend Engineers (including the Lead BE), and Product Owners to understand data requirements and translate them into effective data engineering solutions.
- Provide technical leadership and mentorship to other Data Engineers (DE #1, DE #2) within the team.
- Drive the technical strategy for data ingestion, processing, and integration related to the CDP and Loyalty systems, in collaboration with the Head/PO and Enterprise Architects.
- Ensure data engineering solutions adhere to data governance, security, and compliance requirements.
- Evaluate and recommend new data engineering technologies, tools, and methodologies to enhance our capabilities.
Job requirements
- Bachelor‘s or Master‘s degree in Computer Science, Engineering, or a related technical field.
- Minimum 4+ years of extensive hands-on experience in data engineering
- Proven expertise in designing and building large-scale batch and real-time data pipelines using technologies like Spark, Kafka, Airflow, etc.
- Strong proficiency in SQL and programming languages such as Python or Scala.
- Deep experience with Big Data technologies, cloud data platforms (AWS, Azure, GCP), and various database systems (SQL, NoSQL).
- Solid understanding of data modeling principles, data warehousing, data lakes, and data integration patterns.
- Experience with CI/CD practices for data pipelines and infrastructure-as-code is highly desirable.
- Excellent problem-solving, analytical, and technical leadership skills.
- Strong communication skills, with the ability to articulate complex technical designs and decisions.
