JOB DESCRIPTION
Build and operate the company's data platform - including storage infrastructure, data processing pipelines and toolsets serving data exploitation and governance needs across the organization.
1. Build data platform and tools
- Develop and maintain data platform across storage, processing and serving layers, ensuring it meets the needs of data exploitation teams in the company.
- Build and integrate ETL/ELT tools, metadata analysis and management, create standardized toolsets for teams working with data.
- Manage and deploy platform infrastructure as code and build CI/CD pipelines, ensuring consistent configuration, easy reproducibility and safe deployment.
- Guide end users in using data tools in their daily work.
2. Build data pipelines (batch/streaming)
- Build and operate pipelines bringing data from business sources into the system, using both batch and streaming mechanisms.
- Organize and model data into logical layers (raw, cleaned, serving) so data is consistent, easy to query and reusable.
- Build and maintain datasets serving analytics, providing Data Analysts and Data Scientists with data for exploitation.
- Supply data to other business systems with requirements, through appropriate integration mechanisms.
- Set up schedules and automation so data is always ready at the right time, reducing manual operations.
3. Data governance, quality and security
- Manage metadata and lineage so data in the system is clear about origin, meaning and usage.
- Build automated data tests, monitor quality and handle cases of incorrect or missing data.
- Implement access control and data access permissions according to company security and compliance requirements.
4. Operations and monitoring
- Build and maintain monitoring and alerting systems for the platform and data pipelines, detect and handle issues early.
- Analyze and optimize system performance so data processing tasks run stably and efficiently.
5. Collaboration and improvement
- Coordinate with business, technical teams and source system operations to align requirements and deploy data solutions.
- Write and maintain technical documentation for systems and data pipelines.
- Ensure code quality through review and compliance with team standards.
- Evaluate current technologies, experiment with new technologies and solutions, propose system improvements.
CANDIDATE REQUIREMENTS
1. Education/Certifications
- Bachelor's degree in Computer Science, Software Engineering, Information Technology or related fields.
- Master's degree in related field is preferred.
2. Work experience
- Minimum 3 years of Data Engineering experience.
- Experience working with large-scale data processing systems.
- Experience with cloud computing platforms is an advantage.
3. Knowledge/Professional competencies/Skills
- Systems thinking: understand data, data flows and how components in a data system operate and connect.
- Understanding of database design principles, data modeling and data warehousing.
- Proficiency in SQL and data processing programming languages (Python/Scala).
- Master techniques for building pipelines to collect, transform and process data at both batch and streaming scales, along with principles ensuring data quality.
- Knowledge of big data processing technologies, data governance tools.
- Understanding of platform operations: infrastructure automation (IaC), CI/CD and system monitoring.
- Self-motivated in work and good collaboration with related departments.
- Knowledge of applying AI to data engineering work - both in daily tasks and integration into platforms, pipelines to increase automation and efficiency.
- Understanding of machine learning pipelines and how to prepare and supply data for ML problems.
BENEFITS AND ENTITLEMENTS
- Flexible and competitive compensation: Receive fixed salary commensurate with ability and attractive bonuses based on actual contribution performance on projects.
- Clear career development path
- Benefits and working conditions: Active Cool-down mechanism: After long-term continuous campaigns or projects, the company prioritizes creating space and time for you to transition to rest, training and energy recovery, preparing for the next steps.
- Full insurance, healthcare and benefits according to State regulations and the Group's special policies.
- Open, transparent and fully digitalized working environment.
- Premium health insurance package and 24/24 accident insurance beyond social insurance, health insurance and work injury insurance according to State regulations.
- Training programs for personal capacity development, team bonding programs, retreats, teambuilding.
