รายละเอียดงาน• Design, develop, and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources such as crowdsourcing data, test tool, network statistics, application log etc. Also develop and maintain data models and warehouses
• Implement processes and systems to automate data processing tasks
• Optimize data storage, ensuring data integrity and reliability while managing scalability and performance.
• Collaborate with data scientists and analysts to understand their data needs and design and implement data pipelines that meet those needs
• Write and maintain documentation for data pipelines and data models
• Troubleshoot data-related issues, investigate data anomalies, and perform root cause analysis
• Implement data security and access controls to protect sensitive data