Roles and Responsibilities

• Develop, optimize, and maintain ETL/ELT pipelines for efficient data ingestion, processing, and storage.
• Work with structured and unstructured data from various sources, ensuring data quality and integrity.
• Implement and manage data warehouses, data lakes, and other storage solutions.
• Collaborate with data scientists, analysts, and business teams to understand data needs and develop appropriate solutions.
• Write clean, efficient, and scalable Python code for data transformation and automation.
• Optimize query performance and troubleshoot data-related issues.
• Ensure data security, privacy, and compliance with relevant regulations.
• Document data engineering processes, workflows, and best practices.

• 2+ years of experience in data engineering.
• Proficiency in Python for data processing and automation.
• Experience with SQL and relational databases such as PostgreSQL, MySQL, or SQL Server.

Please refer to job description.