Data Engineer

We are seeking a skilled Software Engineer to join our Data Platform team. As a key contributor, you will play a crucial role in enhancing technical skills and delivering solutions that meet business objectives.

• Collaborate with senior engineers and team leads to understand customer and business needs, gathering requirements and participating in planning sessions.
• Design, develop, test, and deploy scalable systems and applications, contributing to architectural decisions on system design, data models, and integration strategies.
• Develop and maintain code using programming languages such as Java, C#, Go, or Python, automating processes, enhancing system functionality, and creating features for data engineering tasks.
• Assist in building and maintaining CI/CD pipelines, contributing to the automation of build, test, and deployment processes.
• Implement software development best practices, including Test-Driven Development (TDD) and Behavior-Driven Development (BDD).
• Contribute to data engineering tasks, developing data pipelines for data ingestion, transformation, and loading into databases or data warehouses.
• Maintain live production systems, monitoring and ensuring system health.
• Analyze systems and processes to identify areas for improvement, suggesting enhancements such as code optimizations, database indexing, caching strategies, or architectural changes.
• Stay current with emerging technologies and industry trends, especially in AI and data-driven technologies.
• Work collaboratively with cross-functional teams to ensure technical solutions align with business requirements.
• Participate in code reviews and technical discussions, providing constructive feedback to peers on code quality, architecture, and best practices.

• Bachelor's degree in Computer Science, Software Engineering, or related field.
• Software engineering experience with a focus on data engineering, designing and implementing data pipelines and data systems for efficient data processing and storage.
• Strong proficiency in programming languages such as Java, C#, Go, or Python, with a demonstrated ability to write clean, efficient, and maintainable code.
• Solid understanding of software development best practices, including TDD, BDD, and experience with version control systems like Git.
• Experience in data engineering, including developing data pipelines, ETL processes, and working with SQL and NoSQL databases.
• Knowledge of agile development methodologies, with practical experience working in iterative development cycles.
• Strong problem-solving and analytical skills, with the ability to diagnose and resolve technical issues related to system performance, scalability, and reliability.
• Excellent communication and collaboration skills, capable of working effectively in a team environment and interacting with cross-functional teams and stakeholders.
• Demonstrated passion for continuous learning and staying current with emerging technologies, especially in AI and data-driven technologies.

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Experience with cloud-based data warehousing applications, such as Snowflake, Amazon Redshift, or similar technologies.
• Experience in building data pipelines with cloud-native ingestion, orchestration, and transformation applications.
• Knowledge of AI and machine learning concepts, with experience in leveraging data-driven technologies and tools to improve system capabilities.
• Cloud Infrastructure Management: Extensive hands-on experience with cloud infrastructures in AWS and Azure.