Senior Data Engineer
Há 2 dias
Responsibilities
Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.
Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning.
Develop and maintain CI/CD pipelines using GitHub Actions to automate the deployment of data engineering solutions.
Utilize GitHub for version control, ensuring that all code changes are tracked, reviewed, and managed effectively.
Work closely with cross-functional teams to define requirements, design solutions, and deliver high-quality data engineering outputs.
Skills Must have
- It is expected that the engineer:
- Is proficient in Data Engineering concepts (Object Storage, Data Pipelines, ELTs, Data Modeling, etc.)
- Is proficient in Software Engineering concepts (Continuous Integration, Continuous Deployment, Unit Testing, Coverage, Linting, Version Control System, etc.)
- Have knowledge or understanding the basic concepts of Software Development lifecycle (Release Engineering, Deployments, Code review, Requirements definition)
- Platforms - Azure Databricks, SQL Server, Azure Machine Learning, Azure Blob Storage
- Programming Language - Python, PySpark
- CI/CD - GitHub Actions, GitHub
- VCS - GitHub
LANGUAGES
- English: B2 Upper Intermediate
-
Senior Data Engineer
2 meses atrás
Brasil Remobi Tempo inteiroSenior Data Engineer About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. ...
-
Senior Data Engineer
3 semanas atrás
Brasil Aptonet Inc Tempo inteiroAs a Senior Data Engineer (Python/Spark) , you will play a crucial role in building and maintaining robust data ingestion pipelines, applications, and data processing systems. You will work on cutting-edge technologies and be responsible for designing, implementing, and optimizing solutions that support our Data Product Hub. Key Responsibilities: Develop...
-
Senior Data Engineer
4 semanas atrás
Brasil inspired! Tempo inteiro** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION ** We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...
-
Senior Data Engineer
Há 1 mês
Brasil Sandbox Group Tempo inteiroAbout the role This is a 100% remote position As a Senior Data Engineer, is responsible for the development, construction, maintenance, and testing of architectures, such as databases and large-scale processing systems. Is responsible play a pivotal role in optimizing data systems and building them from the ground up, working closely with data analysts to...
-
Senior Data Engineer
2 meses atrás
Brasil Sigma Software Group Tempo inteiroSigma Software is looking for an experienced Senior Data Engineer to join our growing engineering team. This opportunity is for you if you want to work with a tightly knit team of data engineers solving challenging problems using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud. Sounds like you? We are waiting for...
-
Senior Data Engineer
Há 5 dias
Brasil Luxoft Tempo inteiroResponsibilities Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python. Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning. Develop and maintain CI/CD pipelines using GitHub...
-
Senior Data Engineer
Há 3 dias
brasil Luxoft Tempo inteiroResponsibilities Design, build, and maintain scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python. Work with Azure and GCP platforms, specifically managing services like Azure Databricks, Azure SQL Server, BigQuery, DataProc, and Azure Machine Learning. Develop and maintain CI/CD pipelines using GitHub Actions...
-
Senior Data Engineer
2 meses atrás
Brasil Andela Tempo inteiroSenior Data Engineer Andela Location Requirement: Brazil, Canada, Egypt. About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive...
-
Data Engineer
4 semanas atrás
Brasil Blueclip Tempo inteiroAs Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by...
-
Data Engineer
Há 3 dias
brasil Blueclip Tempo inteiroAs Blueclip, we started our journey to bring the most creative minds and the know-how together to deliver great works. About Our Search We are looking for a multi-talented Big Data Engineer to facilitate the operations of the Data scientists and Engineering team of our partner which is a cryptocurrency investment research platform that’s driven by machine...
-
Data Engineer
3 semanas atrás
Brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....
-
Data Engineer
Há 3 dias
brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...
-
Data Engineer
Há 2 dias
brasil Remobi Tempo inteiroData Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...
-
Data Engineer
Há 1 mês
Brasil Birlasoft Tempo inteiroData Engineer - Cognite Qualifications Experience with Cognite Solutions Experience in data governance and modern platforms like Data Fabric and Data Mesh. Ability to work in complex environments with large data volumes, including cloud and hybrid implementations. Hands-on experience in Data Science and AI/ML projects, with proficiency in advanced...
-
Senior Data Engineer
3 semanas atrás
Brasil Sigma Software Group Tempo inteiroOur growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value. If you’re excited about working with cutting-edge technology in a fast-paced environment,...
-
Senior Data Engineer
Há 2 dias
brasil Sigma Software Group Tempo inteiroOur growing data teams are seeking a savvy Senior Data Engineer to join them and help build and evolve the next generation of Audience & Identity data platforms that handle data at scale and use state-of-the-art technologies to unlock the data’s business value.If you’re excited about working with cutting-edge technology in a fast-paced environment,...
-
Senior Android Engineer
Há 7 dias
Brasil BetterEngineer Tempo inteiroBetter Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...
-
Senior Android Engineer
Há 6 dias
brasil BetterEngineer Tempo inteiroBetter Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...
-
Senior Android Engineer
Há 2 dias
brasil BetterEngineer Tempo inteiroBetter Engineers. Better Results. BetterEngineers connects accomplished Software Engineers across the Americas with our portfolio of high-growth and newsworthy technology companies in the United States. Senior Engineers in the BetterEngineers network work remotely with some of the most interesting tech companies in the world. Join us today and experience a...
-
Data Engineer
4 semanas atrás
Brasil Zazmic Inc Tempo inteiroJob Title: Senior Data Engineer (Apache Spark, GCP) Join our dynamic data team, where you’ll have the opportunity to shape the future of our data infrastructure and drive innovation across the organization. We’re looking for a highly skilled Data Engineer who thrives in a fast-paced environment and is passionate about leveraging cutting-edge...