Senior Data Engineer
1 semana atrás
Job Summary:
We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.
Key Responsibilities:
- Design and implement data pipelines using PySpark and Python on Azure Databricks and GCP.
- Work closely with cross-functional teams to define requirements, design solutions, and deliver high-quality data engineering outputs.
- Develop and maintain CI/CD pipelines using GitHub Actions to automate the deployment of data engineering solutions.
- Utilize GitHub for version control, ensuring that all code changes are tracked, reviewed, and managed effectively.
- Collaborate with data scientists and analysts to design and implement data models and data visualizations.
Requirements:
- Proficiency in Data Engineering concepts (Object Storage, Data Pipelines, ELTs, Data Modeling, etc.)
- Proficiency in Software Engineering concepts (Continuous Integration, Continuous Deployment, Unit Testing, Coverage, Linting, Version Control System, etc.)
- Knowledge of Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage
- Programming skills in Python and PySpark
- Experience with CI/CD pipelines using GitHub Actions
- Strong understanding of software development lifecycle (Release Engineering, Deployments, Code review, Requirements definition)
Language:
English: B2 Upper Intermediate
-
Senior Data Engineer
2 semanas atrás
Brasil ECF Data, LLC Tempo inteiroUnlock Your Data PotentialAt ECF Data, LLC, we're on the lookout for a skilled Senior Data Engineer to join our team. As a key player in our data-driven organization, you'll be responsible for designing, building, and managing complex data pipelines that drive business growth.We're a Portuguese consulting company with a strong focus on Technology and...
-
Senior Data Engineer
3 semanas atrás
Brasil Data Privacy Tempo inteiroAbout the RoleWe are seeking a highly skilled Data Platform Engineer to join our team at TRM Labs. As a key member of our Data Platform team, you will be responsible for designing, building, and maintaining scalable and highly available data infrastructure for our products and services.Key ResponsibilitiesDesign and implement complex data pipelines to...
-
Senior/Staff Software Engineer, Data Platform
2 semanas atrás
Brasil Data Privacy Tempo inteiroAbout the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...
-
Brasil Data Privacy Tempo inteiroAbout TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...
-
Senior Data Engineer
3 semanas atrás
Brasil AgileEngine, LLC Tempo inteiroJob DescriptionWe are seeking a highly skilled Senior/Lead BI Engineer to join our team at AgileEngine, LLC.Key Responsibilities:Assess and analyze large datasets, including census, eligibility, medical, and Rx claims data.Map and merge data dictionaries to ensure accurate and efficient data analysis.Develop and implement automated tests to ensure data...
-
Senior Data Engineer for Zazmic Inc
3 semanas atrás
Brasil Zazmic Inc Tempo inteiroJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our dynamic data team at Zazmic Inc. As a Senior Data Engineer, you will play a critical role in designing, developing, and optimizing scalable data pipelines using Apache Spark and Google Cloud Platform (GCP).Key Responsibilities:Architect, build, and maintain...
-
Senior Data Engineer
2 semanas atrás
Brasil AgileEngine, LLC Tempo inteiroJob DescriptionWe are seeking a highly skilled Senior/Lead BI Engineer to join our team at AgileEngine, LLC.Key Responsibilities:Assess and analyze large datasets, including census, eligibility, medical, and Rx claims data.Map incoming data dictionaries to our data dictionary and merge information into the dataset for analysis.Collaborate with the QA team to...
-
Senior Data Engineer
2 semanas atrás
Brasil AgileEngine, LLC Tempo inteiro{"h1": "Data Analysis and Engineering Expert","p": "We are seeking a highly skilled Data Analysis and Engineering Expert to join our team at AgileEngine, LLC. As a Senior Data Engineer, you will be responsible for assessing census/eligibility, medical, and Rx claims data, mapping incoming data dictionaries to our data dictionary, merging information into the...
-
Senior Data Engineer
2 semanas atrás
Brasil AgileEngine, LLC Tempo inteiroJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at AgileEngine, LLC. As a Data Engineer, you will be responsible for designing, building, and maintaining complex data pipelines to connect different sources of data together.Key ResponsibilitiesCommunicate with cross-functional teams to understand data needs and business...
-
Data Engineer
3 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Plan Ahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Develop and maintain high-performance data...
-
Data Engineer
2 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologiesDevelop and maintain large-scale data systems,...
-
Data Engineer
2 semanas atrás
Brasil Planahead Tempo inteiroJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Collaborate with cross-functional teams to ensure...
-
Senior Data Management Engineer
3 semanas atrás
Brasil Luby Tempo inteiroAbout LubyLuby is a dynamic and innovative company that is passionate about technology and data. We are seeking a highly skilled Senior Data Management Engineer to join our team and help us drive our data modernization project forward.Job SummaryThe Senior Data Management Engineer will be responsible for building and maintaining data pipelines, performing...
-
Data Engineer
2 semanas atrás
Brasil Premier Group Recruitment Tempo inteiroData Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Data Engineer
2 semanas atrás
brasil Premier Group Recruitment Tempo inteiroData EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Data Engineer
2 semanas atrás
brasil Premier Group Recruitment Tempo inteiroData Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...
-
Senior Software Engineer
2 semanas atrás
Brasil Ignitho Technologies Inc. Tempo inteiroSenior Software EngineerIgnitho Technologies Inc. is seeking a highly skilled Senior Software Engineer to join our team.Key Responsibilities:Design and develop scalable.NET applications hosted on Azure cloud services, with a focus on Azure Kubernetes Services.Optimize SQL databases for efficient data retrieval and manipulation, and execute complex queries...
-
Senior Data Architect
2 semanas atrás
Brasil Thoughtworks Inc. Tempo inteiroJob Title: Senior Data EngineerAt Thoughtworks, we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in building, maintaining, and testing the software architecture and infrastructure for managing data applications.Key Responsibilities:Develop and operate modern data architecture approaches...
-
Senior Data Architect
2 semanas atrás
Brasil Thoughtworks Inc. Tempo inteiroSenior Data EngineerAt Thoughtworks Inc., we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in building, maintaining, and testing the software architecture and infrastructure for managing data applications.Key Responsibilities:Develop and operate modern data architecture approaches to...
-
Senior Data Engineer
2 semanas atrás
Brasil Teachable, Inc. Tempo inteiroAbout TeachableTeachable is a leading platform for creator-educators to share their knowledge and reach millions of students worldwide. As a dynamic and cross-cultural team, we're committed to delivering market-leading products that prioritize creator control and flexibility.About the RoleWe're seeking a highly skilled Senior Data Engineer to join our Data...