Senior Data Engineer

1 semana atrás


Brasil Luxoft Tempo inteiro
Job Title: Senior Data Engineer

Job Summary:

We are seeking a highly skilled Senior Data Engineer to join our team at Luxoft. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on Azure Databricks and Google Cloud Platform (GCP) using PySpark and Python.

Key Responsibilities:

  • Design and implement data pipelines using PySpark and Python on Azure Databricks and GCP.
  • Work closely with cross-functional teams to define requirements, design solutions, and deliver high-quality data engineering outputs.
  • Develop and maintain CI/CD pipelines using GitHub Actions to automate the deployment of data engineering solutions.
  • Utilize GitHub for version control, ensuring that all code changes are tracked, reviewed, and managed effectively.
  • Collaborate with data scientists and analysts to design and implement data models and data visualizations.

Requirements:

  • Proficiency in Data Engineering concepts (Object Storage, Data Pipelines, ELTs, Data Modeling, etc.)
  • Proficiency in Software Engineering concepts (Continuous Integration, Continuous Deployment, Unit Testing, Coverage, Linting, Version Control System, etc.)
  • Knowledge of Azure Databricks, SQL Server, Azure Machine Learning, and Azure Blob Storage
  • Programming skills in Python and PySpark
  • Experience with CI/CD pipelines using GitHub Actions
  • Strong understanding of software development lifecycle (Release Engineering, Deployments, Code review, Requirements definition)

Language:

English: B2 Upper Intermediate


  • Senior Data Engineer

    2 semanas atrás


    Brasil ECF Data, LLC Tempo inteiro

    Unlock Your Data PotentialAt ECF Data, LLC, we're on the lookout for a skilled Senior Data Engineer to join our team. As a key player in our data-driven organization, you'll be responsible for designing, building, and managing complex data pipelines that drive business growth.We're a Portuguese consulting company with a strong focus on Technology and...

  • Senior Data Engineer

    3 semanas atrás


    Brasil Data Privacy Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our team at TRM Labs. As a key member of our Data Platform team, you will be responsible for designing, building, and maintaining scalable and highly available data infrastructure for our products and services.Key ResponsibilitiesDesign and implement complex data pipelines to...


  • Brasil Data Privacy Tempo inteiro

    About the RoleWe're seeking a highly skilled Senior/Staff Software Engineer to join our Data Platform team. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and reliable data infrastructure for our products and services.Key ResponsibilitiesDesign and develop highly available and scalable data services to...


  • Brasil Data Privacy Tempo inteiro

    About TRM LabsTRM Labs is a mission-driven company that aims to build a safer financial system for billions of people. We deliver a blockchain intelligence data platform to financial institutions, crypto companies, and governments to fight cryptocurrency fraud and financial crime.Job DescriptionWe are seeking a highly skilled Software Engineer to join our...

  • Senior Data Engineer

    3 semanas atrás


    Brasil AgileEngine, LLC Tempo inteiro

    Job DescriptionWe are seeking a highly skilled Senior/Lead BI Engineer to join our team at AgileEngine, LLC.Key Responsibilities:Assess and analyze large datasets, including census, eligibility, medical, and Rx claims data.Map and merge data dictionaries to ensure accurate and efficient data analysis.Develop and implement automated tests to ensure data...


  • Brasil Zazmic Inc Tempo inteiro

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our dynamic data team at Zazmic Inc. As a Senior Data Engineer, you will play a critical role in designing, developing, and optimizing scalable data pipelines using Apache Spark and Google Cloud Platform (GCP).Key Responsibilities:Architect, build, and maintain...

  • Senior Data Engineer

    2 semanas atrás


    Brasil AgileEngine, LLC Tempo inteiro

    Job DescriptionWe are seeking a highly skilled Senior/Lead BI Engineer to join our team at AgileEngine, LLC.Key Responsibilities:Assess and analyze large datasets, including census, eligibility, medical, and Rx claims data.Map incoming data dictionaries to our data dictionary and merge information into the dataset for analysis.Collaborate with the QA team to...

  • Senior Data Engineer

    2 semanas atrás


    Brasil AgileEngine, LLC Tempo inteiro

    {"h1": "Data Analysis and Engineering Expert","p": "We are seeking a highly skilled Data Analysis and Engineering Expert to join our team at AgileEngine, LLC. As a Senior Data Engineer, you will be responsible for assessing census/eligibility, medical, and Rx claims data, mapping incoming data dictionaries to our data dictionary, merging information into the...

  • Senior Data Engineer

    2 semanas atrás


    Brasil AgileEngine, LLC Tempo inteiro

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at AgileEngine, LLC. As a Data Engineer, you will be responsible for designing, building, and maintaining complex data pipelines to connect different sources of data together.Key ResponsibilitiesCommunicate with cross-functional teams to understand data needs and business...

  • Data Engineer

    3 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Plan Ahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Develop and maintain high-performance data...

  • Data Engineer

    2 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologiesDevelop and maintain large-scale data systems,...

  • Data Engineer

    2 semanas atrás


    Brasil Planahead Tempo inteiro

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Planahead. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using cutting-edge tools and technologies.Collaborate with cross-functional teams to ensure...


  • Brasil Luby Tempo inteiro

    About LubyLuby is a dynamic and innovative company that is passionate about technology and data. We are seeking a highly skilled Senior Data Management Engineer to join our team and help us drive our data modernization project forward.Job SummaryThe Senior Data Management Engineer will be responsible for building and maintaining data pipelines, performing...

  • Data Engineer

    2 semanas atrás


    Brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    2 semanas atrás


    brasil Premier Group Recruitment Tempo inteiro

    Data EngineerContract$32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Data Engineer

    2 semanas atrás


    brasil Premier Group Recruitment Tempo inteiro

    Data Engineer Contract $32 - $36 per hour. Premier Group has engaged exclusively with a growing marketing agency who are seeking a Data Engineer to join them on a 3-month contract, with a huge possibility of extension. The company is an English speaking business, so you must have strong English, both written and verbal, as well as your own Sociedade...

  • Senior Software Engineer

    2 semanas atrás


    Brasil Ignitho Technologies Inc. Tempo inteiro

    Senior Software EngineerIgnitho Technologies Inc. is seeking a highly skilled Senior Software Engineer to join our team.Key Responsibilities:Design and develop scalable.NET applications hosted on Azure cloud services, with a focus on Azure Kubernetes Services.Optimize SQL databases for efficient data retrieval and manipulation, and execute complex queries...

  • Senior Data Architect

    2 semanas atrás


    Brasil Thoughtworks Inc. Tempo inteiro

    Job Title: Senior Data EngineerAt Thoughtworks, we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in building, maintaining, and testing the software architecture and infrastructure for managing data applications.Key Responsibilities:Develop and operate modern data architecture approaches...

  • Senior Data Architect

    2 semanas atrás


    Brasil Thoughtworks Inc. Tempo inteiro

    Senior Data EngineerAt Thoughtworks Inc., we're seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in building, maintaining, and testing the software architecture and infrastructure for managing data applications.Key Responsibilities:Develop and operate modern data architecture approaches to...

  • Senior Data Engineer

    2 semanas atrás


    Brasil Teachable, Inc. Tempo inteiro

    About TeachableTeachable is a leading platform for creator-educators to share their knowledge and reach millions of students worldwide. As a dynamic and cross-cultural team, we're committed to delivering market-leading products that prioritize creator control and flexibility.About the RoleWe're seeking a highly skilled Senior Data Engineer to join our Data...