Sr Python Data Engineer
Há 4 dias
Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts). Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and/or a data lake architecture. Contribute to CI/CD pipelines using GitHub Actions. Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
-
Sr. Data Engineer
Há 3 dias
São Paulo, SP, Brasil ADM Tempo inteiroJob Summary Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Sr. Data Engineer is responsible for...
-
Sr. Data Engineer
Há 3 dias
São Paulo, SP, Brasil ADM Tempo inteiroJob Summary Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Sr. Data Engineer is responsible for...
-
Lead Data Solutions Engineer
Há 2 dias
São Paulo, SP, Brasil beBeeDataEngineer Tempo inteiroJob Description: As a Sr. Data Engineer, you will be responsible for designing, building, and maintaining data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark. Your primary goal is to create scalable and efficient data solutions that drive business value. The ideal candidate should have experience in...
-
Sr. Data Engineer
Há 2 dias
São Paulo, SP, Brasil XML International Tempo inteiroSr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative. The IDE team creates...
-
Sr. Data Engineer
1 dia atrás
São Paulo, SP, Brasil XML International Tempo inteiroSr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative. The IDE team creates...
-
Data Engineer
4 semanas atrás
São Paulo, SP, Brasil Elios Talent Tempo inteiroData Engineer Highlights Build and maintain pipelines that power data-driven insights Hybrid or remote flexibility High-growth opportunities in cloud and big data technologies Role Summary We are seeking a Data Engineer to architect and maintain data infrastructure that supports analytics and machine learning. This role ensures that high-quality data is...
-
Data Engineer
4 semanas atrás
São Paulo, SP, Brasil Elios Talent Tempo inteiroData Engineer Highlights Build and maintain pipelines that power data-driven insights Hybrid or remote flexibility High-growth opportunities in cloud and big data technologies Role Summary We are seeking a Data Engineer to architect and maintain data infrastructure that supports analytics and machine learning. This role ensures that high-quality data is...
-
Data Engineer
4 semanas atrás
São Paulo, SP, Brasil PIXIE Tempo inteiroPosition Overview As an Azure Data Engineer (with DevOps focus) , you will design, build, and maintain scalable data solutions and cloud infrastructure to support our retail applications. You'll develop and optimize data pipelines, implement automation, and apply DevOps practices to ensure reliability, security, and performance in our Azure environment....
-
Data Engineer
4 semanas atrás
São Paulo, SP, Brasil PIXIE Tempo inteiroPosition Overview As an Azure Data Engineer (with DevOps focus), you will design, build, and maintain scalable data solutions and cloud infrastructure to support our retail applications. You'll develop and optimize data pipelines, implement automation, and apply DevOps practices to ensure reliability, security, and performance in our Azure environment....
-
Senior Data Engineer
Há 3 dias
São Paulo, SP, Brasil Celebal Technologies Tempo inteiroJob Title: Data Engineer Location: São Paulo, Brazil (Hybrid or Remote within Brazil) Employment Type: Full-time About the Role We are looking for an experienced Data Engineer to join our data team in Brazil. The ideal candidate will design and maintain modern data pipelines and architectures, with a strong focus on Databricks development and migration...
