Sr Python Data Engineer
2 semanas atrás
Senior Python Data Engineer About the ProjectResponsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs usingFastAPIor similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (usingGitHubCopilot, Claude, etc.) to scaffold and generate API/data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts). Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and/or a data lake architecture. Contribute toCI/CDpipelines using GitHub Actions.Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
-
Sr Python Data Engineer
Há 12 horas
Rio do Sul, Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel...
-
Sr. data engineer
Há 2 dias
estado do rio grande do norte, Brasil XML International Tempo inteiroSr Data Engineer (São Paulo, Brazil)Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative.The IDE team creates business...
-
Data Engineer – Databricks | Azure
Há 5 dias
Índio do Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJ Responsabilidades: - Desenvolver e otimizar pipelines de dados utilizando Databricks e...
-
Sr Python Data Engineer
Há 2 horas
Índio do Brasil Softensity Inc Tempo inteiroSenior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...
-
Data Engineer
Há 4 dias
Porto Belo, Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...
-
Data Engineer – Databricks | Azure
Há 5 dias
Índio do Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços...
-
Data Engineer
Há 2 dias
Porto Alegre, Brasil beBeeData Tempo inteiroMaster Data Engineer We are seeking a seasoned expert in data engineering to spearhead the development of high-performance systems for large-scale AI and data pipelines. The ideal candidate will possess expertise in Python programming, as well as strong foundational knowledge in data structures, algorithms, and computational problem-solving. Design and...
-
Data Engineer
Há 7 dias
Índio do Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production.You will design, develop, and...
-
Data Engineer
Há 7 dias
Índio do Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...
-
Sr. Data Engineer
3 semanas atrás
Porto Alegre, Brasil Tecla Tempo inteiro*Native/Bilingual English is required for this role (read/written/spoken)Please upload your CV Resume in English.Monthly salary:$4,000 - $5,000 USDOur partner is looking for a hands-on and entrepreneurial Data Engineer to build and own the data infrastructure across their growing portfolio of minor league teams. In this role, you will be responsible for...
