Sr Python Data Engineer
Há 2 horas
Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code.Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools).Participate in design discussions for future migration to Snowflake and/or a data lake architecture.Contribute to CI/CD pipelines using GitHub Actions.Required Skills and ExperienceStrong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl).Experience building backend services or APIs using frameworks like FastAPI.Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar).Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.Softensity is an equal-opportunity employer. All qualified applicants are considered without regard to gender, identity, or personal background.
-
Sr. data engineer
Há 24 horas
Brasil ADM Tempo inteiroJob Summary Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance? ADM is seeking a Sr. Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value. The Sr. Data Engineer is responsible for...
-
Data Engineer – Databricks | Azure
Há 5 dias
Índio do Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJ Responsabilidades: - Desenvolver e otimizar pipelines de dados utilizando Databricks e...
-
Data Engineer – Databricks | Azure
Há 5 dias
Índio do Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI, consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico.Modelo: RemotoRegime: PJResponsabilidades:Desenvolver e otimizar pipelines de dados utilizando Databricks e serviços...
-
Data Engineer
Há 7 dias
Índio do Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production. You will design, develop,...
-
Data Engineer
Há 7 dias
Índio do Brasil HeartCentrix Solutions Tempo inteiroWe are seeking a highly skilled Python Data Engineer with an AI/ML focus to join our client's growing data & analytics team in Brazil. This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists to bring models into production.You will design, develop, and...
-
Sr python data engineer
2 semanas atrás
Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using Fast API or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....
-
Sr python data engineer
Há 24 horas
Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using Fast API or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....
-
Sr python data engineer
1 dia atrás
Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using Fast API or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....
-
Data Engineer
Há 7 dias
Índio do Brasil Insight Global Tempo inteiroPosition: Data Engineer Location: Remote in Brazil Duration: 3 year+ PJ Contract Monthly Salary Range: 3-5k USD/Month Requirements: - 3+ years of experience in Data Engineering - Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse/Databricks are also acceptable - Advanced Data Manipulation experience using SQL,...
-
SR Python Engineer + Java
3 semanas atrás
Brasil Ascendion Tempo inteiroAscendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. We are looking...
