Sr Python Data Engineer

Há 5 dias

Belo Horizonte, Brasil Softensity Inc Tempo inteiro

Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts). Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and/or a data lake architecture. Contribute to CI/CD pipelines using GitHub Actions. Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.

  • Sr Python Engineer + Java

    4 semanas atrás

    Belo Horizonte, Brasil Ascendion Tempo inteiro

    Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients....

  • Sr. Data Engineer

    Há 2 dias

    Belo Horizonte, Brasil Xml International Tempo inteiro

    Sr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization.From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative.The IDE team creates business...

  • Sr. Data Engineer

    Há 7 dias

    Belo Horizonte, Brasil Adm Tempo inteiro

    Job Summary Do you want to join a team passionate about engineering data solutions to inform business decisions and transform business performance?ADM is seeking a Sr.Data Engineer, someone who thrives in an environment continuously integrating and deploying data products and analytics driving business value.The Sr.Data Engineer is responsible for delivery,...

  • Sr Python Data Engineer

    1 semana atrás

    Belo Horizonte, Brasil Softensity Inc Tempo inteiro

    Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...

  • Data Engineer

    2 semanas atrás

    Belo Horizonte, Brasil Vaga Para Data Engineer Tempo inteiro

    Vem ser Inter com a gente Conta digital gratuita, plataforma de investimentos, shopping e o que mais a vida precisar.O Inter é isso, e é muito mais.A gente acredita que tudo pode ser mais simples, e que cada dia é mais uma oportunidade de fazer diferente.Se você também é assim, vem ser #sanguelaranja.Join us in Inter&Co Free digital account, investment...

  • Python/ Data Engineer

    1 semana atrás

    Belo Horizonte, Brasil Luxoft Tempo inteiro

    Join a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities.Responsibilities:- Design and develop backend and data pipelines using Python.- Development...

  • Senior Data Engineer

    2 semanas atrás

    Belo Horizonte, Brasil beBeeDataEngineer Tempo inteiro

    As a senior data engineer, you will be responsible for designing and implementing robust data pipelines using Python. The ideal candidate should have expert-level proficiency in Python and its relevant ecosystem, including Flask, Django, and FastAPI for backend development, as well as pandas for data manipulation. Strong working experience with modern...

  • Data Center Engineer

    Há 3 dias

    Belo Horizonte, Brasil Georgiatek Systems Inc. Tempo inteiro

    Title: Data Center (Engineer/ Sr Engineer/ SME) Location: São Paulo, Brazil (Hybrid) Type: Contract (PJ) Job Description: Required Skills (Must Have and should meet all the below standards for qualifying to this role) Knowledge on Routing and switching Technologies like IGP, OSPF, EGP, BGP, STP, RSTP, VTP, VSS, vPC, vDC, MSTP, LACP, VLAN, Knowledge on Data...

  • Data Engineer Ii

    2 semanas atrás

    Belo Horizonte, Brasil Vaga Para Data Engineer Ii Na Inter Carreiras Tempo inteiro

    Vem ser Inter com a gente Conta digital gratuita, plataforma de investimentos, shopping e o que mais a vida precisar.O Inter é isso, e é muito mais.A gente acredita que tudo pode ser mais simples, e que cada dia é mais uma oportunidade de fazer diferente.Se você também é assim, vem ser #sanguelaranja.Join us in Inter&Co Free digital account, investment...

  • Senior Data Engineer

    2 semanas atrás

    Belo Horizonte, Brasil Bebeedataengineer Tempo inteiro

    As a senior data engineer, you will be responsible for designing and implementing robust data pipelines using Python.The ideal candidate should have expert-level proficiency in Python and its relevant ecosystem, including Flask, Django, and FastAPI for backend development, as well as pandas for data manipulation.Strong working experience with modern frontend...