Sr Python Data Engineer

Há 7 dias

Nova Santa Rita, Brasil Softensity Inc Tempo inteiro

Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts). Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and / or a data lake architecture. Contribute to CI / CD pipelines using GitHub Actions. Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have : Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding. Softensity is an equal-opportunity employer. All qualified applicants are considered without regard to gender, identity, or personal background. #J-18808-Ljbffr

  • Sr Python Data Engineer

    4 semanas atrás

    Nova Santa Rita, Brasil Softensity Inc Tempo inteiro

    Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....

  • Sr Python Data Engineer

    Há 7 dias

    Nova Santa Rita, Brasil Softensity Inc Tempo inteiro

    Senior Python Data Engineer About the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...

  • Sr Python Data Engineer

    Há 4 dias

    Nova Lima, Brasil Softensity Inc Tempo inteiro

    Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...

  • Sr Python Data Engineer

    Há 5 dias

    Lagoa Santa, Brasil Softensity Inc Tempo inteiro

    Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs usingFastAPIor similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute to...

  • Data Engineer

    3 semanas atrás

    Santa Cruz do Sul, Brasil Insight Global Tempo inteiro

    Position: Data Engineer Location: Remote in Brazil Duration: 3 year+ PJ Contract Monthly Salary Range: 3-5k USD/Month Requirements: 3+ years of experience in Data Engineering Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse/Databricks are also acceptable Advanced Data Manipulation experience using SQL, Pandas,...

  • Data Engineer

    Há 3 dias

    Lagoa Santa, Brasil Brick Abode Tempo inteiro

    Data Engineer – Brick Abode We are a software development company serving clients in multiple countries, valuing a strong computer science foundation and autonomy for our engineers. We look for a responsible and proactive professional who navigates between technology and business contexts with ease, thrives in fast‑paced environments, and communicates...

  • Data Engineer

    1 dia atrás

    Morada Nova, Brasil Brick Abode Tempo inteiro

    Data Engineer - Brick Abode Join us as a Data Engineer at Brick Abode, a software development company serving clients worldwide. We value a strong computer science base and offer autonomy, continuous learning, and direct communication with business stakeholders. About Brick Abode We are a software development company that serves clients from multiple...

  • Data Engineer

    Há 3 dias

    Santa Luzia, Brasil Brick Abode Tempo inteiro

    Join to apply for the Data Engineer role at Brick Abode . We are a software development company that serves clients from multiple countries around the world, with differing technological needs. We value a strong computer science foundation and welcome contractors who have a solid understanding of today’s technology. People here have autonomy, are in touch...

  • Senior Data Engineer

    Há 24 horas

    Nova Lima, Brasil Applaudo Tempo inteiro

    About You You are a Senior Data Engineer who enjoys building reliable, scalable data platforms and enabling data-driven and AI-powered products.You feel comfortable owning data pipelines end to end, working closely with analytics and AI/Data Science teams, and translating complex data problems into robust technical solutions.You value clean architecture,...

  • Data Engineer

    Há 3 dias

    Lagoa Santa, Brasil Brick Abode Tempo inteiro

    Data Engineer – Brick AbodeWe are a software development company serving clients in multiple countries, valuing a strong computer science foundation and autonomy for our engineers.We look for a responsible and proactive professional who navigates between technology and business contexts with ease, thrives in fast-paced environments, and communicates...