Sr Python Data Engineer

Há 7 dias


Salvador, Brasil Softensity Inc Tempo inteiro

Senior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code.Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools).Participate in design discussions for future migration to Snowflake and/or a data lake architecture.Contribute to CI/CD pipelines using GitHub Actions.Required Skills and ExperienceStrong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl).Experience building backend services or APIs using frameworks like FastAPI.Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar).Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.



  • Salvador, Brasil Bebeedataengineer Tempo inteiro

    Job SummaryThis position emphasizes service development utilizing Python, coupled with data workflow orchestration and AI/LLM integration.Create scalable and efficient backend systems employing Python as the primary programming language.Leverage AWS services such as Glue, Step Functions, and SQS to streamline data workflows and maintain serverless...


  • Salvador, Brasil beBeeDataEngineer Tempo inteiro

    Job Summary This position emphasizes service development utilizing Python, coupled with data workflow orchestration and AI/LLM integration. Create scalable and efficient backend systems employing Python as the primary programming language. Leverage AWS services such as Glue, Step Functions, and SQS to streamline data workflows and maintain serverless...


  • Salvador, Brasil Agileengine Tempo inteiro

    OverviewAgileEngine is an Inc. **** company that creates award-winning software for Fortune 500 brands and startups across 17+ industries.We rank among leaders in application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.WHY JOIN US If you're looking for a place to grow, make an impact, and work with...


  • Salvador, Brasil Bebeedataengineer Tempo inteiro

    About our Data Engineering Role:We're looking for a talented data engineer to design and build scalable engineering solutions that solve complex business and data problems.As a key member of our team, you'll collaborate with multiple stakeholders to deliver deep-dive analyses and experiment design for new initiatives and high-priority business areas.You'll...

  • Data Engineer

    Há 6 dias


    Salvador, Brasil Bebeedataengineer Tempo inteiro

    Job OpportunityWe are seeking an experienced software engineer to help us develop and maintain automation pipelines for ingesting, mapping, and enriching large datasets from multiple external platforms.The successful candidate will play a key role in connecting our backend systems to external data sources, ensuring our data remains accurate, normalized, and...

  • Data Engineer

    Há 6 dias


    Salvador, Brasil beBeeDataEngineer Tempo inteiro

    Job Opportunity We are seeking an experienced software engineer to help us develop and maintain automation pipelines for ingesting, mapping, and enriching large datasets from multiple external platforms. The successful candidate will play a key role in connecting our backend systems to external data sources, ensuring our data remains accurate, normalized,...


  • Salvador, Brasil Elios Talent Tempo inteiro

    Data Platform Engineer – Senior Key Highlights 🛠️ Lead the design and expansion of large-scale data platform components supporting analytics, experimentation, and machine learning workloads ⚡ Architect and optimize ETL, streaming, metadata, and federated querying systems at scale 📊 Drive performance tuning, observability, and reliability...


  • Salvador, Brasil beBeeDataEngineer Tempo inteiro

    About our Data Engineering Role: We're looking for a talented data engineer to design and build scalable engineering solutions that solve complex business and data problems. As a key member of our team, you'll collaborate with multiple stakeholders to deliver deep-dive analyses and experiment design for new initiatives and high-priority business areas....

  • Senior Data Engineer

    1 semana atrás


    Salvador, Brasil Eightpoint Tempo inteiro

    About EightpointEightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners.With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of user-centric...


  • Salvador, Brasil MetaCTO Tempo inteiro

    Senior Fullstack Engineer (Python, React)MetaCTO – AI Developer – Remote MetaCTO helps companies design, build, and scale high-impact software using modern engineering practices and AI-assisted development workflows. We're hiring a Senior Fullstack Engineer (Python, React) to build client-facing applications, internal platforms, and AI-enabled automation...