Sr Python Data Engineer
2 semanas atrás
Senior Python Data Engineer About the Project Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API / data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts). Collaboration & Automation Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and / or a data lake architecture. Contribute to CI / CD pipelines using GitHub Actions. Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have : Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI / CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding. Equal Opportunity Employer Softensity is an equal-opportunity employer. All qualified applicants are considered without regard to gender, identity, or personal background. #J-18808-Ljbffr
-
Sr. Data Engineer
3 semanas atrás
Manaus, Brasil Xml International Tempo inteiroSr Data Engineer (São Paulo, Brazil)Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative.The IDE team creates business...
-
Sr Python Data Engineer
2 semanas atrás
Manaus, Brasil Softensity Inc Tempo inteiroSenior Python Data EngineerAbout the ProjectDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute to a spec-driven...
-
High-Performance Data Processing Specialist
3 semanas atrás
Manaus, AM, Brasil beBeeData Tempo inteiroJob Description: As a Sr Python Data Engineer, you will be responsible for designing, building, and maintaining high-performance data processing pipelines using Python libraries. Your expertise in leveraging the capabilities of Pandas and Polars to process large datasets efficiently is highly sought after.
-
Backend Data Engineer
2 semanas atrás
Manaus, Brasil beBeeDataEngineer Tempo inteiroBackend Data Engineer Role We are seeking an experienced Backend Data Engineer to lead the development of our data pipelines and services. This role emphasizes Python-based architecture, AWS data workflows, and integration with AI/ML frameworks to enable advanced media processing capabilities. Key Responsibilities: Design and develop scalable backend...
-
Python/ Data Engineer
1 semana atrás
Manaus, Brasil Luxoft Tempo inteiroJoin a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities. Responsibilities: Design and develop backend and data pipelines using Python. Development...
-
Python/ Data Engineer
1 semana atrás
Manaus, Brasil Luxoft Tempo inteiroJoin a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities. Responsibilities: - Design and develop backend and data pipelines using Python. - Development...
-
Backend Data Engineer
2 semanas atrás
Manaus, Brasil Bebeedataengineer Tempo inteiroBackend Data Engineer RoleWe are seeking an experienced Backend Data Engineer to lead the development of our data pipelines and services.This role emphasizes Python-based architecture, AWS data workflows, and integration with AI/ML frameworks to enable advanced media processing capabilities.Key Responsibilities:Design and develop scalable backend services...
-
Senior Data Engineer
Há 5 dias
Manaus, Brasil Bebeedata Tempo inteiroAbout the RoleWe are seeking a highly skilled data engineer to join our team.This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities.
-
Senior Data Engineer
3 semanas atrás
Manaus, Brasil beBeeData Tempo inteiroAbout the Role We are seeking a highly skilled data engineer to join our team. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities.
-
Data Engineer
1 dia atrás
Manaus, Brasil Zunzun Solutions Tempo inteiroSummary: We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise-grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the...
