Sr Python Data Engineer
2 semanas atrás
Senior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports. Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code. Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times. Integrate with messaging and storage mechanisms (e.G., Service Bus, Storage Accounts). Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools). Participate in design discussions for future migration to Snowflake and/or a data lake architecture. Contribute to CI/CD pipelines using GitHub Actions. Required Skills and Experience Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl). Experience building backend services or APIs using frameworks like FastAPI. Solid understanding of data modeling principles (Star Schema) and handling normalized datasets. Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based). Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar). Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK). Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding. Softensity is an equal-opportunity employer. All qualified applicants are considered without regard to gender, identity, or personal background.
-
Sr Python Data Engineer
3 semanas atrás
Fortaleza, Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities - Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). - Develop and expose RESTful APIs using FastAPI or similar frameworks. - Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel...
-
Lead Python Data Solutions Architect
2 semanas atrás
Fortaleza, Brasil beBeeData Tempo inteiroProject Overview As a Sr Python Data Engineer, you will play a key role in designing and building high-performance data processing pipelines using Pandas and Polars. Data Pipeline Development: Develop and expose RESTful APIs using FastAPI or similar frameworks. Parquet File Processing: Consume and process normalized Parquet files to generate dynamic Excel...
-
Sr Python Data Engineer
3 semanas atrás
Fortaleza, Brasil Softensity Inc Tempo inteiroSenior Python Data EngineerAbout the ProjectResponsibilitiesDesign, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).Develop and expose RESTful APIs using FastAPI or similar frameworks.Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.Contribute...
-
Python Data Engineer Position
4 semanas atrás
Fortaleza, Brasil beBeeBackend Tempo inteiroWe're seeking a seasoned engineer to craft backend and data pipelines using Python. This role involves developing scalable and reliable Kubernetes-hosted applications, integrating AI/LLM frameworks into production systems, and ensuring seamless collaboration with Agile teams. Key Responsibilities: - Design and develop efficient data workflows using Python,...
-
Lead Python Data Solutions Architect
2 semanas atrás
Fortaleza, CE, Brasil beBeeData Tempo inteiroProject Overview As a Sr Python Data Engineer, you will play a key role in designing and building high-performance data processing pipelines using Pandas and Polars. Data Pipeline Development: Develop and expose RESTful APIs using FastAPI or similar frameworks. Parquet File Processing: Consume and process normalized Parquet files to generate dynamic Excel...
-
Python Data Engineer Position
Há 7 dias
Fortaleza, Brasil Bebeebackend Tempo inteiroWe're seeking a seasoned engineer to craft backend and data pipelines using Python.This role involves developing scalable and reliable Kubernetes-hosted applications, integrating AI/LLM frameworks into production systems, and ensuring seamless collaboration with Agile teams.Key Responsibilities:- Design and develop efficient data workflows using Python, AWS...
-
Python Data Engineer Position
3 semanas atrás
Fortaleza, CE, Brasil beBeeBackend Tempo inteiroWe're seeking a seasoned engineer to craft backend and data pipelines using Python. This role involves developing scalable and reliable Kubernetes-hosted applications, integrating AI/LLM frameworks into production systems, and ensuring seamless collaboration with Agile teams. Key Responsibilities: - Design and develop efficient data workflows using Python,...
-
High-Performing Python Engineer
3 semanas atrás
Fortaleza, Brasil beBeePerformance Tempo inteiroSenior Python Developer Role We are seeking an experienced Senior Python Developer to join our elite team of engineers. The ideal candidate will have a proven track record in designing, building, and optimizing high-performance Python systems for large-scale AI and data workflows. Key Responsibilities: Design and develop modular, clean, and production-ready...
-
Senior Cloud Data Engineer
3 semanas atrás
Fortaleza, CE, Brasil beBeeDataEngineering Tempo inteiroWe are seeking a seasoned Data Engineer with expertise in building scalable pipelines and data infrastructure. Our ideal candidate will have a strong background in cloud environments, SQL, and Python. About the Role This is a hybrid Full-Stack Data Engineer position that combines data engineering with data science overlap. The successful candidate will be...
-
Python Ai/Ml Data Architect
Há 7 dias
Fortaleza, Brasil Bebeedataengineer Tempo inteiroJob Overview:We're seeking a skilled Python Data Engineer with an AI/ML focus to join our data & analytics team in Brazil.This role is ideal for someone who loves building scalable data pipelines, operationalizing machine learning workflows, and partnering closely with data scientists.Design, develop, and maintain data infrastructure that powers AI-driven...
