Sr Python Data Engineer
Há 5 dias
Senior Python Data Engineer
About the Project
Responsibilities
- Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars).
- Develop and expose RESTful APIs using FastAPI or similar frameworks.
- Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports.
- Contribute to a spec-driven development workflow (using GitHub Copilot, Claude, etc.) to scaffold and generate API/data pipeline code.
- Optimize report generation logic for speed and scalability, currently targeting sub-20 second response times.
- Integrate with messaging and storage mechanisms (e.g., Service Bus, Storage Accounts).
- Collaborate on infrastructure-as-code automation using Bicep (or similar IaC tools).
- Participate in design discussions for future migration to Snowflake and/or a data lake architecture.
- Contribute to CI/CD pipelines using GitHub Actions.
Required Skills and Experience
- Strong proficiency in Python for data processing (must have expertise in Pandas, nice to have: Polars, openpyxl).
- Experience building backend services or APIs using frameworks like FastAPI.
- Solid understanding of data modeling principles (Star Schema) and handling normalized datasets.
- Familiarity with enterprise messaging patterns and data integration from various sources (API-based and file-based).
- Experience working with GitHub and CI/CD pipelines (GitHub Actions or similar).
- Infrastructure-as-Code experience with Bicep or comparable tools (Terraform, AWS CDK).
- Comfort with spec-driven development and leveraging AI tools like GitHub Copilot for scaffolding.
-
Sr Python Data Engineer
Há 2 dias
Brasília, Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the ProjectResponsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs usingFastAPIor similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....
-
Sr. Data Engineer
Há 2 dias
Brasília, Brasil XML International Tempo inteiroSr Data Engineer (São Paulo, Brazil) Become part of a community of experts in Information Digital Engineering (IDE), turning ideas into reality by embedding AI across the organization. From enhancing existing operations to accelerating the development of next-generation clean energy solutions, your impact will be transformative. The IDE team creates...
-
Sr Python Data Engineer
Há 2 dias
Brasília, Brasil Softensity Inc Tempo inteiroSenior Python Data EngineerAbout the ProjectResponsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs usingFastAPIor similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel reports....
-
Senior Python Developer
Há 2 dias
Brasília, Brasil beBeeData Tempo inteiroJob Overview As a Senior Python Data Engineer, you will design, build and maintain high-performance data processing pipelines using leading-edge technologies like Pandas and Polars. This role is perfect for individuals with strong proficiency in Python for data processing, experience building backend services or APIs using FastAPI, a solid understanding of...
-
Python/ Data Engineer
1 dia atrás
Brasília, DF, Brasil Luxoft Tempo inteiroJoin a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities. Responsibilities: Design and develop backend and data pipelines using Python. Development...
-
Sr. Data Engineer
2 semanas atrás
Brasília, Brasil Tecla Tempo inteiro*Native/Bilingual English is required for this role (read/written/spoken) Please upload your CV Resume in English. Monthly salary: $4,000 - $5,000 USD Our partner is looking for a hands-on and entrepreneurial Data Engineer to build and own the data infrastructure across their growing portfolio of minor league teams. In this role, you will be responsible...
-
Sr. Data Engineer
2 semanas atrás
Brasília, Brasil Tecla Tempo inteiro*Native/Bilingual English is required for this role (read/written/spoken) Please upload your CV Resume in English. Monthly salary: $4,000 - $5,000 USD Our partner is looking for a hands-on and entrepreneurial Data Engineer to build and own the data infrastructure across their growing portfolio of minor league teams. In this role, you will be responsible for...
-
Sr. data engineer
2 semanas atrás
Brasília, Brasil Tecla Tempo inteiro*Native/Bilingual English is required for this role (read/written/spoken)Please upload your CV Resume in English.Monthly salary:$4,000 - $5,000 USDOur partner is looking for a hands-on and entrepreneurial Data Engineer to build and own the data infrastructure across their growing portfolio of minor league teams. In this role, you will be responsible for...
-
Data Engineer
Há 6 dias
brasília, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Sr. Data Engineer
2 semanas atrás
Brasília, Brasil Tecla Tempo inteiro*Native/Bilingual English is required for this role (read/written/spoken)Please upload your CV Resume in English.Monthly salary: $4,000 - $5,000 USDOur partner is looking for a hands-on and entrepreneurial Data Engineer to build and own the data infrastructure across their growing portfolio of minor league teams. In this role, you will be responsible for...
