Senior Python Engineer
Há 1 mês
Hello
We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile.
Role: Senior Python Engineer
Duration: 2+ Months
Location: Brazil ( REMOTE )
Mandatory Skills : Experience with Airflow on Kubernetes or KEDA
We are seeking a highly skilled Senior Python Engineer to join our Technical Data Delivery team. In this role, you will be pivotal in developing and managing critical components of our data platform, including Data APIs (REST APIs), Apache Airflow, and data engineering artifacts such as data ingestion and data curation pipelines. This position requires strong proficiency in Python, Apache Airflow, REST APIs, Azure DevOps, and Azure cloud services.
Responsibilities:
1. Collaborate closely with the Data Engineering Lead to devise effective data ingestion strategies aligned with business objectives.
2. Define and implement robust data ingestion patterns and processes to ensure efficient and reliable data flow into the organization's data platform.
3. Contribute to the development and deployment of Apache Airflow on Azure Kubernetes Service (AKS).
4. Develop and maintain reusable data engineering or ETL pipelines and codebases using Python, Airflow, REST APIs, PySpark, Databricks, and the Azure cloud platform.
5. Design and implement robust data APIs using Python frameworks such as FastAPI or Flask, and deploy them on Azure App Service.
6. Work with cross-functional teams to understand data requirements and provide scalable data engineering solutions.
7. Design and implement batch and streaming data architectures leveraging Azure cloud services like Azure Data Factory and Azure Databricks.
8. Ensure adherence to software engineering best practices, including version control, testing, and continuous integration/continuous deployment (CI/CD) processes.
9. Participate in code reviews, technical discussions, and knowledge-sharing sessions within the team.
Skills (must have):
1. Strong experience in Python programming language.
2. Extensive experience with Apache Airflow and its deployments on Azure Kubernetes Service.
3. Extensive experience with Apache Airflow developments like Dynamic DAGs and Airflow Rest API’s
4. Hands-on experience with Python frameworks like FastAPI or Flask and deploying REST APIs on Azure App Service.
5. Sound understanding of software engineering development practices, including version control, testing, and continuous integration/continuous deployment (CI/CD) with proven experience using Azure DevOps
6. Demonstrated experience of core data engineering concepts and principles.
7. Proficiency in designing and implementing reusable and scalable data engineering pipelines and codebase.
8. Solid experience in designing batch and streaming data architectures using Azure cloud platform services.
9. Effective problem-solving skills and the ability to troubleshoot complex data engineering issues.
10. Commitment to continuous learning and staying updated with industry trends and best practices in data engineering.
11. Strong communication and collaboration skills with English language proficiency. Ability to work effectively in a team environment, provide training, and document processes.
Skills (nice to have):
1. Proficiency in writing PySpark code for data processing and transformation.
2. Familiarity with Python tools like Pytest, tox, poetry.
3. Familiarity with Python testing frameworks like pytest and build tools like tox and poetry.
Thank You
Satti Reddy
-
Senior Python Engineer
Há 1 mês
Brazil YASH Technologies Tempo inteiroHello We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile. Role: Senior Python Engineer Duration: 2+ Months Location: Brazil ( REMOTE ) Mandatory Skills : Experience with Airflow on Kubernetes or KEDA We are seeking a highly skilled Senior Python Engineer to...
-
Senior Python Engineer
Há 1 mês
Brazil, BR YASH Technologies Tempo inteiroHello We are actively looking for a Senior Python Engineer. If you or your consultant are actively looking for a new job please share your profile.Role: Senior Python EngineerDuration: 2+ Months Location: Brazil ( REMOTE ) Mandatory Skills : Experience with Airflow on Kubernetes or KEDAWe are seeking a highly skilled Senior Python Engineer to join our...
-
Senior Backend Software Engineer
Há 1 mês
Brazil MetaCTO Tempo inteiroAt MetaCTO, we specialize in helping startups and growing companies turn visionary ideas into successful digital products through expert app development and fractional CTO services. As a Senior Backend Software Engineer, you’ll focus on building scalable, reliable backend systems that power innovative applications for our clients. This role will work...
-
Senior Full Stack Engineer
Há 4 dias
Brazil Cinnamon Inc. Tempo inteiroSenior Full Stack Software EngineerJob Title: Senior Full Stack Software EngineerLocation: Remote (Brazil)Job Type: Full-timeAbout Us:We are a healthcare startup dedicated to improving patient advocacy through technology. Our software automates processes to assist patient advocates in their efforts to help patients afford their medical bills by enrolling...
-
Data Engineer
Há 4 dias
Brazil, BR Insight Global Tempo inteiroMust-haves:5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..)Snowflake data warehousingPython & SQL codingDay to Day:Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data analytics...
-
Data Engineer
Há 4 dias
Brazil Insight Global Tempo inteiroMust-haves:5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..)Snowflake data warehousingPython & SQL codingDay to Day:Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data analytics...
-
Senior Software Engineer
4 semanas atrás
Brazil Linkeen Tempo inteiroJoin Our Team as a Senior Backend Engineer!Are you passionate about cutting-edge backend technologies and building scalable, serverless applications? Do you have strong experience in AWS Serverless, AppSync, DynamoDB, GraphQL, and Lambda functions? If you have a knack for designing performant APIs, and it’s a bonus if you have some experience with AI...
-
Senior Software Engineer
2 semanas atrás
Brazil, BR Orange Quarter Tempo inteiroOrange Quarter have partnered with the fastest growing scale-up in the world and I’m helping them hire Senior Software Engineers for their teams in LATAM as they accelerate towards IPO.They have a market leading HR and Payroll platform that is used by over 35,000 businesses across 150+ countries.This role entails being part of a truly cross-functional...
-
Senior Software Engineer
2 semanas atrás
Brazil Orange Quarter Tempo inteiroOrange Quarter have partnered with the fastest growing scale-up in the world and I’m helping them hire Senior Software Engineers for their teams in LATAM as they accelerate towards IPO.They have a market leading HR and Payroll platform that is used by over 35,000 businesses across 150+ countries.This role entails being part of a truly cross-functional...
-
Senior Back-End Developer
Há 4 dias
Brazil, BR Flatiron Software Co Tempo inteiroJob Title: Senior Backend Developer (Python)About:Flatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide...
-
Senior Back-End Developer
Há 4 dias
Brazil Flatiron Software Co Tempo inteiroJob Title: Senior Backend Developer (Python)About:Flatiron is a global remote software development company with engineers located around the world. We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exceptional products and services for our clients. As a forward-thinking software engineering company, we provide...
-
Senior Data Engineer
2 semanas atrás
São Paulo, Brazil, BR BL Consultants Tempo inteiroSenior Data Engineer - São Paulo, Brazil - RemoteAbout the Role: Our client is looking for a Senior Data Engineer to be a technical powerhouse to help us scale our data infrastructure, automation and tools to meet growing business needs.You’re excited about this opportunity because you will…Work with business partners and stakeholders to understand data...
-
Senior DevOps Engineer
1 semana atrás
Brazil TLR Ventures Tempo inteiroThis is a freelance contractor position.TLR Ventures is biotech startup backed by Jackson Laboratories, a leading global biomedical lab. We are developing a transformational technology platform for biomedical research that’s going to make a big difference in how drugs are discovered and how diseases are cured. The platform is a scientific data collection...
-
Senior DevOps Engineer
2 semanas atrás
Brazil, BR TLR Ventures Tempo inteiroThis is a freelance contractor position.TLR Ventures is biotech startup backed by Jackson Laboratories, a leading global biomedical lab. We are developing a transformational technology platform for biomedical research that’s going to make a big difference in how drugs are discovered and how diseases are cured. The platform is a scientific data collection...
-
Senior Test Automation Engineer
Há 1 mês
Brazil Sigma Software Group Tempo inteiroWe’re seeking a Senior/Principal Test Automation Engineer to lead testing efforts alongside the customer and product team. Ready for the challenge? Join us!In this role, you will work to develop and maintain automated tests and test frameworks that ensure high-quality software without the need for manual testing. The Test Automation Engineer will work...
-
Senior DevOps Engineer
1 semana atrás
Brazil The React Hub Tempo inteiroPosition: Senior DevOps EngineerLocation: Brazil– Fully remote (B2B Contract)The React Hub has partnered with an iGaming & Crypto start-up partner who is looking to add an AWS expert to their growing Dev teamAbout the role:The Lead Engineer is looking to hire their first DevOps Engineer, who can take charge and help improve their infrastructure. They...
-
Senior Backend Engineer
Há 4 dias
Brazil Station70 Tempo inteiroJob Type: Full-time, Remote (US CST, EST, MST time zones)About Station70Station70 is redefining digital asset security through our wallet-agnostic platform for scalable and secure digital asset key backup and recovery. Named after the protective bunkers used in the CASTLE nuclear tests, we offer trusted infrastructure for safeguarding assets against wallet...
-
Senior Backend Engineer
Há 3 dias
Brazil Station70 Tempo inteiroJob Type: Full-time, Remote (US CST, EST, MST time zones)About Station70Station70 is redefining digital asset security through our wallet-agnostic platform for scalable and secure digital asset key backup and recovery. Named after the protective bunkers used in the CASTLE nuclear tests, we offer trusted infrastructure for safeguarding assets against wallet...
-
Senior Backend Engineer
Há 4 dias
Brazil, BR Station70 Tempo inteiroJob Type: Full-time, Remote (US CST, EST, MST time zones)About Station70Station70 is redefining digital asset security through our wallet-agnostic platform for scalable and secure digital asset key backup and recovery. Named after the protective bunkers used in the CASTLE nuclear tests, we offer trusted infrastructure for safeguarding assets against wallet...
-
Senior Machine Learning Engineer
2 meses atrás
Brazil ATRA Tempo inteiroVaga: Machine Learning Engineer - MLOps Descrição da Vaga: Estamos à procura de um(a) Machine Learning Engineer especializado(a) em Google Cloud para integrar nosso time. O profissional terá a principal função de operacionalizar modelos criados pelas áreas usuárias, utilizando práticas de MLOps para garantir a eficiência e escalabilidade das...