
Senior Data Engineer
2 semanas atrás
Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Responsibilities- Use Python and SQL to efficiently create, extract, transform, and optimize very large datasets
- Troubleshoot data and data processes and develop solutions for improvement
- Develop and maintain data models, schemas, and documentation
- Contribute as a hands-on engineer while sometimes taking the lead in the technical design and solution
- Collaborate daily with data scientists, food scientists, product owners, team members, API developers, architects, and DevOps engineers
- Advise other developers, both junior and senior, and share best practices
This job description is not intended to be all-inclusive. Employees may be asked to perform additional tasks as required, that may or may not be related to their primary duties.
Required Qualifications- Minimum 7 years' experience using Python for analyzing, extracting, creating, and transforming large datasets
- Proficiency in Python 3+ and common Python libraries and tools for data engineering, specifically Pandas, NumPy, and Jupyter Notebooks
- Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server
- Solid understanding of database design principles, data modeling, and data warehousing concepts
- Excellent troubleshooting skills and instincts
- Curious, self-motivated, and self-directed; comfortable working within an Agile software development team with short, iterative delivery cycles
- College degree or equivalent experience in computer science, software development, engineering, information systems, math, food science, or other applicable field of study
- NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing
- Exposure to Terraform or other Infrastructure-as-Code tooling
- Proficient in Azure DevOps for source code and pipeline management
Location: Remote
Job Type: Full Time
Seniority level- Mid-Senior level
- Full-time
- Information Technology
- Internet Publishing
Referrals increase your chances of interviewing at FoodChain ID by 2x
Get notified about new Senior Data Engineer jobs in Brazil.
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
-
Senior Data Engineer
1 semana atrás
Brasil beBeeDataEngineering Tempo inteiro US$80.000 - US$120.000Senior Data Engineer - Azure RemoteThis role involves designing, developing, and maintaining large-scale data processing systems using Azure Data Factory.RequirementsBachelor's degree in Computer Science or related field.Minimum 5 years of experience with data engineering, including Azure Data Factory and Databricks.Excellent knowledge of SQL for data...
-
Data Engineer Sênior
2 semanas atrás
Brasil beBeeEngenheiro Tempo inteiro R$900.000 - R$1.200.000Vaga de Data Engineer Sênior Somos uma equipe de profissionais em constante evolução, comprometidos com a inovação e o desenvolvimento de soluções que impactem positivamente o mercado de saúde. Estamos procurando por um profissional experiente para desempenhar o papel de Data Engineer Sênior.Aqui você terá a oportunidade de trabalhar em projetos...
-
Senior Data Engineer
2 semanas atrás
Brasil Avenue Code Tempo inteiroWe are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.Key Responsibilities:Build and optimize ETL pipelines with AWS Glue.Work with AWS S3, Glue,...
-
Senior Data Engineer
4 semanas atrás
Brasil Pride Global Tempo inteiroWe're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location : Remote – Brazil only Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...
-
Senior Data Engineer
2 semanas atrás
Brasil Covalenty Tempo inteiroSobre a Covalenty Somos um SaaS-enabled B2B marketplace que conecta farmácias independentes aos seus fornecedores, ajudando a cadeia de suprimentos farmacêutica a ser mais eficiente, inteligente e integrada. Nosso propósito é garantir que o estoque ideal esteja no lugar certo, na hora certa — da indústria à farmácia.Senior Data EngineerNa Covalenty,...
-
Senior Data Engineer
1 semana atrás
Brasil beBeeData Tempo inteiro R$750.000 - R$1.100.000Senior Data Engineer - We are seeking a highly skilled and motivated professional to join our team as a Senior Data Engineer. In this pivotal role, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines and ETL processes that empower business units with efficient data processing and utilization.">Key...
-
Senior Data Engineer
Há 4 dias
Brasil Fullstack Labs Tempo inteiroSenior Data Engineer - Remote - Latin America at FullStack LabsJoin to apply for the Senior Data Engineer - Remote - Latin America role at FullStack Labs.About FullStackFullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on-demand projects.We focus on...
-
Senior Data Engineer
Há 2 dias
Brasil Pride Global Tempo inteiro🚀 We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay 📍 Location : Remote – Brazil only 🗣️ Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing...
-
Senior Data Engineer
Há 7 dias
Brasil beBeeData Tempo inteiro R$80.000 - R$100.000We are seeking an experienced Senior Data Engineer to lead the design, development, and implementation of data solutions that enable our organization to make informed decisions and improve overall performance.ResponsibilitiesDesign and develop scalable data architectures that meet business requirementsCollaborate with cross-functional teams to understand...
-
Senior Data Engineer
Há 5 dias
Brasil FullStack Labs Tempo inteiroSenior Data Engineer - Remote - Latin America at FullStack Labs Join to apply for the Senior Data Engineer - Remote - Latin America role at FullStack Labs . About FullStack FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on-demand projects. We focus...