
Data Engineer
Há 4 dias
Join AgileEngine as a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. We are an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. Our people-first culture has earned us multiple Best Place to Work awards. ABOUT THE ROLE We are looking for a Senior Data Engineer to work with AWS and big data frameworks like Hadoop and Spark to drive impactful data initiatives across the company. RESPONSIBILITIES Design, build, and maintain large-scale data pipelines and data processing systems in AWS. Develop and optimize distributed data workflows using Hadoop, Spark, and related technologies. Collaborate with data scientists, analysts, and product teams to deliver reliable and efficient data solutions. Implement best practices for data governance, security, and compliance. Monitor, troubleshoot, and improve the performance of data systems and pipelines. Mentor junior engineers and contribute to building a culture of technical excellence. Evaluate and recommend new tools, frameworks, and approaches for data engineering. REQUIREMENTS Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. 5+ years of experience in data engineering, software engineering, or related roles. Strong hands-on expertise with AWS services (S3, EMR, Glue, Lambda, Redshift, etc.). Deep knowledge of big data ecosystems, including Hadoop (HDFS, Hive, MapReduce) and Apache Spark (PySpark, Spark SQL, streaming). Strong SQL skills and experience with relational and NoSQL databases. Proficiency in Python, Java, or Scala for data processing and automation. Experience with workflow orchestration tools (Airflow, Step Functions, etc.). Solid understanding of data modeling, ETL/ELT processes, and data warehousing concepts. Excellent problem-solving skills and ability to work in fast-paced environments. Ability to work German Time Zone (6-7 am to 2-3 pm Brazil/ART time). Upper-Intermediate English level. NICE TO HAVES Experience with real-time data streaming platforms (Kafka, Kinesis, Flink). Knowledge of containerization and orchestration (Docker, Kubernetes). Familiarity with data governance, lineage, and catalog tools. Previous leadership or mentoring experience. PERKS AND BENEFITS Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. AgileEngine is an equal opportunities employer and welcomes applications from diverse candidates. #J-18808-Ljbffr
-
Azure Data Engineer
Há 6 dias
Belo Horizonte, Brasil Capitole Tempo inteiroOPPORTUNITY IN BARCELONA, SPAIN About the role We are looking for a skilled Azure Data Engineer to join our international tech team, collaborating with our customer, a global leader in digital solutions .You will design and implement scalable data solutions in the cloud, collaborate with architects and product owners, and mentor other engineers to ensure...
-
Senior Data Engineer
1 semana atrás
Belo Horizonte, Brasil Caderno Nacional Tempo inteiroSenior Data Engineer - Detalhes da Vaga. ? This is a full-time, 100% remote opportunity exclusive to candidates located in Brazil. ? You''ll be working with a fast-paced US-based company, leading innovations in sustainable commerce and data-driven operations. ? What Youll DoDesign, develop, and maintain robust, scalable data infrastructure across real-time...
-
Data Engineer
4 semanas atrás
Belo Horizonte, Brasil buscojobs Brasil Tempo inteiroThis position is fully remote and is a PJ contract. Pay range is 25-29 / hr USD. Required Skills & Experience 5+ years of experience as a Data Engineer with minimum 3 years of experience in Azure tool stack (Databricks, ADF, Synapse Analytics) Good to have experience with other Azure services Azure Functions, Event Grid, etc Strong expertise in writing...
-
Data Engineer
Há 2 dias
Belo Horizonte, Brasil Luxoft Tempo inteiroProject Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...
-
Data Engineer
1 semana atrás
Belo Horizonte, Brasil Luxoft Tempo inteiroProject Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...
-
Data Engineer
3 semanas atrás
Belo Horizonte, Brasil Luxoft Tempo inteiroProject Description: The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week. Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart....
-
Senior Data Engineer
4 semanas atrás
Belo Horizonte, Brasil SecurityScorecard Tempo inteiroJoin to apply for the Senior Data Engineer role at SecurityScorecard 2 days ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at SecurityScorecard Get AI-powered advice on this job and more exclusive features. Funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV, Riverwood...
-
Senior Data Engineer
3 semanas atrás
Belo Horizonte, Brasil Avenue Code Tempo inteiroWe are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.Key Responsibilities:Build and optimize ETL pipelines with AWS Glue.Work with AWS S3, Glue,...
-
Senior Data Engineer
2 semanas atrás
Belo Horizonte, Brasil Avenue Code Tempo inteiroWe are looking for a Senior Data Engineer to design and maintain scalable data pipelines on AWS, ensuring performance, quality, and security. You will collaborate with data scientists and analysts to integrate data from multiple sources and support AI/ML initiatives.Key Responsibilities:Build and optimize ETL pipelines with AWS Glue.Work with AWS S3, Glue,...
-
Data Engineer
4 semanas atrás
Belo Horizonte, Brasil Ryz Labs Tempo inteiroJoin to apply for the Data Engineer role at Ryz Labs . Ryz Labs is looking for a Data Engineer to help enhance and stabilize the data monitoring system for one of our biggest clients. The role focuses on building robust, scalable, and proactive alerting workflows to ensure high data quality and reliability across pipelines. You will collaborate with the...