Senior Data Engineer
2 semanas atrás
Mission
- Responsible for building, managing, and optimizing data pipelines;
- Support for defining data flows and access to data sources;
- Ensure compliance with data governance, data architecture, and data security requirements.
Responsibilities
- Create, maintain, and optimize data pipelines for data structures that encompass data modeling, data transformation, schemas, metadata, and workload management;
- Drive Automation through effective metadata management;
- Participate in ensuring compliance and governance during data use, including the maintenance of the data catalog;
- Collaborate andsupport data owners and other stakeholders around data topics;
- Ensure the proper use of the data architecture defined by Data Factory team;
- Respect and follow security principles ensuring compliance with data delivery.
Competencies & Skills
- Strong experience with various Data Management architectures, mainly AWS environment;
- Strong experience with Data Modeling;
- Ability to design, build and manage data pipelines;
- Experience working with commercial and open source message queuing technologies;
- Highly creativeand collaborative;
- Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
Specific Technical Knowledge
- Solid knowledge in: Databrics, Spark, python, terraform, SQL, Scala, S3, AWS Glue, AWS Athena, AWS Lambda, AWS Step Functions;
Big data, Relational Databases;
- Experience in: EMR, Gitflow, Agile Metodology;
DevOps.
Languages
- English: Advanced or Fluent
Additional information
- Remote work
-
Data Engineer – Databricks | Azure
3 semanas atrás
Várzea Grande, Brasil UPBI Data & AI Tempo inteiroA UPBI Data & AI , consultoria especializada em soluções digitais, parceira Microsoft e Databricks, está buscando um(a) Data Engineer com sólida experiência em Databricks e Azure para atuação em projeto internacional estratégico. Modelo: Remoto Regime: PJ Responsabilidades: Desenvolver e otimizar pipelines de dados utilizando Databricks e...
-
Data Engineer
2 semanas atrás
Várzea Grande, Brasil Insight Global Tempo inteiroPosition : Data Engineer Location : Remote in Brazil Duration : 3 year+ PJ Contract Monthly Salary Range : 3-5k USD / Month Requirements : 3+ years of experience in Data Engineering Hands on data engineering experience with Microsoft Fabric (highly preferred) or Azure Synapse / Databricks are also acceptable Advanced Data Manipulation experience using SQL,...
-
Senior Data Engineer
3 semanas atrás
Várzea Grande, Brasil Eightpoint Tempo inteiroAbout EightpointEightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners. With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of user-centric...
-
Data Engineer
2 semanas atrás
Várzea Grande, Brasil Design Manager Tempo inteiroJob Title: Data Engineer Location: Remote (Brazil) Employment Type: Full Time Compensation: Competitive hourly rate, commensurate with experience About Design Manager Design Manager (+DesignSpec) is a leading provider of project management and accounting software tailored specifically for interior design firms. For over 30 years, we've helped thousands...
-
Databricks Data Engineer
1 dia atrás
Várzea Grande, Brasil GlobalSource IT Tempo inteiroDatabricks Data Engineer Fully Remote Contract We're looking for a hands-on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high-quality datasets and...
-
Data Engineer
Há 7 dias
Várzea Grande, Brasil Ascendion Tempo inteiroOverview: We are seeking a highly skilled Data Engineer to support the development of personalized search capabilities and data assimilation initiatives within the organization. This is a remote role aligned to the EST time zone. The ideal candidate will have strong experience working with Python, databricks, and Kafka, and will contribute directly to...
-
Senior Gen Ai Engineer
Há 5 dias
Várzea Grande, Brasil unosquare Tempo inteiroSenior Generative AI Engineer – Copilot / Power AutomateSummary We are seeking a Senior Generative AI Engineer with hands-on experience in Microsoft Copilot Studio and Power Automate to support and scale our organization's use of AI-driven productivity tools. This role blends technical expertise in building and optimizing agents with the ability to...
-
Data Engineer
Há 4 dias
Várzea Paulista, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career!Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to...
-
Senior Principal Software Engineer
2 semanas atrás
Várzea Grande, Brasil Software Mind Americas Tempo inteiroWe are Software Mind, an awesome team of engineers who are ready to ramp up any top-notch company's projects! Our aim? To always be one step ahead. Become part of a multicultural company in constant growth with an excellent work environment certified by Great Place To Work! Job Description We are looking for a Senior Principal Software Engineer to join one...
-
Gcp Data Engineer
4 semanas atrás
Várzea Grande, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...