Senior Data Engineer
Há 5 horas
Mission Responsible for building, managing, and optimizing data pipelines;
Support for defining data flows and access to data sources;
Ensure compliance with data governance, data architecture, and data security requirements.
Responsibilities
Create, maintain, and optimize data pipelines for data structures that encompass data modeling, data transformation, schemas, metadata, and workload management;
Drive Automation through effective metadata management;
Participate in ensuring compliance and governance during data use, including the maintenance of the data catalog;
Collaborate andsupport data owners and other stakeholders around data topics;
Ensure the proper use of the data architecture defined by Data Factory team;
Respect and follow security principles ensuring compliance with data delivery.
Competencies & Skills
Strong experience with various Data Management architectures, mainly AWS environment;
Strong experience with Data Modeling;
Ability to design, build and manage data pipelines;
Experience working with commercial and open source message queuing technologies;
Highly creativeand collaborative;
Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
Specific Technical Knowledge
Solid knowledge in: Databrics, Spark, python, terraform, SQL, Scala, S3, AWS Glue, AWS Athena, AWS Lambda, AWS Step Functions;
Big data, Relational Databases;
Experience in: EMR, Gitflow, Agile Metodology;
DevOps.
Languages
English: Advanced or Fluent
Additional information
Remote work
-
Senior Data Engineer
Há 7 horas
Cuiabá, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Senior Data Engineer
3 semanas atrás
Cuiabá, Brasil Eightpoint Tempo inteiroAbout Eightpoint Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners. With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of...
-
Senior Data Engineer
Há 7 horas
Cuiabá, Brasil Eightpoint Tempo inteiroAbout Eightpoint Eightpoint is an internet technology company specializing in the agile development of products and content that address real-world interests, captivating users and driving significant growth for partners. With offices in the United States and Cayman Islands, Eightpoint collaborates with partners globally on the next generation of...
-
Data Engineer
2 semanas atrás
Cuiabá, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Data Engineer
Há 6 horas
Cuiabá, Brasil Tata Consultancy Services Tempo inteiroCome to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing...
-
Senior Devops Engineer
Há 8 horas
Cuiabá, Brasil Edison Smart Tempo inteiroSenior DevOps Engineer | Remote ±3 GMT (Brazil) | €200 per day | 12 months Role: Senior DevOps Engineer Location: Remote ±3 GMT (Brazil) Rate / Salary: €200 per day Duration: 12 months (extension likely) Language: English I'm partnering with a leading consultancy delivering a large-scale Cloud, DevOps & Data transformation for a major global...
-
Data Engineer
3 semanas atrás
Cuiabá, Brasil Insight Global Tempo inteiroInsight Global is seeking a Data Engineer to join a Workforce Productivity and Data Engineering team and lead initiatives across Microsoft Azure, Fabric, and Databricks platforms onsite in Costa Rica. You will be responsible for designing, building, and maintaining scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Databricks. You...
-
Data Engineer
4 semanas atrás
Cuiabá, Brasil BairesDev Tempo inteiro6 days ago Be among the first 25 applicants At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant...
-
Sr Python Data Engineer
1 semana atrás
Cuiabá, Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities - Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). - Develop and expose RESTful APIs using FastAPI or similar frameworks. - Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel...
-
Sr Python Data Engineer
Há 4 horas
Cuiabá, Brasil Softensity Inc Tempo inteiroSenior Python Data Engineer About the Project Responsibilities Design, build, and maintain high-performance data processing pipelines using Python libraries (Pandas, Polars). Develop and expose RESTful APIs using FastAPI or similar frameworks. Consume and process normalized Parquet files from multiple upstream sources to generate dynamic Excel...
