AWS Data Processing Expert
2 semanas atrás
Job Description We are looking for a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using AWS. Your primary focus will be on building scalable, efficient, and secure data pipelines using tools like PySpark, AWS Glue, and Amazon S3. You will work closely with cross-functional teams to ensure seamless integration with other systems and applications. This is an excellent opportunity for someone who wants to learn and grow with a dynamic company. Key Responsibilities Design and develop large-scale data processing systems using AWS Build scalable, efficient, and secure data pipelines using PySpark, AWS Glue, and Amazon S3 Work closely with cross-functional teams to ensure seamless integration with other systems and applications Requirements Proven experience with AWS (API Gateway, Lambda/Fargate, S3, Glue, CloudWatch) Strong knowledge of PySpark (partitioning, joins, optimization) Experience with Glue Data Catalog and querying via Athena Experience with integration and manipulation of data in REST APIs Knowledge of infrastructure as code (Terraform or CloudFormation) Good practices in version control (Git) and CI/CD Benefits Professional development and constant evolution of your skills Opportunities to work outside Brazil A collaborative, diverse, and innovative environment that encourages teamwork Others We offer a range of benefits to support your well-being and career growth. Our company promotes an inclusive culture and values diversity, equity, and inclusion. We are committed to creating a workplace where everyone feels valued, respected, and empowered to contribute their best work. ),
-
Expert Data Processing Specialist
2 semanas atrás
Brazil beBeeDataEngineer Tempo inteiroSenior Data Engineer The role entails design, build and maintain high-performance data processing pipelines. Develop scalable data processing pipelines using Python libraries (Pandas, Polars). Consume and process normalized Parquet files from multiple sources to generate dynamic reports. Collaborate with cross-functional teams on designing and implementing...
-
Chief Data Architect
2 semanas atrás
Brazil beBeeDataEngineer Tempo inteiroData Engineering Position We are looking for a skilled Data Engineer to join our team and help us drive innovation in data processing and storage. Design and implement scalable data processing systems using AWS technologies and serverless architectures. Develop data ingestion pipelines and integration processes to ensure smooth data transfer from various...
-
Brazil beBeeBackend Tempo inteiroSenior Backend Engineer Opportunity Are you ready to build a high-quality, scalable data processing pipeline and collaborate with our team to take our product to market? We're seeking an experienced Senior Backend (Typescript) Engineer to join our innovative startup on an initial 12-month contract basis. The ideal candidate will be comfortable with AWS...
-
Big Data Expert
3 semanas atrás
Brazil beBeeDataEngineer Tempo inteiroJob Description Aubay Portugal is a multinational French company with offices in Lisbon and Oporto. It specializes in Management, Implementation, Development and Maintenance of Information Systems. The company has over 150 active partners and operates in various sectors such as banking, insurance, telecommunications, services, energy and transports. What...
-
Senior Data Engineer
2 semanas atrás
Brazil Breakthrough Talent Tempo inteiroSenior Data EngineersBreakthrough Talent is currently supporting a leading data business build a brand new data platform to support a modern data mesh organisation. They work with national and global clients across data, software and digital consulting, and they are now looking for a Data Infrastructure Engineer to help build and scale their next generation...
-
Transformational Data Architect
2 semanas atrás
Brazil beBeeDataEngineer Tempo inteiroJob Title: Senior Data Engineer About the Role We are seeking a highly skilled Data Engineer to join our team and play a key role in building and maintaining our next generation data platform. This is an exciting opportunity for someone who enjoys owning infrastructure, building reusable solutions, and supporting data teams with analytics and AI ready...
-
Transformative Data Engineer
3 semanas atrás
Brazil beBeeData Tempo inteiroJob Overview We are seeking a skilled Cloud Solutions Architect to lead the design and implementation of scalable data pipelines using Databricks. The ideal candidate will have hands-on experience with Databricks, AWS-based application development, and strong collaboration skills. Key Responsibilities Design and develop scalable data pipelines using...
-
Senior Data Engineer
2 semanas atrás
Brazil Breakthrough Talent Tempo inteiroSenior Data Engineers Breakthrough Talent is currently supporting a leading data business build a brand new data platform to support a modern data mesh organisation. They work with national and global clients across data, software and digital consulting, and they are now looking for a Data Infrastructure Engineer to help build and scale their next generation...
-
Real-Time Data Engineering Expert
Há 5 dias
Brazil beBeeDataEngineer Tempo inteiroAs a skilled professional in data engineering, you will be responsible for designing and implementing scalable data pipelines using Databricks and Kafka. Mandatory Skills: +5 years of experience in data engineering roles Proven expertise with Databricks (Spark, Delta Lake, notebooks, performance tuning) Strong hands-on experience with Apache Kafka (topics,...
-
Data Engineering
Há 2 dias
Brazil Luxoft Tempo inteiroProject Description: Join a team focused on backend and data engineering for headend applications at a leading video content provider. This role emphasizes Python-based services, AWS data workflows, and integration with AI/LLM frameworks to enable advanced media processing capabilities. Mandatory Skills Description: Strong Python development experience....
