Middle/Senior Data Engineer for Support
3 semanas atrás
1 week ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Role OverviewAs a Data Engineer on our Support Team, you will be responsible for maintaining robust data pipelines to support our products and services. You will work closely with cross-functional teams to understand data requirements and implement efficient solutions using PySpark. The ideal candidate will have a strong background in data engineering, exceptional problem-solving skills, and a passion for working with large-scale datasets.
Key Responsibilities- Perform ongoing maintenance and optimization of existing data pipelines built with PySpark.
- Monitor pipeline performance and proactively identify areas for improvement to enhance efficiency and reliability.
- Maintain scalable data pipelines using PySpark to support various business needs.
- Ensure that all data is getting refreshed automatically daily as per SLA and data quality is being permanently monitored
- Troubleshoot and resolve complex issues of Foundry users within SLAs
- Optimize and tune existing data pipelines for improved performance and reliability.
- Troubleshoot and resolve data-related issues on time to ensure smooth operation of production systems.
- Document processes, procedures, and troubleshooting steps to facilitate knowledge sharing and maintain system integrity.
- Ensure immediate communications in case of Foundry outages and delays, but also for upcoming changes and other support information to end users.
- Implement continuous improvement of existing processes
- 3-4 years of experience working as a Data Engineer, strongly focusing on building data pipelines using PySpark.
- Proficiency in Python programming and experience with relevant libraries and frameworks.
- Solid understanding of distributed computing principles and experience with Apache Spark.
- Experience working with large-scale datasets and designing efficient data processing workflows.
- Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues in production environments.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Intermediate+ English level
- Readiness to work with TypeScript
- Experience with Palantir Foundry or similar data integration and analytics platforms is a plus
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
- not applicable for freelancers
- Not Applicable
- Full-time
- Information Technology and Engineering
- Software Development
Referrals increase your chances of interviewing at N-iX by 2x
Get notified about new Senior Data Engineer jobs in Brazil.
Brazil R$11,000.00-R$12, hours ago
Brazil R$12,600.00-R$16,500.00 2 weeks ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr-
Shopify Support Developer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil AgileEngine Tempo inteiroJoin to apply for the Shopify Support Developer (Middle/Senior) ID38554 role at AgileEngine1 week ago Be among the first 25 applicantsJoin to apply for the Shopify Support Developer (Middle/Senior) ID38554 role at AgileEngineAgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+...
-
Senior Data Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil DBServices Portugal Tempo inteiroWe are looking for a Senior Data Engineer to join global projects, working with modern technologies across front-end and back-end layers. This is a 3 to 12-month contract , renewable based on project availability and performance. Tasks Develop and optimize scalable, high-performing, secure, and reliable data pipelines that address diverse business needs...
-
Senior Data Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Azion Tempo inteiroJoin to apply for the Senior Data Engineer role at Azion2 days ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at AzionGet AI-powered advice on this job and more exclusive features.About AzionWe are a global leader in the application and security industry. Our platform allows companies to operate with agility, reducing...
-
Middle/Senior DevOps Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Provectus Tempo inteiroAbout Provectus Provectus helps companies adopt ML/AI to transform the ways they operate, compete, and drive value. The focus of the company is on building ML Infrastructure to drive end-to-end AI transformations, assisting businesses in adopting the right AI use cases, and scaling their AI initiatives organization-wide in such industries as Healthcare &...
-
Senior data engineer
3 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Netvagas Tempo inteiroAbout AzionWe are a global leader in the application and security industry. Our platform allows companies to operate with agility, reducing latency and increasing the reliability of their applications. We are focused on simplifying application building and looking for passionate and innovative individuals to join our teamAt Azion you will have the...
-
Senior data engineer
3 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Netvagas Tempo inteiroAbout Azion We are a global leader in the application and security industry. Our platform allows companies to operate with agility, reducing latency and increasing the reliability of their applications. We are focused on simplifying application building and looking for passionate and innovative individuals to join our team At Azion you will have the...
-
Python Engineer
3 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil AgileEngine Tempo inteiroJoin to apply for the Python Engineer (Middle) ID39656 role at AgileEngine 2 days ago Be among the first 25 applicants Join to apply for the Python Engineer (Middle) ID39656 role at AgileEngine AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the...
-
Senior HPC Data Engineer
3 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil N-iX Tempo inteiroAbout the Role We are looking for an experienced Data Service Module Engineer to develop and deploy the data service module for the HPC modeling project. This role focuses on implementing high-performance data storage and retrieval systems using HDF5 or similar, with parallel and concurrent I/O capabilities. The ideal candidate will have expertise in...
-
Data Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Elios Talent Tempo inteiroData Engineer – Microsoft Azure (Contractor) Remote (Brazil, supporting EST/CST hours) | 4–5 Month Contract | Collaboration via TeamsOverviewWe are seeking a Data Engineer (short-term contractor) to design and implement data acquisition and ETL processes in Microsoft Azure to support enterprise reporting needs. You will be responsible for integrating...
-
Senior Data Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Oowlish Tempo inteiroJoin Our TeamOowlish, one of Latin America's rapidly expanding software development companies, is seeking experienced technology professionals to enhance our diverse and vibrant team.As a valued member of Oowlish, you will collaborate with premier clients from the United States and Europe, contributing to pioneering digital solutions. Our commitment to...
