Data Engineer for Scalable Data Solutions

Há 3 dias

Brasil beBeeDataEngineer Tempo inteiro US$90.000 - US$120.000

We are specialists in data transformation, combining human expertise with AI to create scalable solutions.

With 30 years of history and partnerships with over 1,000 clients, we've built a strong foundation in data-driven innovation. Artificial Intelligence is our reality.

Data Journey Partnership

Since 2017, we have collaborated with Databricks to help enterprise customers gather valuable insights from their data. Together, we significantly influence our clients' data journeys. With over 200 seasoned Databricks practitioners and a track record of successful enterprise projects, our partnership is exceptionally robust.

We're seeking a talented Databricks Senior Data Engineer to play a crucial role in developing and maintaining scalable data pipelines and infrastructure. You'll drive data analytics and machine learning solutions for our clients.

Main Responsibilities

Design and Develop Data Pipelines: Create robust, scalable data pipelines using Databricks, Apache Spark, and SQL to transform and process large datasets efficiently.

Data Architecture: Collaborate with data architects to design data models and architecture that support data analytics and machine learning applications.

Performance Optimization: Monitor and optimize the performance of existing data pipelines and workflows to ensure high throughput and low latency.

Collaboration with Stakeholders: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical specifications.

Data Quality and Governance: Implement data quality checks and governance practices to ensure data consistency, accuracy, and compliance.

Documentation and Best Practices: Maintain comprehensive documentation for data pipelines and processes, and contribute to the establishment of best practices within the team.

Mentorship: Provide guidance and mentorship to junior team members, fostering a culture of learning and collaboration.

Necessary Qualifications

Experience: 5+ years of experience in data engineering or a related field, with a focus on data pipelines and ETL processes.

Soft Skills: Excellent communication in English, with the ability to work effectively in a team-oriented environment and engage with clients.

Technical Skills: Proficiency in Databricks, Apache Spark, SQL, and Python (or Scala).

Cloud Technologies: Experience with cloud platforms such as Azure, AWS, or GCP, particularly related to data storage and processing solutions.

Big Data Technologies: Experience with additional big data technologies such as Hadoop, Kafka, or Airflow.

Data Modeling: Strong understanding of data modeling concepts and experience with relational and NoSQL databases.

Problem-Solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.

Benefits

-Health insurance

-Meal allowance

-Childcare assistance

-Extended paternity leave

-Partnership with gyms and health professionals via Wellhub;

-Profit Sharing and Results Participation (PLR);

-Life insurance

-Continuous learning platform;

-Discount club

-Free online platform dedicated to physical and mental well-being

Inclusive Environment

We value diversity and inclusion. If you're a person with a disability, please let us know during the selection process so we can ensure your comfort and success.

  • Cloud Data Solutions Architect

    Há 2 dias

    Brasil beBeeDataEngineer Tempo inteiro US$90.000 - US$120.000

    We transform lives by delivering innovative solutions, even in the most complex cases.About the RoleA seasoned data engineer will design and develop scalable data solutions to elevate our data infrastructure and drive business insights. This position involves collaborating with cross-functional teams for seamless integration, processing, and analysis across...

  • Building Scalable Data Platforms

    Há 3 dias

    Brasil beBeeData Tempo inteiro US$90.000 - US$120.000

    Senior Data EngineerAs a Senior Data Engineer, you will play a key role in building scalable data platforms and cutting-edge MLOps solutions. You will work with a fast-paced US-based company, leading innovations in sustainable commerce and data-driven operations.Responsibilities: Design, develop, and maintain robust, scalable data infrastructure across...

  • Senior Data Engineer

    2 semanas atrás

    Brasil Pride Global Tempo inteiro

    We're Hiring: Senior Data Engineer (MLOps) | Remote from Brazil | Fluent English required | USD-Hourly pay Location : Remote – Brazil only Language : Fluent English required Are you passionate about building scalable data platforms and cutting-edge MLOps solutions? Do you want to work with a top-tier US company revolutionizing e-commerce and circular...

  • Data Engineer

    1 semana atrás

    Brasil Insight Global Tempo inteiro

    Insight Global – Brazil RemoteJob Title: Data Engineer (azure)Type: Long term Contract Position (6 months extending, multi year long contract)Compensation: 18,000-21,000 BRL Per MonthLocation: RemoteInterview Process: Immediate Interviews Available – 1 roundStart Date: ASAP (9/8)Priority scheduling for candidates who:Submit resume promptlyAre available...

  • Data Engineer

    Há 8 horas

    Brasil Luxoft Tempo inteiro

    Project Description:The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration,...

  • Snowflake Data Engineer

    2 semanas atrás

    Brasil Onebridge Tempo inteiro

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Senior Data Engineer

    Há 2 dias

    Brasil beBeeData Tempo inteiro R$750.000 - R$1.100.000

    Senior Data Engineer - We are seeking a highly skilled and motivated professional to join our team as a Senior Data Engineer. In this pivotal role, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines and ETL processes that empower business units with efficient data processing and utilization.">Key...

  • DATA ENGINEER

    Há 7 dias

    Brasil 4DF Connect Tempo inteiro

    OverviewDATA ENGINEER ( SnowFlake ) role at 4DF ConnectWe\'re hiring a Data Engineer with advanced skills in Snowflake, Databricks, and Azure (Terraform). Strong experience in data pipelines, ETL, and data migration is required. Advanced English is a must. You\'ll drive technical decisions and collaborate across teams.What you\'ll doAs a Data Engineer, you...

  • Senior Data Solutions Engineer

    Há 5 dias

    Brasil beBeeData Tempo inteiro R$60.000 - R$100.000

    As a pivotal member of our data solutions team, you will play a key role in crafting and implementing cutting-edge data strategies using Azure technologies. This is an exciting opportunity to collaborate with industry-leading tools and contribute to the success of our organization.Key Responsibilities:Design and develop scalable data pipelines using Azure...

  • Senior Data Engineer

    4 semanas atrás

    Brasil Perform Tempo inteiro

    Join to apply for the Senior Data Engineer role at Perform1 month ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at PerformWe are seeking a skilled and motivated Data Engineer to join our Business Technology team. The team is responsible for driving business data analytics and ensuring robust data engineering practices....