Data Engineering

3 semanas atrás

Curitiba, Paraná, Brasil Neo BI Solution Tempo inteiro

Data Engineering 

The primary goal of the data engineering team is to identify the company's needs related to data analysis, science, and engineering in order to build a high-performance, selfservice data platform for Analytics Engineers, Data Analysts, and Data Scientists. This enables them to easily build outstanding large-scale data pipelines with ready abstractions for reliability, scalability, performance, security, quality, profiling, documentation, lineage, among other features. You will work within a unique and challenging big data ecosystem, focusing on storage efficiency, scalable and highperformance queries, extensibility, flexibility, and related challenges, with the objective of helping to better measure data quality. 

Responsibilities:


• Build and maintain a high-performance data platform that meets company needs, integrates with product solutions, and drives analytical innovation, enabling exceptional engineering and efficient platforms.


• Align with stakeholders to understand their primary needs, while maintaining a holistic view of the problem and proposing extensible, scalable, and incremental solutions.


• Contribute to defining the strategic vision, crossing team and service boundaries to solve complex problems. Design, develop, and optimize frameworks and utilities for ingestion, processing, and transformation. Create comprehensive documentation of platform features and operational processes. 

What we are looking for:


• Understanding of Big Data technologies, solutions, and concepts (Spark, Trino, Hive, Iceberg, Delta Lake, Hudi) and multiple languages (YAML, Python), including knowledge of integrating them effectively.


• Proficient with Databricks.


• Familiarity with Data Processing Architectures (Lambda, Kappa, Event Sourcing).


• Proficiency in Python or another major programming language, with a passion for writing clean and maintainable code. You might even be a Software Engineer with a focus or passion for data-driven solutions.


• Experience with data orchestration tools (Airflow, Dagster, Prefect).


• Understanding of the data lifecycle and related concepts such as lineage, governance, privacy, retention, anonymization, etc.


• Excellent communication skills, proactively sharing information and seeking context to effectively collaborate with various teams.


• Conduct code reviews and evaluations, advocating for software development best practices focused on engineering excellence and operational quality.


• Provide Level 2 and Level 3 support for libraries, tools, and services

Languages


• Fluent English communication skills, both written and spoken.

Location: Remote

Model: Service Contract (PJ - Independent Contractor)

  • Data Engineering Specialist

    1 dia atrás

    Curitiba, Paraná, Brasil beBeeDataEngineering Tempo inteiro US$90.000 - US$120.000

    Job Title: Data Engineering SpecialistAbout the RoleWe are seeking a skilled and experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering, cloud platforms, and back-end development.Key ResponsibilitiesDesign, develop, and maintain large-scale data pipelines using cloud-based services such...

  • Ll02-250113 Engineering Compliance Specialist

    Há 10 horas

    Curitiba, Paraná, Brasil Validation & Engineering Group Tempo inteiro

    **_Validation & Engineering Group, Inc._**(V&EG) is a leading services supplier who provides solutions for the Pharmaceutical, Biotechnology, Chemical, Food, and Medical Devices industries in the following areas: Laboratory, Compliance, Computer, Engineering, Project Management, Validation, and other services.We are seeking a talented, dedicated individual...

  • Engineering Manager

    3 semanas atrás

    Curitiba, Paraná, Brasil Canonical Tempo inteiro

    Join to apply for the Engineering Manager - Data Platform role at Canonical1 month ago Be among the first 25 applicantsJoin to apply for the Engineering Manager - Data Platform role at CanonicalGet AI-powered advice on this job and more exclusive features.Canonical is building a comprehensive suite of multi-cloud and on-premise data solutions for the...

  • Data Engineering Lead

    1 dia atrás

    Curitiba, Paraná, Brasil beBeeDataEngineer Tempo inteiro R$90.000 - R$118.000

    Lead Data EngineerFounded in 2017, we rapidly became a leader in data analytics. Recognized as one of America's Best Startup Employers, we focus on delivering advanced analytics that supports data-driven decisions. Our solutions provide comprehensive insights and forecasts, enabling us to have a better understanding and response to supply and demand.We are...

  • Data Engineering Specialist

    1 dia atrás

    Curitiba, Paraná, Brasil beBeeDataEngineer Tempo inteiro R$79.260 - R$118.477

    Job OpportunityWe are seeking a highly skilled professional to fill a Data Engineer position in our global clinical research initiative. This is an exciting opportunity for a detail-oriented individual who is comfortable working in a collaborative, remote environment.Key Responsibilities:Collect and ingest large volumes of real-world data, including medical...

  • Engineering Manager

    3 semanas atrás

    Curitiba, Paraná, Brasil Canonical Tempo inteiro

    Engineering Manager - Public Cloud, Python, GolangJoin to apply for the Engineering Manager - Public Cloud, Python, Golang role at CanonicalEngineering Manager - Public Cloud, Python, Golang1 day ago Be among the first 25 applicantsJoin to apply for the Engineering Manager - Public Cloud, Python, Golang role at CanonicalCanonical is a leading provider of...

  • Specialist Data Scientist

    3 semanas atrás

    Curitiba, Paraná, Brasil AB Volvo Tempo inteiro

    Select how often (in days) to receive an alert: Specialist Data Scientist - Powertrain Engineering Location:Curitiba, BR, 81260-900 Position Type: Professional Transport is at the core of modern society. Imagine using your expertise to shape sustainable transport and infrastructure solutions for the future? If you seek to make a difference on a global...

  • Enterprise Data Solutions Architect

    Há 12 horas

    Curitiba, Paraná, Brasil beBeeData Tempo inteiro R$117.120 - R$168.672

    As a seasoned data professional, you will design, implement, and maintain large-scale data pipelines using the Snowflake platform. This role offers a unique opportunity to drive business growth through strategic data management.Key ResponsibilitiesYou will develop scalable data architectures to ingest and transform data from various sources.Collaborate with...

  • Specialist Data Scientist

    4 semanas atrás

    Curitiba, Paraná, Brasil AB Volvo Tempo inteiro

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Specialist Data Scientist - Powertrain Engineering Location:Curitiba, BR, 81260-900 Position Type: Professional Transport is at the core of modern society. Imagine using your expertise to shape sustainable transport and...

  • Ll01-241028 Validation Specialist

    4 semanas atrás

    Curitiba, Paraná, Brasil Validation & Engineering Group Tempo inteiro

    **_Validation & Engineering Group, Inc. _**(V&EG) is a leading services supplier who provides solutions for the Pharmaceutical, Biotechnology, Chemical, Food, and Medical Devices industries in the following areas: Laboratory, Compliance, Computer, Engineering, Project Management, Validation, and other services.We are seeking a talented, dedicated individual...