Big Data Developer

2 meses atrás

São Paulo, Brasil Talan Tempo inteiro
Job Description

What you will be doing?

As a Backend Spark Developer, you'll play a key role in bringing technical and functional visions to life. You'll work closely with Solution Designers, Business Architects, and Business Analysts to develop, test, and deploy high-quality solutions that meet and exceed internal standards. Your work will be essential in ensuring optimal performance, reliability, and alignment with our quality benchmarks, driving impactful results for the organization.

We need somebody like you to help our client in different fronts:

  • develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
  • certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery.

Qualifications

What are we looking for?

Required qualifications

  • At least 3 years of experience working with Spark with Scala, software design patterns, and TDD.
  • Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus.
  • Experience and expertise across data integration and data management with high data volumes.
  • Experience working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
  • Experience with different database structures, including (Postgres, SQL, Hive)
  • English (at least B2+)

Preferred qualifications

  • Jenkins
  • Bash script
  • Control-M
  • Software development life cycle (HP ALM...)
  • Basics of cybersecurity & Quality (Sonar, Fortify…)
  • Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)
  • SOA Architecture


Additional Information

What do we offer you?

  • Full-time contract
  • Smart Office Pack so that you can work comfortably from home. 
  • Training and career development 
  • Benefits and perks such as private medical insurance, life insurance, lunch and travel cards as part of the flexible remuneration package 
  • Possibility to be part of a multicultural team and work on international projects 
  • Hibrid position based in Málaga, Spain. Realocation is mandatory
  • Possibility to manage work-permits.

If you are passionate about development & tech, we want to meet you

  • Senior Developer

    3 meses atrás

    São Leopoldo, RS, Brasil SAP Tempo inteiro

    **We help the world run better** At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...

  • Developer - Big Data Fabric Services (Bdfs)

    3 meses atrás

    São Leopoldo, RS, Brasil SAP Tempo inteiro

    **We help the world run better** At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...

  • Senior Developer

    4 semanas atrás

    São Leopoldo, Brasil SAP Tempo inteiro

    Senior Developer - Big Data Fabric Services (BDFS) At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our...

  • Blazor Developer – Data Meaning

    2 meses atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    Titulo da Vaga: Blazor Developer Nome da Empresa: Data Meaning Salário: Localização: São Paulo – SP Descrição da Vaga: Location: BR/LatAmPosition Type: Full timeLength of the contract: 6 months Data Meaning is a boutique global consultancy, Alteryx 2020 Global Partner of the Year, a Tableau Premiere Partner, & Microsoft Gold Partner. We provide...

  • Estágio Controladoria Big Data

    6 meses atrás

    Sao Paulo, Brasil Voith Group Tempo inteiro

    **About the Voith Group** Buscamos um estagiário(a) apaixonado(a) por dados para integrar nossa equipe! Se você é especialista em análise de dados, adora participar de projetos desafiadores e tem experiência em colaboração interdisciplinar, essa vaga é para você. Venha fazer parte do nosso time e contribuir para a otimização de processos...

  • Big Data Developer

    2 meses atrás

    São Paulo, SP, Brasil Talan Tempo inteiro

    **Company Description** Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.** We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities: - ** CONSULTING** in management and innovation...

  • Engenheiro Big Data

    Há 1 mês

    São Paulo, Brasil Winnin Tempo inteiro

    O mundo é ágil e nos cobra agilidade!Acreditamos que a inovação é, antes de tudo, uma atitude. Decidir, surpreender, testar e implantar novas realidades e redefinir o futuro. Queremos criar ideias que transformem pessoas e, assim, impulsionar as pessoas a transformar o mundo.Como conquistamos esta transformação:Provocando a mudança da mentalidade de...

  • Big Data Developer

    Há 14 horas

    São Paulo, Brasil Talan Tempo inteiro

    Company Description Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€. We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities: CONSULTING in management and innovation:...

  • Developer -SAP Big Data Fabric Services

    6 meses atrás

    São Leopoldo, Brasil SAP Tempo inteiro

    We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...

  • Especialista em Big Data Cloudera

    4 semanas atrás

    São Paulo, São Paulo, Brasil Runtalent Tempo inteiro

    Olá!Runtalent, com DNA inovador, é uma empresa consolidada no mercado de tecnologia e especializada em soluções de TI há quase duas décadas. Acompanhamos todos os avanços tecnológicos dos últimos anos e estamos juntos nessa corrida pela transformação digital.Temos uma oportunidade para um Especialista em Big Data Cloudera - Sênior. Local: São...

  • Desenvolvedor de Soluções de Big Data

    Há 1 mês

    São Carlos, São Paulo, Brasil Experian Asia Pacific Pty Tempo inteiro

    Contexto da VagaA Experian Asia Pacific Pty está procurando por um profissional experiente em desenvolvimento de soluções de big data para trabalhar em nossos projetos corporativos. O candidato ideal terá experiência com ferramentas de cloud e DevOps, além de habilidades em banco de dados e desenvolvimento de aplicações.

  • Senior Blazor Developer Position in Data Analytics

    4 semanas atrás

    São Paulo, São Paulo, Brasil Data Meaning Tempo inteiro

    At Data Meaning, a leading global consultancy, we seek an experienced Senior Blazor Developer to join our team. As a key member of our data analytics group, you will be responsible for creating high-performance web applications using the Blazor framework.The ideal candidate will have a solid understanding of web development technologies and a proven track...

  • Big Data Architect

    6 meses atrás

    Sao Paulo, Brasil Caylent Tempo inteiro

    We are a fully remote global company with employees in Canada, the United States and Latin America. We celebrate the culture of each of our team members and foster a community of technological curiosity. Come talk to us to learn more about what it means to be a Caylien! **The Mission**: At Caylent, a Big Data Architect works as an integral part of a...

  • Analista De Dados Big Data Sênior

    Há 1 mês

    São Paulo, Brasil Marketdata Tempo inteiro

    Descrição da Vaga: Estamos em busca de um(a) Analista de Dados Big Data Sênior com expertise em soluções de dados na nuvem, especialmente na AWS, para desenvolver e otimizar pipelines de dados e apoiar as áreas de negócios com insights estratégicos. Se você é apaixonado(a) por transformar dados em soluções e insights acionáveis, essa...

  • IT Developer Iii

    3 semanas atrás

    São Paulo, SP, Brasil Santander Tempo inteiro

    IT Developer III - Data Country: Brazil **# QUEM SOMOS **A F1RST é o futuro e sua carreira está aqui! Nossa cultura é baseada em “Pessoas, Inovação e Resultados”. ️ Fazemos parte do maior banco Internacional do Brasil, um dos maiores bancos do mundo. Promovendo serviços e experiências para os mais de 60 milhões de clientes de todo o...

  • Docente Ciência da Computação

    Há 1 mês

    São João da Boa Vista, Brasil Unifeob Tempo inteiro

    Com a missão de transformar vidas por meio da educação, trabalhamos incansavelmente para proporcionar uma experiência memorável aos nossos colaboradores, estudantes, fornecedores e todos que fazem parte do #TimeUnifeob. Aqui você vai encontrar um ambiente colaborativo, que preza por seus valores e o engajamento de toda a equipe com o objetivo de...

  • Data Scientist

    Há 7 dias

    São Paulo, Brasil Data Meaning Tempo inteiro

    Data Scientist - Qualified Pipeline Location: Latam/US Position Pay: Salary depends on experience POSITION SUMMARY: Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and LATAM. Our expertise lies in delivering tailored solutions in Business...

  • Development Expert

    Há 1 mês

    São Leopoldo, RS, Brasil SAP Tempo inteiro

    **We help the world run better** At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and...

  • Qualified Pipeline

    2 meses atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    Qualified Pipeline - Power Automate/Power Apps Developer Location: USA, Brazil or Latin America Position Type: Full time or Part Time Position Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in delivering...

  • Qualified Pipeline

    1 semana atrás

    São Paulo, Brasil Data Meaning Tempo inteiro

    Qualified Pipeline - Power Automate/Power Apps Developer Location: USA, Brazil or Latin America Position Type: Full time or Part Time Position SummaryData Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in delivering...