Senior Data Engineer Streaming
Há 2 dias
The key to our success is simple; we deliver the highest quality, on time, with passion and commitment, and live every day by a set of great values. We've built a company that fosters long-term careers in an environment of continuous learning, with cutting-edge benefits, tools, and resources. In addition, certifications that endorse our company as a great place to work.
Responsibilities
- 10+ years of experience in software engineering or data engineering roles, with a focus on real-time data processing.
- Deep expertise in streaming technologies, especially Apache Flink.
- Strong experience with AWS services (Kinesis, Lambda, S3, Glue, EMR, ECS, Redshift).
- Proficiency with Apache Iceberg or similar (Delta Lake, Hudi).
- Proven experience in joining streaming and batch data (watermarking, state management, consistency models).
- Strong skills in SQL for data transformations, exploration, and performance tuning.
- Hands-on experience with data exchange pipelines delivering large datasets securely to multiple consumers.
- Strong understanding of distributed systems, networking, and modern data architecture.
- Programming experience in Java, Scala, or Python.
- Experience with BI or frontend data layers (Qlik a plus).
- Advanced English.
- Experience with data cataloging and governance tools.
- Familiarity with data mesh or decentralized data architectures.
- Knowledge of frontend frameworks or dashboarding systems for data applications.
- Design and develop scalable, low-latency streaming data pipelines using Apache Flink on AWS.
- Architect and implement solutions to join streaming and batch data with strong focus on accuracy, consistency, and performance.
- Build and maintain infrastructure for efficient and secure data exchange, delivering large-scale datasets to internal teams and external partners.
- Leverage Apache Iceberg (or similar) for reliable, scalable data table formats across streaming and batch systems.
- Write, optimize, and maintain complex SQL queries for analytics and platform integration.
- Work with AWS Redshift for scalable batch processing and BI workloads.
- Collaborate with data scientists, product teams, and platform engineers to enable real-time analytics and new data-driven features.
- Contribute to the evolution of the data platform architecture, focusing on observability, reliability, and developer self-service.
- Partner with frontend engineers to support data visualization and exploration workflows (experience with Qlik or other BI tools is a plus).
#LI-REMOTE
About usAssureSoft is a multinational software development and information technology company providing strategic consulting, technology services, and outsourcing business processes. We work to innovate and create quality software with motivated, passionate, and qualified teams that develop in an environment of professional, stable growth and continuous learning.
Inclusive Opportunities for Every Talent. At AssureSoft, we believe that true innovation is born from diversity—of ideas, experiences, and perspectives. That's why our hiring practices are inclusive and reflect a firm commitment to equity and equal opportunity.
Here, every person—regardless of origin, gender, orientation, or beliefs—finds a space to grow, contribute, and be valued not only for their talent, but also for who they are.
- Great Place To Work certification.
- A company with more than 15 years of experience.
- Work with world-class clients and long-term projects.
- English scholarships for an external institute.
- English classes with company teachers.
- State-of-the-art tools and resources.
- Certifications for your professional growth.
- Recreation and leisure activities.
- Compliance with the regulations and labor rights of your region.
Retention of your personal information: AssureSoft will retain your personal information for as long as necessary to fulfill the purposes for which it was collected or as necessary to comply with our legal obligations, resolve disputes, and maintain appropriate business records. Once the purpose has been fulfilled, your personal information will be retained and blocked due to the possibility of legal and governmental requirements, and until the status of limitations has run out.
Important Notice Regarding Personal Information: If you do not want your personal and professional information to be retained in our database, please send your request for data removal to
-
Data Engineer
2 semanas atrás
LATAM, Brasil b95d905b-7fde-4d5f-a6a3-5594bd29ce12 Tempo inteiro US$80.000 - US$150.000 por anoWhat were looking for Data Engineer (Only for people located in Latinamerica).Were looking for a Data Engineer/Azure Data Factory/Azure DatabricksKey ResponsibilitiesDesign, implement, and maintain pipelines using Azure Data Factory (ADF) to ingest data from various sources: transactions (orders), product, pricing, inventory, customer etc. into Azure...
-
Senior Data Specialist
2 semanas atrás
LATAM, Brasil HopHR Tempo inteiro US$100.000 - US$150.000 por anoWe are supporting a specialized VC firm in financial services, with offices in New York, London, and Berlin, focused on building, backing, and buying technology-enabled financial and business services companies. The firm is incubating a new insurtech venture aimed at digitizing life-insurance distribution across North America and expanding into...
-
Senior QA Engineer
Há 7 dias
LATAM, Brasil b22e5990-6c7e-41d4-a3d0-12e10dae0a72 Tempo inteiro US$80.000 - US$120.000 por anoAbout TruelogicAt Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we've been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.Our team of 600+ highly skilled...
-
Senior Backend Engineer
2 semanas atrás
LATAM, Brasil bdf2baf5-7374-4f2d-bae9-e8fe605e3919 Tempo inteiro R$80.000 - R$150.000 por anoCompany DescriptionBlend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...
-
Senior Backend Software Engineer
Há 6 dias
LATAM, Brasil Squad Tempo inteiro R$80.000 - R$150.000 por anoAbout our ClientOur client is a privately held, early-stage company pioneering the use of artificial intelligence to transform mental health paradigms and develop a new category of psychological fitness. The organization is focused on creating a world where individuals and communities are empowered to proactively identify and address psychological challenges...
-
QA Automation Engineer
Há 4 dias
LATAM, Brasil Sofka Tempo inteiro R$40.000 - R$80.000 por anoAre you passionate about ensuring top-notch quality in web applications? Do you love working with cutting-edge automation tools and contributing to impactful projects for international clients? If so, we want you on our team We're looking for a skilled QA Automation Engineer with strong experience in Playwright, JavaScript, and automation...
-
Cloud DevOps Engineer
Há 5 dias
LATAM, Brasil Azumo Tempo inteiro R$90.000 - R$120.000 por anoAzumo is currently looking for a highly motivated Cloud DevOps Engineer to develop and maintain cloud infrastructure for next-generation web, mobile, and IoT Applications. The position is FULLY REMOTE based in Latin America.IT Infrastructure Management:● Provisioning of infrastructure components for supporting business services● Developing, configuring,...
-
Data Scientist Specialist
Há 16 horas
LATAM - Remote, Brasil Invisible Agency Tempo inteiro US$120.000 - US$180.000 por anoData Scientist SpecialistWhat You'll DoYou'll design and implement data science and machine learning solutions that blend cutting-edge research with practical deployment. Working across industries, domains, and use cases, you'll tackle challenging analytical problems, build robust models, and deliver insights that power client-facing tools and internal...
-
Senior ML Engineer
1 semana atrás
USA - NYC|LATAM - Sao Paulo|Manhasset - NY|USA - NYC - Brooklyn|USA - NYC - Newark, Brasil Rad Hires Tempo inteiro US$120.000 - US$180.000 por anoSenior Machine Learning EngineerBase Salary: 100K USD annuallyWork Model: Hybrid – 3 days per week on-site in the office in Santo Amaro, SPAbout the RoleWe're looking for an experienced Machine Learning Engineer to design, build, and scale intelligent data products that support real-world applications. This position bridges data engineering, model...
-
Senior Director
2 semanas atrás
LATAM - Remote, Brasil phData Tempo inteiro US$120.000 - US$240.000 por anoSenior Director, Data Engineering (Brazil)About phData phData is an AI-forward engineering company focused on getting enterprise data and AI workloads in production for some of the largest and most well-known companies in the world.We specialize in the most complex data, machine learning, and AI problems that only the best engineers can solve. From the top...