Senior Data Platform Engineer

About Truelogic

At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we've been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.

Our team of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that make a difference.

By applying for this position, you're taking the first step in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

Our Client

A global leader in go-to-market intelligence, providing real-time business data, insights, and technology to tens of thousands of companies worldwide. Known for its expertise in sales and marketing enablement, data accuracy, and privacy-first practices, the company empowers organizations to discover, engage, and grow their customer base more effectively. With industry-leading compliance standards, a comprehensive product ecosystem, and a reputation for innovation, this organization helps businesses streamline their tech stacks, align teams, and accelerate revenue growth.

Job Summary

We are seeking an experienced Data Platform Engineer to enhance and optimize our enterprise-scale metadata management environment built on OpenMetadata. This role will focus on extending platform functionality, improving ingestion pipelines, enhancing data lineage capture, and integrating with a modern data stack that includes Airflow, RDS, and OpenSearch. You will be responsible for backend feature development, scalability improvements, and system reliability, with a heavy emphasis on automation and custom integration work. This is a highly collaborative role that requires close work with platform engineers, while taking full ownership of feature development and operational stability for the metadata platform.

Responsibilities

• Design, build, and maintain custom OpenMetadata connectors for metadata ingestion.

• Extend and automate data lineage capture from multiple systems and repositories.

• Debug, patch, and enhance backend features to improve stability and scalability.

• Manage containerized deployments (Kubernetes/ECS) and implement monitoring solutions.

• Optimize storage and retrieval using RDS (PostgreSQL/MySQL) and OpenSearch/Elasticsearch.

• Orchestrate metadata workflows with Apache Airflow and integrate with existing pipelines.

• Implement and maintain RBAC with Okta, supporting clear role separation.

• Oversee upgrade management, backup strategies, and high-availability configurations.

Qualifications and Job Requirements

• 5+ years in data engineering or platform engineering roles, with hands-on OpenMetadata experience.

• Proficiency in ECS (AWS), Airflow, RDS, and OpenSearch/Elasticsearch.

• Strong Python development skills for API integrations and connector development.

• Proven experience implementing RBAC and identity management integrations (e.g., Okta).

• Skilled in container orchestration, infrastructure automation, and performance optimization.

• Ability to merge and manage open-source updates into customized codebases.

• Strong problem-solving skills and a track record of delivering production-grade, scalable solutions.

What We Offer

• 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.

• Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.

• Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.

• Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.

• Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.

Why You'll Like Working Here

• A Culture That Values You: We prioritize well-being and work-life balance, offering engagement activities and fostering dynamic teams to ensure you thrive both personally and professionally.

• Diverse, Global Network: Connect with over 600 professionals in 25+ countries, expand your network, and collaborate with a multicultural team from Latin America.

• Team Up with Skilled Professionals: Join forces with senior talent. All of our team members are seasoned experts, ensuring you're working with the best in your field.

Apply now

#J-18808-Ljbffr

---