LLM Operations

About Truelogic

At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.

Our team of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that make a difference.

By applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

Our client is a subscription-based market research company that provides insights and trends related to digital marketing, media, and commerce.

Our client seeks an LLM Operations & Governance Specialist to manage their AI infrastructure and governance framework. This individual contributor role supports engineering and content teams in building effective, compliant AI agents while optimizing costs and performance. The company has strong executive support for AI transformation, making this a high-impact position.

Infrastructure & Operations

• Manage LLM infrastructure including Claude API, OpenAI
• Troubleshoot agent deployments and API integration issues
• Support engineering teams with technical implementation questions
• Maintain development and production environments for AI agents

Governance & Compliance

• Develop and maintain AI usage policies and guidelines
• Ensure compliance with emerging AI regulation
• Conduct risk assessments for new AI implementations
• Document governance frameworks and safety protocols

Monitoring & Optimization

• Implement Datadog monitoring for AI services
• Build dashboards tracking usage, performance, and costs
• Generate reports on API utilization and spending
• Identify cost optimization opportunities

Enablement & Adoption

• Deploy adoption surveys and analyze results
• Lead training sessions on AI tools and best practices
• Create technical documentation and user guides
• Track AI adoption metrics across departments

• Bachelor's degree or equivalent experience
• 1-3 years in technical operations, support, or related roles
• Daily user of AI tools (ChatGPT, Claude, or similar)
• Python scripting capabilities for automation and API interactions
• Experience with monitoring and observability tools
• Strong analytical and problem-solving skills
• Clear written and verbal communication abilities

• 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.

• Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.

• Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.

• Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.

• Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.

• A Culture That Values You: We prioritize well-being and work-life balance, offering engagement activities and fostering dynamic teams to ensure you thrive both personally and professionally.

• Diverse, Global Network: Connect with over 600 professionals in 25+ countries, expand your network, and collaborate with a multicultural team from Latin America.

• Team Up with Skilled Professionals: Join forces with senior talent. All of our team members are seasoned experts, ensuring you're working with the best in your field.