Empregos atuais relacionados a Senior Software Engineer Opportunity with Large Language Model Evaluation - Porto Alegre, Rio Grande do Sul - beBeeSoftware
-
Senior Software Engineer
2 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil beBeeSoftware Tempo inteiro R$900.000 - R$1.200.000Job Title: Senior Software EngineerThis position involves collaborating with experienced architects, product managers, and other developers to develop critical enhancements and features in a leading data platform.As a senior developer, you will be responsible for delivering end-to-end feature development from requirements through design and development of...
-
Senior Software Engineer Leader
1 semana atrás
Porto Alegre, Rio Grande do Sul, Brasil beBeeSoftwareEngineer Tempo inteiro R$100.000 - R$120.000Job Title: Senior Software Engineer LeaderDescription:We're seeking a skilled Senior Software Engineer to lead our development team. This is an exciting opportunity for a motivated professional looking to drive innovation in the tech industry.Key Responsibilities:- Collaborate with cross-functional teams to identify technical needs and develop solutions.-...
-
Senior iOS Developer Opportunity
2 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil beBeeiOSDeveloper Tempo inteiro R$60.000 - R$90.000Senior iOS Developer OpportunityThis senior level software development role offers a chance to collaborate with top brands and technologies, creating innovative digital products that impact millions worldwide.We are seeking an experienced iOS engineer with 3+ years of expertise in developing high-quality software solutions. The ideal candidate will have a...
-
AI Model Developer
2 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil beBeeArtificialIntelligence Tempo inteiro US$100.000 - US$120.000AI Engineer Senior PositionWe are seeking a skilled AI Engineer to join our team and contribute to the development of innovative solutions. As a senior member, you will be responsible for designing, implementing, and maintaining complex AI models, specifically LLMs, to extract key information from energy contracts and invoices.Develop and implement AI models...
-
Staff Software Engineer
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil DBServices Portugal Tempo inteiroStaff Software Engineer - iOS (Remote Brazil | temporary) Join to apply for the Staff Software Engineer - iOS (Remote Brazil | temporary) role at DBServices Portugal Staff Software Engineer - iOS (Remote Brazil | temporary) 4 days ago Be among the first 25 applicants Join to apply for the Staff Software Engineer - iOS (Remote Brazil | temporary) role at...
-
AI Engineer
2 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil beBeeArtificialintelligence Tempo inteiro R$120.000 - R$140.000Job OpportunityAI Engineer PositionWe are seeking a highly skilled AI engineer to contribute to the development of cutting-edge SAP AI solutions.Work on innovative projects that leverage machine learning and data science to drive business growth.Collaborate with cross-functional teams to design, develop, and deploy large-scale AI systems.Improve system...
-
Software Engineer
3 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Canonical Tempo inteiroSoftware Engineer - packaging - optimize Ubuntu Server Join or sign in to find your next job Join to apply for the Software Engineer - packaging - optimize Ubuntu Server role at Canonical Software Engineer - packaging - optimize Ubuntu Server 1 week ago Be among the first 25 applicants Join to apply for the Software Engineer - packaging - optimize Ubuntu...
-
Senior software engineer python
4 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Netvagas Tempo inteiroSenior software engineer python 4 days ago Be among the first 25 applicants About AzionWe are a global leader in the application and security industry. Our platform allows companies to operate with agility, reducing latency and increasing the reliability of their applications. We are focused on simplifying application building and looking for passionate and...
-
Software Engineer
1 semana atrás
Porto Alegre, Rio Grande do Sul, Brasil Agileengine Tempo inteiroOverviewJoin to apply for the Software Engineer (Senior) ID38789 role at AgileEngine.AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best...
-
Senior Software Engineer
2 semanas atrás
Porto Alegre, Rio Grande do Sul, Brasil Azion Tempo inteiroJoin to apply for the Senior Software Engineer (Go) role at Azion3 days ago Be among the first 25 applicantsJoin to apply for the Senior Software Engineer (Go) role at AzionAbout AzionWe are a global leader in the application and security industry. Our platform allows companies to operate with agility, reducing latency and increasing the reliability of their...
Senior Software Engineer Opportunity with Large Language Model Evaluation
3 semanas atrás
Software Engineering Opportunities with AI-Assisted Development
We are developing large language model evaluation and training datasets to enable LLMs to tackle realistic software engineering challenges. Our approach involves creating verifiable SWE tasks based on public repository histories in a synthetic manner, with human oversight, while expanding dataset coverage across different task types, programming languages, and difficulty levels.
Job Overview:
We seek experienced software engineers with expertise in high-quality public GitHub repositories to contribute to this project. You should have experience working with well-maintained, widely-used repos with 500+ stars. This role entails hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality.
Responsibilities:
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluate unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues challenging for LLMs.
- Opportunities to lead junior engineers on projects.
Requirements:
- Strong experience with at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
- Experience working with well-maintained, widely-used repositories with 500+ stars.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Achievements:
You will be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This opportunity allows you to combine practical software engineering with AI research.
