Prompt Engineering Data Scientist

Careers at Convai

We are excited that you are interested in exploring possible career options with Convai. If creating intelligent NPCs and their applications excite you, we want to talk to you.

About the Prompt Engineer & Evaluation Specialist Role

The Prompt Engineer and Evaluation Specialist will play a key role in crafting high-quality prompts to elicit specific responses from our NPCs and evaluating the efficacy of these prompts. You will be at the forefront of understanding user needs, optimizing system responses, and ensuring our technology exceeds expectations. At Convai, you will:

• Design, develop, and refine prompts to elicit desired outputs from AI models.
• Collaborate with product managers and other engineers to understand product goals and user needs.
• Conduct A/B testing on prompts to determine effectiveness & track prompt performance across different models.
• Write prompts for compelling characters and narratives, focusing on narrative design.
• Discover, test, and document prompts to design engaging character personalities, emotions, styles, and behaviors.
• Design and implement evaluation methodologies that can scale as the product grows.
• Work closely with data scientists to provide feedback on model outputs and suggest areas for improvement.
• Act as a bridge between our team’s technical and non-technical members, ensuring clear communication regarding prompt efficacy and system performance.
• Share insights and findings regularly with the team, promoting a culture of continuous improvement. We are looking for someone with:
• A Bachelor’s / Master’s degree / Ph.D. in Mathematics, Statistics, Computer Science, Computer Engineering, Quantitative/ Computational Social Science, or related field.
• 2+ years of professional experience in data science for AI/ML products.
• Proficiency in prompting architecture or evaluating LLM behavior or relevant transferable experience.
• Strong Python programming proficiency coupled with solid data structure and algorithm knowledge.
• High-level familiarity with the architecture and operation of large language models.
• Strong analytical and problem-solving skills & excellent written and verbal communication skills.
• Ability to thrive in a fast-paced startup environment. Benefits:
• Private Health Insurance
• Paid Time Off
• Training & Development
• Performance Bonus
• Competitive Salary & Equity

Bottom line: If you’re open to taking yourself to the next level and doing your best work that you’d be proud of, Convai would be an ideal place for you. #J-18808-Ljbffr