Marathi - AI Product Evaluator

Productive Playhouse is building a talent pool of Marathi speakers to test and evaluate AI chatbots and language models. Evaluators will interact with models, assess their capabilities, safety, and helpfulness, and submit findings to inform model development and optimization. Responsibilities Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and promptsVoice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverableSubmitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies Qualifications Native or expert-level fluency in Marathi, as spoken in IndiaStrong English reading, writing, and communication skills18 years of age or olderHands-on experience using AI models or large language modelsComfortable with both written and voice-based conversation — and good at asking sharp fo