Accounting Expert: AI Model Evaluation

About Huzzle Labs Huzzle Labs partners with frontier AI labs to evaluate and improve frontier models through deep human expertise. Contributors directly assess advanced AI systems in their specialist fields, receive competitive compensation, and help define the standards used to measure model performance. About the Role Huzzle Labs is seeking experienced accountants to write realistic accounting tasks that test how well frontier AI systems handle accounting work. You will create prompts that are difficult enough for a frontier model to fail, then write a scoring rubric for each task so reviewers can assess the output consistently. A rubric is a list of objective, checkable criteria that a reviewer marks pass or fail. Your judgement helps define the standards used to measure model performance. This is an expert judgement role focused on realistic task design, careful review of model output and precise, consistent documentation. Training is provided. Prior AI training or data-annotation experience is required. Responsibilities Write realistic accounting tasks: Create requests of the kind a client, controller or business owner would send, covering month-end close, bank and credit card reconciliations, AR/AP ageing, accruals and adjusting entries, sales tax, job costing and the clean-up of incomplete or inconsistent books. Build from real material: Review a deal room containing hundreds of files, select the relevant documents and use them to develop prompts and rubrics for tasks