Senior Manager of Meta Evaluation & Quality Assurance

SummaryApple Services Engineering (ASE) powers many AI and LLM features across App Store, Music, Video and more. As these systems increasingly rely on human-in-the-loop evaluation systems, the quality of our decisions is constrained by the quality of our evaluation systems. We believe that to build exceptional LLMs, you need exceptional mechanisms to validate the signals used to train and evaluate them.DescriptionAs...