Title: Specifying Machine Learning Components with Conformal Prediction

Abstract: We study the question of how to build reliable programs out of machine learning components, which are intrinsically error prone. In recent years, conformal prediction has emerged as a promising strategy for quantifying uncertainty of blackbox machine learning models in a way that provides probabilistic guarantees. We propose to use conformal prediction to construct specifications for machine learning components, and then use abstract interpretation to propagate this uncertainty compositionally through the rest of the program. We demonstrate the efficacy of our approach to write programs over images that come with probabilistic guarantees.


UBC Crest The official logo of the University of British Columbia. Urgent Message An exclamation mark in a speech bubble. Caret An arrowhead indicating direction. Arrow An arrow indicating direction. Arrow in Circle An arrow indicating direction. Arrow in Circle An arrow indicating direction. Chats Two speech clouds. Facebook The logo for the Facebook social media service. Information The letter 'i' in a circle. Instagram The logo for the Instagram social media service. External Link An arrow entering a square. Linkedin The logo for the LinkedIn social media service. Location Pin A map location pin. Mail An envelope. Menu Three horizontal lines indicating a menu. Minus A minus sign. Telephone An antique telephone. Plus A plus symbol indicating more or the ability to add. Search A magnifying glass. Twitter The logo for the Twitter social media service. Youtube The logo for the YouTube video sharing service.