Title: Improving Accuracy-Privacy Tradeoff via Model Reprogramming

Abstract: Model reprogramming is a new alternative to standard finetuning of large pretrained models, especially for resource-constrained settings induced by limited data, model choices, compute, and training constraints.  It has shown empirical success in many cross-domain transfer learning tasks and achieved state-of-the-art performance. In this talk, I will present an overview of the machinery of model reprogramming, followed by a deep dive into its benefits in differentially private finetuning. I will also provide a theoretical justification on model reprogramming and discuss future directions.


UBC Crest The official logo of the University of British Columbia. Urgent Message An exclamation mark in a speech bubble. Caret An arrowhead indicating direction. Arrow An arrow indicating direction. Arrow in Circle An arrow indicating direction. Arrow in Circle An arrow indicating direction. Chats Two speech clouds. Facebook The logo for the Facebook social media service. Information The letter 'i' in a circle. Instagram The logo for the Instagram social media service. External Link An arrow entering a square. Linkedin The logo for the LinkedIn social media service. Location Pin A map location pin. Mail An envelope. Menu Three horizontal lines indicating a menu. Minus A minus sign. Telephone An antique telephone. Plus A plus symbol indicating more or the ability to add. Search A magnifying glass. Twitter The logo for the Twitter social media service. Youtube The logo for the YouTube video sharing service.