Preference tuning
Teaching a model judgment/taste by training on "this response is better than that one." (M12)
Teaching a model judgment/taste by training on "this response is better than that one." (M12)
Teaching a model judgment/taste by training on "this response is better than that one." (M12)
Teaching a model judgment/taste by training on "this response is better than that one." (M12)