Rebecca Ferguson refused to work with co-star