To get rid of a burning bush plant, you have to remove the entire root ball, ensuring you don't leave any material behind.