If you want to get back inside the village you were banished from, you must have all 3 characters. Then walk up to the man blocking the entrance, and rapidly push the SELECT button while holding ...