Just to chime in from an Orthodox POV... even though the priest and Bishop roll has a leadership roll within the church they are considered servants and slaves to the parishioners. The handing over the keys to Peter was metaphorical in the fact that the master handed the keys to his household to his head slave when he was away.
In the Orthodox Church the parishioners decide if a Priest is worthy to be ordained. They declare "Axios, Axios, Axios" or "worthy", "worthy", "worthy". The vestments that they wear are to be a sign of submission.
The Priests, Bishops, and Deacons are nothing more than custodians of the Church.