In this passage, who is the one called the Master? To whom is he
speaking?

Answer:
Confucius is "The Master" & He is speaking to his students/followers.