You should exit the dining room and return to the Cloister. Then you have to follow the official palace route to reach the Room of the Chamberlain. You cannot see it passing by and not entering in. The following rooms are King Charles's chambers (official nos. 120-122).
As seen on
National Park And Pena Palace: the romantic vision