The arms square is a central part of the castle, and thus very easy to find as well. Leaving the castle keep, return the way you came, but this time going down. From there, go down a little bit more and you will find yourself in the middle of the arms square. It's a very wide space with a distinguished door shaped like a lock.