Jesus and the disciples are leaving the temple heading for the Mt of Olives. As they reach the Mt of Olives the 4 Disciples are there with him.
Mark 13:3 And as he sat upon the mount of Olives over against the temple, Peter and James and John and Andrew asked him privately
The Holy Bible: King James Version. (2009). (Electronic Edition of the 1900 Authorized Version., Mk 13:2–3). Bellingham, WA: Logos Research Systems, Inc.