Scattered in the adjacent hills are scenic caves and caverns, such as Jade-Milk Cave, Purple Cloud Cave, Stone House Cave, Water Music Cave and Rosy Cloud Cave, most of which have many stone sculptures carved on their walls.