The ancient Subramanyar temple at Vallimalai is associated with colorful legends and it has been revered by the Tiruppukazh hymns of Arunagiri Nathar. Vallimalai is located near Vellore, 16 km north of the Shivastalam Tiruvallam, on the Chennai Bangalore highway.

Legend has it that this is the site at which Valli was born and married Murugan. A similar legend holds at the Velimalai temple near Kanyakumari. Valli is depicted in the form of a playful maiden here. The natural springs on the hill are said to be associated with Valli.

This rock cut  hill temple is built on top of a small hill accessed through a flight of 300 steps. Much of the temple is within a cave. The cave temple is in three levels successively increasing in elevation.There are also shrines to Vinayakar and Kasi Viswanathar here. The construction in this temple is attributed to the Pallava rulers and to the Madurai Nayak rulers.

The annual Brahmotsavam is celebrated in the month of Maasi. Padi Utsavam is celebrated on Tamil new years day in the month of April, and the asterism of Kartikai in the month of Aadi is also celebrated here.