Tradition holds this temple marks where Lord Brahma prayed on the Yamuna to remember the Vedas, and that Yudhishthir built it. Krishna and the Pandavas prayed here on their way to the Mahabharata war, and after victory Yudhishthir performed the Ashwamedha Yagya here and was named Chakravarti Raja.
The Yamuna once flowed where the Ring Road now runs behind the Red Fort; the two arch bridges on the road to ISBT once stood over its water. The Mughals demolished the temple, it was rebuilt elsewhere, and the British removed it again for a new railway line. After Independence a temple of the same name was built at Yamuna Bazar.

