Yes, Bang Pa In is a summer palace for the Kingdom during the Ayutthaya period (14th to 18th century) and from King Rama III onwards. It also hold one of the sad love story there when one of the Consort was drowned.
My personal opinion? Can stay one night in Ayutthaya to take lighted up Wats...