Indie pop twins Tegan and Sarah took to the stage on the Late Show with Stephen Colbert this weekend for a performance of “I’ll Be Back Someday” off of their recently released record, Hey, I’m Just Like You.

The pair performed the pop-driven tune in front of retro neon lights as they sang lines from the track, which they wrote in high school. Their performance revolved around gritty guitar riffs and a driven drum beat as Tegan and Sara took turns singing lines like, “I like to read to you at night/ Like to read till you feel better/ Now’s the time for us to begin.”

Watch Tegan and Sara perform “I’ll Be Back Someday” below.