The Civil Wars, the music duo comprised of Joy Williams and John Paul White, are officially breaking up.

The Civil Wars Breakup

Williams and White announced that The Civil Wars were splitting up for good in a press release on Tuesday, reported Billboard. Though the duo has been on hiatus since 2012, it had yet to be established that the two would not reunite on an album again in the future. As a note of gratitude to their fans, The Civil Wars recorded a cover of “You Are My Sunshine.”

Williams, the more media-friendly of the two, had revealed that she’s working on new music and plans to get back on tour in the future.

“I am saddened and disappointed by the ending of this duo, to say the very least. JP is a tremendous musician, and I will always be grateful for the music we were able to create together,” Williams said in the statement. “I sincerely hope that ‘You Are My Sunshine’ will be accepted as a token of my gratitude for every single person that has supported our duo throughout the years. I’m so thankful and my heart is full. Looking ahead, I’m excited to share the music that I am writing and recording in the midst of this difficult transition. I’ve loved being back in the studio, and have missed performing live. I look forward to seeing you soon."

White, whose future as a recording and touring artist is less certain, said, “I would like to express sincere thanks to all who were a part of the arc of The Civil Wars—from the beginning, to the end, and all points in between. My deep appreciation goes out to all who supported, disseminated, and enjoyed the music. Whatever shape or form the next chapter takes, thanks for being a large part of this one.”

The Civil Wars' first full-length album Barton Hollow was released in 2011 and they followed it up with a self-titled album in 2013. At the 2012 Grammys, the duo won for Best Country Duo/Group Performance and Best Folk Group.