

The band released the live album Ruin Jonny's Bar Mitzvah in 2004 on which they covered karaoke favorites, followed by Love Their Country in 2006 which focused on country and western songs. Blow in the Wind (2001) focused on pop hits of the 1960s, while Take a Break (2003) covered rhythm and blues songs. Have a Ball covered pop hits of the 1960s and 1970s and was followed by Are a Drag (1999), which covered Broadwayshow tunes. Their first album, Have a Ball, was released in 1997 and began a pattern of themed albums after particular musical genres. They came together to perform cover songs during off-time from their main acts and did not initially intend to release albums, instead releasing singles named after the artists they had covered and contributing songs to compilation albums. Me First and the Gimme Gimmes formed in 1995 in California from members of other notable rock bands: Spike Slawson (Swingin' Utters), Chris Shiflett (No Use for a Name, Foo Fighters), Fat Mike (NOFX), and Joey Cape and Dave Raun (Lagwagon).
