Lady Antebellum performed at the CMT Video Music Awards.  They started out with their new smash hit Just A Kiss, but it turned into a hit from Prince!  Enjoy the video after the jump.