Assateague and Chincoteague Islands (bordering the Maryland and Virginia state lines, respectively) are famous for their wild horses and ponies. My wife and I visited last year and loved seeing them roaming around.
Wild Horses on the Beach – Assateague and Chincoteague