Perennial vegetable border plants add a structure or a frame around your landscape. They add interest in the form of colorful foliage or flowering splash.