Were border states part of the union?

Border States were Union States which had a lot of Confederate sympathizers. They never left the Union. In fact, this is how West Virginia separated from Virginia.