Is it easy to keep a Goat? I really want a goat, they are so cute!?

Do I need to have a fence/ house for it? I live on two acres. Does anyone know where I could procure a cashmere goat in the US?