In order to prevent any health problem, you will have to take proper care of the baby goat. Deworm it on a regular basis, trim its hooves, give it required vaccines when it is three weeks old. For vaccination, you can contact a vet who will guide you with the same. With a warm and damp cloth, clean its ears, legs, hooves, and face regularly.