Minibuses or shared Jeeps leave the transport terminal of Neiva. The trip lasts 1 hour and costs 5,000 COP. There's no point to stay in Villavieja though. Just stay in the minibus until it takes you right into the desert. It should be able to drop you off directly at a hostel.
The collectivos from Neiva to Villavieja charge 6,000 COP per person and 15,000 if they bring you directly to the desert (more for a single person, less for a group). A single traveler might just get off at Villavieja and find a mototaxi (motorbike) to the desert for 10,000 COP or less.
Getting around the city should not be a problem as it's small enough to be covered on foot. The tricky part is getting around the desert as there is no public transportation and it can get expensive. You can either :
Everyone seems to offer morning or evening tours of the desert for 40,000 pesos per person. It is a bit overpriced for what you get. You can do it by yourself. It is safe.
Villavieja is a nice colombian town and really authentic. The Hospedaje Villa Rocio is a great deal. You get a super clean and huge room for up to 3-4 people. From 30 to 50.000 COL depent if you like van or aircon. Coffee included, a fridge and 24 h electricity! Your choice. Walk into the dessert around 1 h to 1,5 h.
In the Desert
There's absolutely no point to stay in Villavieja. There are a number of options in the desert that are well priced (for example 15,000 COP per person for a room, or 10,000 COP for a hammock - July 2015). Mid week there's no need to book. Accommodation is basic and electricity is only available during the evening, however it is beautiful in the desert and the temperature is in fact quite pleasant. Just make sure your camera and phone are charged before you come. Expect to pay COP 5,000 for breakfast of COP 10,000 for lunch or dinner.
Hostal Noches del Saturno seems to be popular but the staff is not friendly and the food is not good. Dona Lilia (the closest to the observatory) has the best food and is a good place to stay. There are more accommodation options. All of them are basic with solar light to charge phones. Expect to pay 10,000 COP for a hammock (5,000 if you bring your own hammock or tent) and more for a cabana. (Dec 2015)