There is public bus from town for about Y10 RMB. In winter 2015 free of charge but few new offices near parking lot already built, maybe it's ticket office.
First temple is Utse temple, yellow 3-floor building in elevation 4322m next to parking lot. From here you can climb to more than 5000 meters visit dozens of meditating caves and small temples.
The most important place in this valley is the cave where Guru Rinpoche meditated in 8th century during his visit to Tibet. Get to this cave will take you at least 2 hours of normal walk, but remember the high altitude and get ready for hundreds of stairs!!! Tibetan pilgrims spend whole day in this mountains.
There is a narrow tunnel in the cave, Tibetan people believe, who can climb through the cave has no sin. From the mountain can see only in south direction, in summer will enjoy splendid view of Yarlung Tsampo and Samye town.
In the mountains is few small restaurants, but not so many, if you will climb to Guru Rinpoche's cave, bring enough water and small snack.
Cars of buses to Samye.