The Mino area is renowned for its ceramics.
You can take the Chuo line from Nagoya. Takes about 45 minutes.
Unfortunately Tajimi doesn't have a very good public transportation system. There are buses, but they can be inconvenient. The best way around this city is by car or taxi.
Oribe Street This is a very nice shopping area. You can buy many types of ceramics and other hand made items here.
Utsuwatei Open from 0800 until 1700 everyday. Is a great handicrafts shop located about a one or two minute walk from the Tajimi Souzoukan (Creative Center). This store has tons of ceramics for both decoration and daily use, such as utensils. You can also find a number of lacquer ware and apparel.