I tried to pay for purchases at a temporary store in the station with my card, but they told me that they take cash only.

In Japan, small stores, vending temporary store  in train stations, and stalls in the precincts of shrines and temples often only accept cash payment. Be sure to have some Japanese yen in cash when shopping. Most convenience stores and larger establishments accept credit cards and electronic money.