I made an appointment with a medical facility through a medical services broker, but their fee was unbelievably high.

There are brokers that mediate with Japanese medical facilities on behalf of foreigners residing outside of Japan. It seems that some charge a high brokerage fee. If you cannot understand why the fee is so high, ask for a specific breakdown and negotiate.