I made a big stink to them and UltimateBet has agreed to cover the charges from my bank as a one time courtesy with proof via bank statement.

Lesson learned: Deposit using eChecks from now on. (I just did this for the first time today at PokerStars and was surprised at how quick and easy it went through.)

And avoid UB like the plague.

I will be withdrawing my money from UB as soon as they reimburse me for the finance charges.