It turns out you can do a one-time payment using a debit or credit card through PayPal, without having an account on PayPal. But you can’t set up a subscription without having a PayPal account. I guess that’s good enough, for odd cases like mine.
Reply To: Paypal problem