The short answer is, Yes, you have to set up a credit card account
for your firm/yourself in order to be able to submit eFilings.
There is not no provision in the eFiling system for payments to be
made by any other method than by credit card/debit card.
Your concern about the security of your credit card is understandable.
However, the eFileManager system utilizes the Chase Bank PaymenTech system that is built with the most advanced technology to protect your privacy.
Neither FileTime nor eFileManager save any credit card information.