In case you need to delete the reference number just delete it from the reference number field. Unfortunately you can not set it so the reference number would never be on the invoice. That means you have to delete it every time while creating an invoice. 

If you need a feature regarding the setting of a reference number, please let us know. We are constantly developing our service according to our customer wishes.