Elements like these (PayPal buttons), should not be inserted as page content in the editor, but in your WordPress template files.
I assume you are developing your own WordPress theme! If not, you can modify an existing shipped WordPress theme such as the Twenty Eleven WordPress theme.
Depending on the placement of the button, you should do it in header.php, sidebar.php or footer.php, all, of your selected WordPress theme.