If you want to remove an existing budget, click "Financials" and "Budget" in the left menu. Then click on the tab "Manage budget".
Click on the budget you want to remove, then click on the icon with the three dots (···) to the right of the "Download budget" button and select "Remove".