You can organise your Budget Versions by Creating Groups for them in the Budget Manager Screen:
To Archive a Budget or Scenario Version navigate to
Budgets & Cashflow > Budget Tools > Budget (or Scenario) Manager
Toggle off the Version you wish to Archive (grey)
This retains all of the budget details, however it is no longer visible to choose in either the Budgets & Actuals or the Report Data Source settings
Additionally, you could create a Group for your Archived Budgets
Budget Manager > Create Group
Set the Group name to Archived Budgets
Position it as required, perhaps at the bottom of all of your Groups
Click ADD GROUP
Drag your old Budgets into the Archived Group using the up/down arrows to the left of the Budget name
As an Alternative, you can EXPORT the Budget Versions to Excel, retain them within your Organisation Filing System, and then Delete them from Calxa.