How do I remove the tracking code from links that aren't CTAs?

HubSpot attaches parameters to your links to track visitors traveling between one domain and another, turning off cross-domain link tracking will remove the tracking code

From your HubSpot Settings, under Account Setup, choose Tracking & Analytics, then Tracking Code, then choose the Advanced Tracking tab.

Below the list of Additional site domains, you'll see a setting called Automatic cross-domain linking.

If you want your analytics data to connect between multiple domains, you'll need to keep this setting enabled, but if you don't use multiple domains or subdomains turning this off will improve performance.