You can include the variant URL in your product export using a Custom Field with a value like this:

https://{{ _shop_domain }}/products/{{ handle }}?variant={{ variants.id }}

On the "Templates" page, there's also a template called "All Products and Variants" which already includes separate columns for the product URL and variant URL. It can be customized further as needed.