There is a easy way. Setup a unsubscribe tag (inside the filters section in sendgrid.com). When you use this tag in email body basically its substituted with the raw unsubscribe link. Use this raw link with different unsubscribe text/color etc inside your html email.

I should have posted that I had already figured out a work around using the substitution. I had missed it when I was first scanning through the documentation.