Thank you for your prompt reply!
Changing the orderby string from ‘name’ to ‘natural’ did the trick, I am not sure what is wrong with using ‘name’ but problem is apparently solved.
below is the fixed shortcode
[tag_groups_alphabetical_index orderby=natural column_count=2 smallest=17 keep_together=0 ]