As long as you use any cache plugins, the plugins will cache everything, including the currency cookies and the currency switch will show your chosen currency only after cache is deleted from plugin. 

Set exceptions to not cache these cookies in the cache plugin settings

my_custom_curr

my_custom_curr_pos

my_custom_curr_symbol