AWS provides a way to switch accounts in the same browser using "Switch role": https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_switch-role-console.html
Once you switch to another role/account, it will stay on that browser's "history" - it uses cookies to store the list of roles you switched to.
If you want to update that list, currently the only way is to update the cookie.
NOTE: you'll need to URL-encode the updated value before updating it in the browser's cookie.
In chrome, similar for other browsers: