You can move your 401k to a different company or bank. However, you can only do it for certain reasons, like retirement or a new job, there are others too.
Only if you are moving into another 401k will you not be taxed/fined. You can not put into a bank, that's considered early withdrawal, subjecting it to penalization.