Bitcoin has a pair of public and private keys. Public key is the bitcoin address for receiving purposes.
On the other hand, private key is for withdrawing purposes. Therefore, the storing location of the private key where the bitcoin is stored. Typically private key is stored in the electronic wallets, and e-wallets are stored on desktops or online.