Wallet basically can be defined into two, hot and cold wallet which can further be broken down into numerous types, software, hardware, and paper.
They all have their perks and can be said to be safe in their own ways, each designed to meet different users taste and none inferior to the other.
Hardware wallet like the name says, they come in a hardware device that does not require internet connection at all times except when a transaction is needed to be achieved