So PayPal or your bank are third parties that you have to trust will act honourably.
You can still do that with cryptocurrency and use third parties or dapps with escrow style protection features but you can also do direct transfers, without any third party involvement and no protection, like giving cash to someone requires no third party approval and there are no protections.
It annoys the hell out of me too, especially in a quiet place like a library or park and some clown does the full AAH-CHOOO like a cartoon character.