It's for your own protection to prevent some hacker impersonating you. There's no chance the hacker also has your phone.
If you want to leave your Paypal account open to anyone with your account name and password then I believe you can disable "second factor" authentication.
Some sites, such as Amazon, don't require you provide an extra code from your phone provided you're using the same PC you usually do.