A cheap stereo from the 90s was like that. Switch built into the arm.
I prefer the Garrard turntable my grandfather built into a big wooden box with big amplifiers. Auto stop, cushioned lowering of the stylus etc. Very smooth everything, the turntable had a lot of inertia in it, must have been a big heavy flywheel underneath for smooth rotation.
Sounds like a good way to stop your neighbour listening to the radio.