You're not being paranoid. A furnace that new shouldn't shake enough for the inspector to flag it, let alone enough for you to feel it from outside the unit. The only thing in there that really moves is the blower wheel, so if the whole cabinet is vibrating, that's almost always the culprit. It behaves exactly like an unbalanced tire on a car. Either something is stuck in the wheel, or the wheel itself is bad or deformed. A piece of debris, a loose chunk of insulation from an attic install like yours, even a paper document that got sucked in, any of that will throw the wheel off balance and shake the whole cabinet.
And that last one isn't as crazy as it sounds. I've heard of installation manuals and warranty paperwork ending up inside blower housings because someone set them on an open unit during the install. Looking at your photo, with the documents in that clear sleeve just sitting on top of the cabinet, it's easy to see how paper ends up where it shouldn't when the door comes off. Attics are dusty, sloppy job sites. As for the HVAC company finding nothing wrong, that bugs me too. It's the kind of thing you can miss if the furnace happens to run quiet while they're standing there, or if they just listened and didn't pull the blower to look at the wheel. Since you weren't there, you have no idea what they actually did. I'd call them back and ask specifically whether they inspected and cleaned the blower wheel, and I'd want to be present for it. You're still under warranty, so if the wheel itself is deformed, that's a warranty part, but somebody has to actually find it first. One other thought from your photo: with the unit mounted horizontally like that, any imbalance gets amplified because the cabinet has nothing damping it. So even a small bit of debris in the wheel can look like a lot of shaking. Trust your gut on this one.