Yes, it is a bit unnerving - at least your car is not grey or black, which tends to make it even less noticeable. (though with all the salt still on the roads, many cars are still ash-grey this time of year).

Multiply your experience by a factor of 4X and you'll know what it is like to ride a motorcycle in heavy traffic - hardly anyone sees you! I do agree that the big rig drivers NORMALLY are much more alert than most car/SUV drivers, but sometimes they've had too little sleep and not enough caffeine..