You got me with "if you use REM for padding, everything gets bigger and page looks zoomed in". I guess it makes sense that if user can use zoom in function, then using browser font size should do something else