I would assume that expansion of space would include that between atoms as well. So yes objects are expanding.

Expansion is small - only when you measure to huge distances does it make itself appearent.