Nah, 4gb is a cheapo desktop computer for general use these days (Chrome is using over 1gb for me right now with about 16 tabs). 8 is only $35 more, and ought to mean you use virtual memory not all all or only for favorable purposes (stuff that isn’t actually being used). 16 will keep a fairly intense user from ever using virtual memory.
Recently games have been constrained by the 512mb memory on the consoles… but that is now going up to around 6gb, So I think 8gb is going to be the standard for cross platform games very soon.
Oh, and there is actually a real downside to going up too far. To get quick suspend/resume space equal to ram must be reserved on the SSD. On a build where cost is a factor taking that big of a bite of SSD space can be troublesome.