Size of a file has little to do with the physical size of the document you scanned , it is in the details of what was scanned.
Copy either of the documents in greyscale then in color using all the same settings and you should see some more dramatic differences.
If you want to see a real change in a single scanned doc, when you enable color, also enable OCR on an all text doc.