Yes, if you are using a content store implementation / addon that supports S3, you can technically store every item in the contentstore directory in S3. Ideally, you would likely use a caching content store to avoid accessing S3 multiple times for a specific file (to reduce latency and cost for access), so the cached content items may still be stored in contentstore after all.
