< Previous | Contents | Next >

Folder structures

Because of the way HCP stores objects, the folders you create and the way you store objects in them can have an impact on performance. Here are some guidelines for creating effective folder structures:

Plan the folder structure for a bucket before storing objects in the bucket. Make sure all users of the bucket are aware of these plans.

192 Chapter 7: Usage considerations

Concurrent writes of the same object

Avoid structures that result in a single folder getting a large amount of traffic in a short time. For example, if you ingest objects rapidly, use a structure that does not store objects by date and time.

If you do store objects by date and time, consider the number of objects ingested during a given period of time when planning the folder structure. For example, if you ingest several hundred objects per second, you might use a folder structure such as year/month/day/hour/minute/second. If you ingest only a few folders per second, a less fine-grained structure would be better.

Follow these guidelines on the size of the folder structure:

Try to balance the width and depth of the folder structure.

Do not create folder structures that are more than 20 levels deep.

Instead, create flatter folder structures.

Avoid placing a large number of objects (greater than 100,000) in a single folder. Instead, create multiple folders and evenly distribute the objects among them.