An AWS Glue Spark job writes engineered features to Amazon S3 for training. Each run writes millions of small objects under a single prefix with high write concurrency, and runs now fail with 503 Slow Down errors. The training jobs that read the output are also slow to list and open the files. Which actions should the ML engineer take? (Select TWO.)
Choose TWO.
S3 request-rate scaling: 503 Slow Down means too many requests per prefix; small files multiply requests.
Amazon S3 supports a high request rate per partitioned prefix (thousands of writes per second) and scales as you add prefixes. A job that sends millions of small PUTs into one prefix exceeds that rate and receives 503 Slow Down. Two complementary fixes: spread writes across more prefixes, and reduce the number of requests by writing fewer, larger files, which also helps training jobs that read the data. Transfer Acceleration and Versioning do not change request limits, and backoff retries only absorb throttling without fixing its cause or the small-file reads.
- Read the error: 503 Slow Down is S3 throttling request rate per prefix.
- Spread the requests across multiple prefixes.
- Cut the request count by writing larger files.
- Reject options that only retry, target network distance or keep the request count.
Exam tip: 503 Slow Down: spread across prefixes and write fewer, bigger files.
Collecting and Storing Data for ML and AI on AWS (MLA-C02) — the lesson that teaches this.