Amazon SageMaker AI
Fully managed platform for building, training, and deploying your own ML models.
Verified against AWS documentation · 2026-08-26
Key facts
- 01Covers the whole ML lifecycle in one service: label, build in notebooks, train, tune, deploy, monitor
- 02You bring the data and the model — AWS brings managed compute. It is not a pre-trained API
- 03Four inference options: real-time (persistent endpoint), serverless (intermittent traffic), asynchronous (large payloads, scales to zero), batch transform (offline bulk)
- 04Limits: real-time 25 MB / 60s, serverless 4 MB / 60s, async 1 GB / 1 hour, batch transform runs GB-scale datasets for days
- 05Naming: the original service is now SageMaker AI. "Amazon SageMaker" now refers to the wider Unified Studio platform that wraps it
Exam triggers
Phrases and scenarios that point here.
- "Custom model", "train on our own data", "our own algorithm" → SageMaker, not Rekognition/Comprehend/Transcribe
- "No ML expertise", "business analyst", "no code" → Canvas; "automatically find the best model" → Autopilot
- Endpoint sits idle most of the day → Serverless Inference; large payload or minutes-long inference → Asynchronous Inference; no endpoint needed at all → Batch Transform
- "Reduce training cost" → Managed Spot Training (up to 90% off)
- "Accuracy degrades over time" → Model Monitor; "explain the prediction" or "detect bias" → Clarify
Not this service
- Off-the-shelf vision, speech, or text prediction → Rekognition, Transcribe, Comprehend
- Call a foundation model by API and pay per token → Bedrock
- Train and predict without leaving SQL → Redshift ML or Athena ML
Use cases
- 01Forecasting demand from five years of your own POS data, where no off-the-shelf model has ever seen your SKUs
- 02Hosting a fraud-scoring model behind a real-time endpoint that checkout calls inline on every transaction
- 03Async inference for a claims processor chewing through 200 MB scanned PDF bundles, scaling to zero overnight
- 04Batch transform to re-score the entire customer base for churn once a month — nothing left running between runs
- 05Managed Spot Training for overnight hyperparameter sweeps, where an interruption costs patience but not money
How it's charged
- 01No platform fee — you pay ML instance-hours per feature, billed per second; SageMaker Savings Plans discount that rate for a 1- or 3-year $/hour commitment
- 02Real-time endpoints bill every second they are InService, traffic or not — the single most common source of surprise SageMaker bills
- 03Training, processing, and batch transform jobs bill only for job duration; Managed Spot Training cuts that by up to 90% in exchange for interruptions
- 04Serverless and asynchronous inference scale to zero: serverless bills compute-time plus data processed, async bills nothing while its queue is empty
- 05Storage bills separately and quietly — notebook and Studio EBS volumes keep charging while the instance is stopped, plus S3 for datasets and model artifacts