AWS Certified AI PractitionerFoundation ModelsMedium
An AI solutions architect is designing a system for a legal firm that needs to analyze complex legal documents, summarize cases, and answer specific questions based on the content. Due to strict data privacy regulations and the highly sensitive nature of the data, the firm cannot upload any documents to external cloud services. They require the foundation model to be run entirely within their secure on-premises infrastructure. Which deployment strategy is MOST appropriate for this scenario?
- AUsing a fully managed cloud-based foundation model service (e.g., Amazon Bedrock)
- BLeveraging a serverless function to call a remote foundation model API
- CDeploying an open-source foundation model on the firm's private data center infrastructure
- DFine-tuning a publicly available foundation model on a cloud GPU instance
Show answer & explanationAnswer & explanation
Correct answer: C. Deploying an open-source foundation model on the firm's private data center infrastructure
The core constraint is the inability to upload sensitive data to external cloud services and the requirement for on-premises operation. Deploying an open-source foundation model on the firm's private data center infrastructure directly addresses these needs by keeping all data and processing within their controlled environment.
Why the other options are wrong
- A. This option involves uploading data to a cloud service, which violates the data privacy requirement.
- B. Calling a remote API means data would be sent to an external service, violating the privacy constraint.
- D. Fine-tuning in the cloud still involves moving data to external infrastructure, which is not allowed.
On-Premises FM Deployment
Running a foundation model entirely within an organization's own data center or private infrastructure, typically for enhanced data control, security, and regulatory compliance.
- Data remains local
- High security and compliance
- Requires significant internal resources
Memory trick: On-Premises is like keeping your treasure locked in your own VAULT.