A company has fine-tuned a pre-existing model from Amazon Bedrock to enhance document summarization for an internal project. They now want to use the custom model through Amazon Bedrock for production purposes.
What should the company do to enable the use of the custom model?
4. Enable access to the custom model within Amazon Bedrock.
Enable access to the custom model within Amazon Bedrock is correct because once the model is fine-tuned, it must be made accessible within Amazon Bedrock to be used in production. Enabling access to the custom model ensures the company can use it for inference tasks like document summarization directly through Bedrock’s infrastructure.
Reference:
Amazon Bedrock
A company is building a generative AI application with Amazon Bedrock and wants to understand how much data it can include in a single prompt.
What factor should the company consider?
2. Context window size
The context window size defines how much input the model can process in a single prompt. It determines the maximum number of tokens (words or characters) that can be included in the input for the model to process.
Reference:
Amazon Bedrock
A media company is building a news summarization tool using Amazon Bedrock to generate concise summaries of trending news articles. The company wants to ensure that the generated content avoids misinformation and inappropriate topics.
Which AWS service or feature will help meet this requirement?
3. Guardrails for Amazon Bedrock
Guardrails can be used to ensure the generated content adheres to certain standards, such as avoiding misinformation, inappropriate topics, or harmful content. In this scenario, guardrails would help ensure that the news summaries are both accurate and appropriate for the audience.
Reference:
Amazon Bedrock Guardrails
Which feature of Amazon OpenSearch Service enables companies to create applications that use vector-based search functionality?
3. Advanced vector indexing and similarity search for high-dimensional data.
Amazon OpenSearch Service provides vector search capabilities, which are essential for building vector databases. These features allow companies to search for similar items based on vector representations, often used in applications like recommendation engines and AI-driven search.
Reference:
Amazon OpenSearch Service
A company needs to visualize the total sales of its best-performing products across different retail outlets over the last year. The company wants an automated solution to create these graphs based on its data.
Which AWS service should the company use?
1. Amazon QuickSight Q for automated insights
Amazon QuickSight Q is a natural language query tool that allows users to generate graphs and reports automatically by asking questions in plain language. It’s specifically designed to create visualizations like sales reports without manual effort.
Reference:
Amazon QuickSight
Which method is used to evaluate the accuracy of a foundation model (FM) applied to image classification tasks?
2. Measure the model’s accuracy using a benchmark dataset specifically designed for image classification.
Evaluating the accuracy of a foundation model involves comparing its predictions to known labels from a predefined dataset. Benchmark datasets are specifically curated for tasks like image classification to assess how well a model performs against a standardized set of images.
Reference:
Image Classification - MXNet
A company has customized a foundation model (FM) with Amazon Bedrock to handle customer support queries. The company now wants to test the model’s ability to respond accurately to new types of queries. They need to upload and store a new dataset that Amazon Bedrock can access for the validation process.
Which AWS service should they use for storing this dataset?
1. Amazon S3
Amazon S3 is a scalable, cost-effective object storage service that is widely used for storing large datasets. It is commonly integrated with machine learning services, including Amazon Bedrock, for tasks like training and validating models. S3 allows easy access to datasets needed for model validation.
Reference:
Amazon S3
A company is developing an application using Amazon Bedrock. With a limited budget, the company seeks a flexible pricing model that does not require long-term commitments.
Which Amazon Bedrock pricing model is most suitable for this requirement?
1. On-Demand
The On-Demand pricing model allows the company to pay only for the resources it uses, with no long-term commitments. This offers flexibility and is ideal for companies with a limited budget who want to avoid upfront costs.
Reference:
Amazon Bedrock Pricing
A media company is using a large language model (LLM) on Amazon Bedrock to summarize movie reviews. The company wants the model to generate concise summaries that capture the overall sentiment of the review.
Which prompt engineering strategy should the company use?
2. Include a few examples of movie reviews with their corresponding summaries before providing the new review to summarize.
Providing a few examples of reviews with their corresponding summaries helps guide the model by showing it how to perform the task. This is known as few-shot learning and helps the LLM generate more accurate summaries based on the patterns in the provided examples.
Reference:
What is Amazon Bedrock?
A research company implemented a chatbot by using a foundation model (FM) from Amazon Bedrock. The chatbot searches for answers to questions from a large database of research papers. After multiple prompt engineering attempts, the company notices that the FM is performing poorly because of the complex scientific terms in the research papers.
How can the company improve the performance of the chatbot?
2. Use domain adaptation fine-tuning to adapt the FM to complex scientific terms.
Lowering the temperature value makes the model’s output more deterministic and consistent. A lower temperature reduces randomness in the generated responses, ensuring the same input yields more similar outputs.
Reference:
Inference Request Parameters and Response Fields for Foundation Models
An education platform is developing a chatbot to help students with homework questions. The company has selected a foundation model (FM) but wants the chatbot’s responses to maintain an encouraging and educational tone.
What should the company do to achieve this?
2. Refine the prompt to ensure the FM produces responses in the desired tone.
Adjusting and refining the prompt can help guide the model to respond in a consistent, encouraging tone, which aligns with the company’s goals for the chatbot.
Reference:
Prompt Engineering Concepts
A fintech company is building a generative AI application using Amazon Bedrock. The company wants to assess the costs related to generating inferences with a large language model (LLM).
Which factor will influence the inference costs?
1. Number of tokens processed
Inference costs for large language models on Amazon Bedrock are driven by the number of tokens processed. Tokens represent pieces of the input or output text, and the more tokens involved in a single inference request, the higher the cost. Monitoring token usage helps control and manage costs effectively.
Reference:
Amazon Bedrock Pricing
A marketing agency needs to select a model from Amazon Bedrock that will be used internally to generate campaign slogans and advertisements. The agency must find a model that produces content in a tone and style that aligns with the agency’s creative standards.
What should the agency do to meet these requirements?
2. Evaluate the models by testing custom prompts and collecting feedback from the agency’s creative team.
The best way to find a model that fits the agency’s style and tone is to use custom prompts that reflect real-world use cases and collect feedback from employees who are familiar with the company’s preferences. This ensures that the chosen model aligns with internal creative standards.
Reference:
Prompt Engineering Concepts
A healthcare company is training a foundation model (FM) to analyze medical records. The company wants to improve the model’s accuracy until it reaches a specific threshold for acceptable performance.
Which solution will help the company achieve this?
2. Increase the epochs.
Increasing the epochs allows the model to continue learning by passing through the dataset multiple times, which can improve the model’s accuracy. The company can adjust the number of epochs to achieve the desired performance, ensuring the model trains until it meets the accuracy threshold.
Reference:
Hyperparameters for Optimizing the Learning Process of your Text Generation Models
A company wants to develop a chat interface using large language models (LLMs) with Amazon Bedrock to help users navigate the company’s product manuals, which are stored as PDF files. The company needs a cost-effective solution to provide relevant answers from the manuals.
Which solution meets these requirements most cost-effectively?
4. Upload PDF documents to an Amazon Bedrock knowledge base and use the knowledge base to provide context when users submit prompts.
Uploading PDF documents to an Amazon Bedrock knowledge base allows the company to store the manuals and provide relevant context dynamically based on user prompts. This solution is cost-effective because the model does not need to be fine-tuned or retrained, and it leverages an existing knowledge base to serve the necessary information without repeatedly submitting large amounts of data.
Reference:
Prompt Engineering Concepts
A healthcare company’s AI development team wants to quickly deploy and consume a foundation model (FM) within their VPC to process medical data securely.
Which AWS service or feature will help them achieve this?
3. Amazon SageMaker endpoints
Amazon SageMaker endpoints allow the team to securely deploy machine learning models, including foundation models, within their VPC. This ensures the data stays within the VPC while enabling real-time access to the deployed models for secure processing of medical data.
Reference:
Real-time Inference
A global transportation company receives thousands of requests daily from customers seeking updates on package deliveries. To manage the volume, the company wants to deploy Agents for Amazon Bedrock to streamline responses and automate workflows.
What are the key benefits of using Amazon Bedrock agents that could assist the transportation company?
2. Automation of routine inquiries and coordination of multi-step processes
Amazon Bedrock agents automate repetitive tasks like responding to common customer inquiries, such as package status, and orchestrate complex workflows, including escalating unresolved issues or initiating specific processes across different systems. This improves efficiency in handling large volumes of customer service requests.
Reference:
Amazon Bedrock Agents
A financial services company is using few-shot prompting on a base model hosted on Amazon Bedrock to generate daily reports. The model currently uses 10 examples in each prompt and performs well. However, the company wants to reduce monthly operational costs.
Which solution will meet these requirements?
2. Decrease the number of tokens in the prompt.
Decreasing the number of tokens in the prompt will directly reduce the amount of input the model processes during each invocation, leading to lower inference costs. Fewer tokens in each prompt mean the company can maintain performance while cutting costs.
Reference:
Design a Prompt
A museum is developing an AI-powered virtual tour guide to explain historical artifacts to visitors. The AI needs to adjust its language and tone depending on the visitor’s background, such as children, history enthusiasts, or academic researchers. The visitor’s background will be provided to the model when they ask questions.
Which solution meets these requirements with the least implementation effort?
2. Include a description of the visitor’s background in the prompt to instruct the model on how to adjust its response.
Including a description of the visitor’s background in the prompt is the most efficient solution, requiring minimal implementation effort. By simply adjusting the prompt, the model can tailor its responses to match the visitor’s background, whether it’s a child or a researcher, without the need for additional training or complex workflows.
Reference:
Prompt Engineering Concepts
An ecommerce company wants to develop a solution that analyzes customer reviews of products to determine customer sentiments based on the text.
Which AWS services meet these requirements?
(Select TWO.)
2. Amazon Comprehend
5. Amazon Bedrock
Amazon Comprehend is a natural language processing (NLP) service that can analyze customer reviews to detect sentiment, including positive, negative, neutral, or mixed. It’s ideal for automatically analyzing written text to determine customer opinions.
Amazon Bedrock offers foundation models for various AI tasks, including text analysis and sentiment detection. It provides pre-trained models that can be fine-tuned for tasks like sentiment analysis based on customer reviews.
References:
Which metric measures the runtime efficiency of operating AI models?
3. Average response time
Average response time measures how quickly an AI model provides predictions or outputs in real-time, making it an important metric for assessing runtime efficiency.
A company is building a large language model (LLM) chatbot to help answer customer questions more efficiently. The company wants to reduce the number of actions that call center employees need to take to assist customers.
Which business objective should the company use to evaluate the effect of the LLM chatbot?
2. Average call duration
Average call duration measures how long call center employees spend on each customer interaction. If the LLM chatbot helps answer questions efficiently, the time employees spend on calls should decrease, making this the most relevant metric to track.
Reference:
Unleash AI to Transform Every Customer Interaction
A manufacturing company is building a solution to generate designs for protective eyewear. The company needs the solution to have high accuracy and minimize the risk of errors in the design annotations.
Which solution will meet these requirements?
2. Human-in-the-loop validation by using Amazon SageMaker Ground Truth Plus
Human-in-the-loop validation through Amazon SageMaker Ground Truth Plus allows human reviewers to validate and correct any annotations made by the model. This ensures high accuracy and minimizes errors in generating designs for protective eyewear.
Reference:
Amazon SageMaker Ground Truth
An AI engineer is developing a search tool that needs to process user queries containing both text and images.
Which type of foundation model (FM) should the engineer use to meet this requirement?
1. Multi-modal embedding model
A multi-modal embedding model can handle and create unified representations of both text and image data. This makes it ideal for search applications that need to process queries containing both formats and return relevant results.
Reference:
Cost-effective Document Classification Using the Amazon Titan Multimodal Embeddings Model