Skip to Content

Leveraging Prompt Registry for Seamless Orchestration

Beginner
45 min.
SAP AI Core, Beginner, Tutorial, Machine Learning, Artificial Intelligence
In this tutorial, we will explore the Prompt Registry feature within Generative AI Hub, focusing on how to efficiently manage and utilize prompt templates in orchestration. You will learn how to register, sync, and integrate prompt templates into the orchestration workflow, ensuring dynamic and structured interactions with AI models.
You will learn
  • How to register and sync a prompt template in Generative AI Hub.
  • How to consume the registered template within an orchestration workflow.
  • How to apply Grounding techniques, Data Masking, and Content Filtering to refine responses.
I321506Smita NaikOctober 17, 2025
Created by
rbrainey
April 18, 2025
Contributors
I321506
rbrainey

Prerequisites

  1. BTP Account
    Set up your SAP Business Technology Platform (BTP) account.
    Create a BTP Account
  2. For SAP Developers or Employees
    Internal SAP stakeholders should refer to the following documentation: How to create BTP Account For Internal SAP Employee, SAP AI Core Internal Documentation
  3. For External Developers, Customers, or Partners
    Follow this tutorial to set up your environment and entitlements: External Developer Setup Tutorial, SAP AI Core External Documentation
  4. Create BTP Instance and Service Key for SAP AI Core
    Follow the steps to create an instance and generate a service key for SAP AI Core:
    Create Service Key and Instance
  5. AI Core Setup Guide
    Step-by-step guide to set up and get started with SAP AI Core:
    AI Core Setup Tutorial
  6. An Extended SAP AI Core service plan is required, as the Generative AI Hub is not available in the Free or Standard tiers. For more details, refer to
    SAP AI Core Service Plans
  7. Orchestration Deployment:
    Refer to the tutorial the basic consumption of GenAI models using orchestration and ensure at least one orchestration deployment is ready to be consumed during this process.
  8. Basic Knowledge:
    Familiarity with the orchestration workflow is recommended
  • Step 1

    In this tutorial, we explore the Prompt Registry feature within the Generative AI Hub, focusing on how to efficiently manage and utilize prompt templates in orchestration pipelines.

    Prompt templates allow for dynamic and structured interactions with AI models. This tutorial will guide you through the end-to-end process of integrating these templates into your orchestration workflows.
    A Prompt Registry is a centralized system for storing, managing, and versioning prompt templates used in AI-driven applications. It allows developers and teams to reuse, modify, and track changes in prompts efficiently. This is particularly useful in large-scale AI projects where prompts need to be standardized, refined, and deployed across different models or scenarios.

    Why Use a Prompt Registry?

    • Consistency – Ensures uniform prompts across different use cases.

    • Version Control – Tracks prompt iterations and allows rollback if needed.

    • Collaboration – Enables teams to work on prompt engineering collaboratively.

    • Automation – Integrates prompts seamlessly into AI workflows and CI/CD pipelines.

    There are two key approaches to managing prompts in a Prompt Registry:

    1. Imperative API (Direct API Control for Dynamic Prompt Management): The Imperative API allows you to create, update, and manage prompt templates dynamically via API calls. This approach is best suited for interactive design-time use cases, where you need to iteratively refine prompts and track their versions. Each change is explicitly made via CRUD operations, and you can manage versions manually.
    2. Declarative API (Git-based Sync for Automated Prompt Management): The Declarative API, on the other hand, integrates with SAP AI Core applications and is ideal for CI/CD pipelines. Instead of managing templates through direct API interactions, you define them as YAML files in a Git repository. The system automatically syncs these templates, ensuring that updates are seamlessly reflected in the prompt registry without manual intervention.

    You will learn:

    • Declarative approach to creating a prompt template.
    • How to register and sync a prompt template in Generative AI Hub.
    • How to consume the registered prompt within an orchestration workflow.
    • How to apply Grounding, Data Masking, and Content Filtering to improve the quality, safety, and relevance of AI-generated responses.

    For more information on prompt registry, refer to the official documentation:
    Prompt Registry in SAP Generative AI Hub – Help Portal

  • Step 2
  • Step 3
  • Step 4
  • Step 5
Back to Top
Back to top