Skip to Content

Orchestration with Grounding Capabilities in SAP AI Core

Beginner
45 min.
SAP AI Core, Beginner, Tutorial, Machine Learning, Artificial Intelligence
This tutorial provides a step-by-step guide to setting up document grounding, creating pipelines, and utilizing vector APIs for facility management. In our use case, we use facility management emails uploaded to Microsoft SharePoint as grounding documents. This enables precise retrieval of relevant information, supporting efficient query resolution and service request handling. Follow this guide to streamline facility-related insights and response processes.
You will learn
  • How to set up orchestration pipelines, enable document grounding, and perform vector retrieval using SAP AI Core’s grounding capabilities
I321506Smita NaikJuly 10, 2025
Created by
I321506
February 27, 2025
Contributors
I321506
TillK17
shibeshduw

Prerequisites

  1. BTP Account
    Set up your SAP Business Technology Platform (BTP) account.
    Create a BTP Account
  2. For SAP Developers or Employees
    Internal SAP stakeholders should refer to the following documentation: How to create BTP Account For Internal SAP Employee, SAP AI Core Internal Documentation
  3. For External Developers, Customers, or Partners
    Follow this tutorial to set up your environment and entitlements: External Developer Setup Tutorial, SAP AI Core External Documentation
  4. Create BTP Instance and Service Key for SAP AI Core
    Follow the steps to create an instance and generate a service key for SAP AI Core:
    Create Service Key and Instance
  5. AI Core Setup Guide
    Step-by-step guide to set up and get started with SAP AI Core:
    AI Core Setup Tutorial
  6. An Extended SAP AI Core service plan is required, as the Generative AI Hub is not available in the Free or Standard tiers. For more details, refer to
    SAP AI Core Service Plans
  7. Access to Microsoft SharePoint for grounding capabilities.
  • Step 1

    In this tutorial, we explore how to extend orchestration capabilities in SAP AI Core by incorporating grounding—the process of enriching GenAI outputs with enterprise-specific or domain-relevant context to ensure accurate and reliable responses.

    Grounding addresses key challenges such as hallucinations and lack of specificity by connecting the model to external knowledge sources during inference.

    In the Generative AI Hub orchestration workflow, templating and model configuration are mandatory. In this tutorial, we are focusing on the grounding module usage, but in our orchestration consumption request you will also find optional modules such as data masking and content filtering. In general this tutorial covers the usage of all orchestration modules.

    In this tutorial we are covering:

    • How to create the Data Injestion Pipeline(pipeline API and vectore API options). You can choose either of these options based on the requirements
    • How to use Amazon S3 or Microsoft SharePoint as document repository.
    • How to retrieve and verify the content dynamically from uploaded documents.
    • How to configure and use grounding in orchestration

    Use Case: In our scenario, we use facility management emails uploaded to Microsoft SharePoint and Amazon S3 as grounding documents. The orchestration pipeline retrieves relevant content from these documents and enables context-aware question answering using retrieval-augmented generation (RAG).

    For additional context, refer to:
    🔗 Grounding in SAP AI Core (Help Portal)

    By the end of this tutorial, you will:

    • Understand how to use grounding module in Orchestration and apply it to practical, enterprise-relevant use cases.
    • Learn how to use the solution using SAP AI Launchpad, Python SDK, Java, JavaScript, and API(Bruno Client).
  • Step 2
  • Step 3
  • Step 4
  • Step 5
  • Step 6
  • Step 7

    In the previous steps, we have completed the data preparation for grounding. Before initiating model inference or orchestration, ensure that there is an active orchestration deployment (**scenario ID: orchestration**). To verify the available orchestration deployments and their status, use the get_deployment API under the “Deployments” section in the Bruno collection. Additionally, update the orchestration_service_url in the environment.

    NOTE: If no deployments are found, please refer to this tutorial for guidance tutorial.

  • Step 8

    Adding Grounding significantly enhances the model’s ability to provide Accurate and Context-specific responses. Without Grounding, the model generates generic replies, while with grounding, it retrieves precise information from the uploaded document. Screenshots showcasing both responses are provided for comparison.

Back to Top
Back to top