--- parser: v2 auto_validation: true time: 15 tags: [tutorial>beginner, topic>machine-learning, topic>artificial-intelligence, topic>cloud, software-product>sap-business-technology-platform, software-product>sap-ai-services, software-product>data-attribute-recommendation, tutorial>free-tier] primary_tag: topic>machine-learning author_name: Juliana Morais author_profile: https://github.com/Juliana-Morais slug: cp-aibus-dar-swagger-soc-upload canonical_url: https://developers.sap.com/tutorials/cp-aibus-dar-swagger-soc-upload --- # Use a Sales Order Completion (SOC) Dataset Schema to Upload Training Data to Data Attribute Recommendation Upload a dataset to your Data Attribute Recommendation service instance to afterwards be able to train your machine learning model using the Sales Order Completion (SOC) business blueprint. ## You will learn - How to authorize your client to communicate with your Data Attribute Recommendation service instance - How to do upload data to your Data Attribute Recommendation service instance to train a machine learning model ## Intro To try out Data Attribute Recommendation, the first step is to upload data that will be used to train a machine learning model. For more information, see [Data Attribute Recommendation help portal documentation](https://help.sap.com/docs/Data_Attribute_Recommendation). For further definition of specific terms, see [Concepts](https://help.sap.com/docs/Data_Attribute_Recommendation/105bcfd88921418e8c29b24a7a402ec3/cff2de73bc9c4625b35eb036439ae70a.html). Business Use Case: Use the Sales Order Completion (SOC) business blueprint in the context of the sales order process to predict missing fields that are needed for completion. With a dedicated pre-processing, the business blueprint takes care of imbalanced datasets as well as model training split based on the sales order object. To better understand the Sales Order Completion (SOC) business blueprint from the Data Attribute Recommendation service, take a look at the blog post: ? --- ### Authorize Swagger UI You'll use Swagger UI, via any web browser, to call the Data Attribute Recommendation APIs. Swagger UI allows developers to effortlessly interact and try out every single operation an API exposes for easy consumption. For more information, see [Swagger UI](https://swagger.io/tools/swagger-ui/). In the service key you created for Data Attribute Recommendation in the previous tutorial: [Use Free Tier to Set Up Account for Data Attribute Recommendation and Get Service Key](cp-aibus-dar-booster-free-key) or [Use Trial to Set Up Account for Data Attribute Recommendation and Get Service Key](cp-aibus-dar-booster-key), you find a section called `swagger` (as highlighted in the image below) with three entries, called `dm` (data manager), `mm` (model manager) and `inference`. You'll use all three Swagger UIs throughout the tutorials. ![Service Key](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/service-key-details.png) For this tutorial, copy the URL of the Swagger UI for `dm` and open it in a browser tab. >After finishing this tutorial, keep the Swagger UI for `dm` open to perform the clean up tasks in [Use the Sales Order Completion (SOC) Business Blueprint to Predict Missing Sales Order Fields](cp-aibus-dar-swagger-soc-predict). 1. To be able to use the Swagger UI endpoints, you need to authorize yourself. In the top right corner, click **Authorize**. ![Authorize](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/swagger-authorize.png) 2. Get the `access_token` value created in the previous tutorial: [Get OAuth Access Token for Data Attribute Recommendation Using Any Web Browser](cp-aibus-dar-web-oauth-token), then add **Bearer** (with capitalized "B") in front of it, and enter in the **Value** field. ``` Bearer ``` 3. Click **Authorize** and then click **Close**. ![Authorize](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/swagger-token.png) ### Create dataset schema Now, you need to create a new dataset schema. A dataset schema describes the structure of datasets. Use the following dataset schema: ```JSON { "features":[ { "label":"SALESORDERTYPE", "type":"CATEGORY" }, { "label":"SALESORGANIZATION", "type":"CATEGORY" }, { "label":"DISTRIBUTIONCHANNEL", "type":"CATEGORY" }, { "label":"ORGANIZATIONDIVISION", "type":"CATEGORY" }, { "label":"MATERIAL", "type":"CATEGORY" } ], "labels":[ { "label":"SALESGROUP", "type":"CATEGORY" }, { "label":"SALESOFFICE", "type":"CATEGORY" } ], "businessBlueprintFields":[ { "label":"SALESDOCUMENT", "type":"CATEGORY" }, { "label":"SALESDOCUMENTITEM", "type":"CATEGORY" } ], "name":"soc-dataset-schema" } ``` For the Sales Order Completion (SOC) business blueprint, you need to add the `businessBlueprintFields`: `SALESDOCUMENT` and `SALESDOCUMENTITEM` to the dataset schema. Adding features and labels is optional. In the dataset schema we use for this tutorial, the features are the inputs for the machine learning model whereas the labels are the fields that will be predicted. Thus, this schema provides as input training fields such as `SALESORDERTYPE` and `SALESORGANIZATION`, and wants to predict `SALESGROUP` and `SALESOFFICE`. To create the dataset schema, proceed as follows: 1. In Swagger UI, expand the endpoint `POST /datasetSchemas` by clicking on it. Then click **Try it out**. ![Dataset Schema Endpoint](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-schema-endpoint.png) 2. Copy the above dataset schema into the text area. Then click **Execute** to create it. ![Dataset Schema Execute](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-schema-execute.png) 3. Further below, you find the response of the service. The response includes a representation of dataset schema that was just created. Additionally, the dataset schema received an `id`. Copy it locally as you'll need it in the next step. ![Dataset Schema Response](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-schema-response.png) You have successfully created a dataset schema. ### Create dataset Next, you need to create a dataset using the dataset schema that you have created. The dataset is a table that holds the data that you'll upload later. To create the dataset, proceed as follows: 1. Expand the endpoint `POST /datasets` by clicking on it. Then click **Try it out**. ![Dataset Endpoint](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-endpoint.png) 2. In the text area, replace the parameter `datasetSchemaId` with the `id` that you copied from the previous step and replace the parameter `name` with an appropriate name for you dataset, `soc_tutorial_dataset`, for example. Then click **Execute** to create the dataset. ![Dataset Execute](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-execute.png) 3. In the response of the service, you find the `id` of your dataset. Copy it locally as you'll need it in the next steps and also in the next tutorial: [Use the Sales Order Completion (SOC) Business Blueprint to Train a Machine Learning Model](cp-aibus-dar-swagger-soc-model). Additionally, you find the `status` of the dataset. The status is `NO_DATA` as no data file has been uploaded yet. ![Dataset Response](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-response.png) You have successfully created a dataset. ### Upload data The final step in this tutorial is to upload data to your dataset. In this tutorial, you'll use this [dataset](https://github.com/SAPDocuments/Tutorials/raw/master/tutorials/cp-aibus-dar-swagger-soc-upload/Dataset_SOC.csv). Right click on the link, then click ***Save link as*** to open the file dialog. In the dialog, replace the file ending `txt` with `csv` as indicated below. Then save the file. ![Save File Dialog](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/save-file-dialog.png) In Swagger UI, proceed as follows to upload to the data: 1. Expand the endpoint `POST /datasets/{id}/data` by clicking on it. Then click **Try it out**. ![Data Endpoint](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/data-endpoint.png) 2. Fill the parameter `id` with the `id` of your dataset that you previously copied. 3. Click **Choose File** below the parameter `Request body`. In the dialog that opens, select the SOC dataset that you just downloaded. Then click **Execute** to upload the data. ![Data Execute](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/data-execute.png) In the response, you'll see that the status of your dataset has changed to `VALIDATING`. The service is now validating the data that you have uploaded. ![Data Response](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/data-response.png) You have successfully uploaded data to your dataset. ### Check dataset status To check the validation status of your data, proceed as follows: 1. Expand the endpoint `GET /datasets/{id}` by clicking on it. Then click **Try it out**. ![Dataset Status Endpoint](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-status-endpoint.png) 2. Fill the parameter `id` with the `id` of your dataset. Click **Execute**. ![Dataset Status Execute](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-status-execute.png) 3. In the response of the service, you find the status of your dataset. If the status is still `VALIDATING`, check back in a few minutes. If the status is `SUCCEEDED`, your data is valid. In case the status is either `INVALID_DATA` or `VALIDATION_FAILED`, create a new dataset and upload the data once again. ![Dataset Status Response](https://raw.githubusercontent.com/sap-tutorials/Tutorials/master/tutorials/cp-aibus-dar-swagger-soc-upload/dataset-status-response.png) You have successfully created a dataset and uploaded data. You can now use the dataset to train a machine learning model.