Data Services within the SAP BI staging process
job for the PoC in Data Services Designer
- Click on
Project menu and select New > Project.
- Let us call our
new project as PoC
- Create new job
by selecting New Batch Job from context menu(right click menu). Call it as
- Create a new
dataflow and name it as PoC_DataFlow1.
- Open the
PoC_File_Format to the workspace as a Source.
- Let us have
some validation done on the source data. Let us assume we want only those
records where country is ‘IN’ (India) or ‘US’.
- Drag the
Validation from the Transform tab of the Local Object Library on the Data
- Connect source
with the validation.
- Double click on
the Validation box
- You will see
Validation Transform Editor as shown below.
- Click on Country column in the Schema In section.
- Enable Validation
- Select ‘In’ radio button and enter validation criteria as ‘IN’,
- This indicates that records with country as either ‘IN’ or ‘US’
will pass the validation and rest would fail the validation. Passed and
failed records are stored separately.
- Drag the target
for failed records from any of the available datastores e.g. Database, Flat
Files, Excel Workbooks, BW Target, etc. In our case, I have created a target
datastore for Oracle XE schema on my local machine. So I have taken a
template table as a target for the failed records.
- Name it as
- Connect the
Validation box with target Invalid_Customer for failing records.
here to continue...