In this POC, we have tried to extract historical revalidation data from CSV and load it to MongoDB with some simple fields mapping and table joining.
Steps:
Download and install Pentaho Data Integration
Create a new transformation
...
10. Records would be loaded to the MongoDB
...
Joining Tables
The Revalidation table does not include the GMC number that we want. So we need to join it with the gmcdetails table with the tcsId
...
Steps:
Add one more data input for GmcDetails
Add “Merge join” for the two tables.
Add the key field for joining. We can choose “Inner”, “Left outer”, “Right outer”, or “Full outer” as join type
...
3. Connect it to the MongoDB output
4. Run it!
...
5. Records will be loaded to MongoDB of table joined with (revalidation.tisId = gmcDetails.id).
...