Build AI Model infused Power Apps for users
Use Case:
AI models for text classification, extraction, sentiment analysis, OCR and others
Business Value:
Utilize Microsoft AI Hub pre-built models to generate outputs that the business needs with accuracy, suggestions, and enhancement.
Solution Stack:
Microsoft Power Platform | AI Hub |AI Models |Power Automate | ChatGPT
Ref: https://www.youtube.com/watch?v=hwOdYCh0Sok
Above video has the demonstration of the use cases using pre-built Azure AI model within Power Apps.
This blog is to provide necessary steps to build the app using the AI models.
Login to https://make.powerapps.com/
Click AI Hub → AI Models
Make sure you in in USA environment depending upon the feature availability in your region. Typically, USA and USA Preview regions has the latest preview features available to use. If you do not see all the latest models, its either the license isn’t premium or you are in downstream environments.
Utilize the AI Models from the page:
Data extraction:
Have sample files about 10-50 and tag the necessary fields to capture. This could be sales order, invoice or procurement order or package list.
Once the files are trained, go to canvas apps and insert this model against the data source where the files are stored.
Make sure you choose use in an app option as above
We got to select the premium model for invoice processing:
Sample Invoice File:
- Once the file is uploaded into the power apps. AI Model kicks in and analyzes the key information. In this case Invoice Total, ID and Date.
- Thes are automatically rendered using AI model which is pre trained
- Saves time and reduces error for business users while dealing with invoices and other data extraction related activity.
- You can further extend the use case to use Power Automate Flow for workflow, approvals and auto email generation.
This is only a sample app with one AI Model. There are about 15 prebuilt AI model and one can custom develop these Azure AI Models and use it to meet your business needs.
In the below demo, I’ve used other key models as reference.
Ref: https://www.youtube.com/watch?v=hwOdYCh0Sok
Another example: Extract receipt details automatically
We will use the below 7/11 bill as sample:
You can either capture the necessary fields for billing purpose or use the text extractor / OCR model to get output of all the data from the file – pdf, jpeg, png and other supported docs.
Another sample for reference:
