21-10-24 10:51 AM - edited 21-10-24 11:03 AM
Hi,
I have connected the Blue Prism database to Power BI to get an overview of all our bots. I just have to click on the “ Update ” button in Power BI. The data is automatically transferred from the database. I have noticed that uploading the data to Power BI takes more time when the internet speed is low. At the same time, the resource connection in the Blue Prism tool gets lost until the data is updated. My question is: Is the data transfer in Power BI from the Blue Prism database secure? And is there any chance of losing data in the database? Note that the resource goes back to the idle/logged off state from the “Resource connection lost” state once the data update is complete.
Thanks in advance.
Regards,
Ekram
Answered! Go to Answer.
21-10-24 02:05 PM - edited 21-10-24 02:15 PM
Hi Ekram,
We generally do not recommend using a direct database connection for third-party reporting tools, as the Blue Prism database is utilized for operational purposes, is transactional in nature, and not designed for live/direct reporting by external tools.
Runtime Resources communicate to the database server via the BP Server with moderate to high volume. Notably, the transactional records are inserted into the database along with the updates being performed within the workflow table. Also, the logging information such as session logs, working queue logs, audit logs, schedule logs, and alerts are updated and stored frequently within the database.
Direct Database communication from an external application to the BPE Database will cause an additional burden over the operational performance in the database. This burden may lead to higher network latency between the Application Server and the database. Such network latency would impact the regular performance of the Runtime Resources and automations may be affected (as you describe).
We would recommend the following alternatives to a direct DB connection to a reporting tool:
- Utilize the in-built Data Gateways functionality to export reporting data to a separate system
- Utilize a tool that can be used to receive Session log data from Runtime Resources via an HTTP endpoint
- Create a reporting database/"mirror" environment which mimics your Production environment that can be used to retrieve reporting data
Edit: It looks like there's a few Power BI connectors available on the Digital Exchange that can make use of its available REST API endpoints. If you have a requirement to use Power BI, one of these may help with your stated purposes here:
https://digitalexchange.blueprism.com/dx/entry/3439/solution/power-bi-integration-2
https://digitalexchange.blueprism.com/dx/entry/3595/solution/power-bi-via-rpa-asset
https://digitalexchange.blueprism.com/dx/entry/3439/solution/microsoft-power-platform-connector-2
21-10-24 02:05 PM - edited 21-10-24 02:15 PM
Hi Ekram,
We generally do not recommend using a direct database connection for third-party reporting tools, as the Blue Prism database is utilized for operational purposes, is transactional in nature, and not designed for live/direct reporting by external tools.
Runtime Resources communicate to the database server via the BP Server with moderate to high volume. Notably, the transactional records are inserted into the database along with the updates being performed within the workflow table. Also, the logging information such as session logs, working queue logs, audit logs, schedule logs, and alerts are updated and stored frequently within the database.
Direct Database communication from an external application to the BPE Database will cause an additional burden over the operational performance in the database. This burden may lead to higher network latency between the Application Server and the database. Such network latency would impact the regular performance of the Runtime Resources and automations may be affected (as you describe).
We would recommend the following alternatives to a direct DB connection to a reporting tool:
- Utilize the in-built Data Gateways functionality to export reporting data to a separate system
- Utilize a tool that can be used to receive Session log data from Runtime Resources via an HTTP endpoint
- Create a reporting database/"mirror" environment which mimics your Production environment that can be used to retrieve reporting data
Edit: It looks like there's a few Power BI connectors available on the Digital Exchange that can make use of its available REST API endpoints. If you have a requirement to use Power BI, one of these may help with your stated purposes here:
https://digitalexchange.blueprism.com/dx/entry/3439/solution/power-bi-integration-2
https://digitalexchange.blueprism.com/dx/entry/3595/solution/power-bi-via-rpa-asset
https://digitalexchange.blueprism.com/dx/entry/3439/solution/microsoft-power-platform-connector-2
a month ago
Hi @steven.boggs ,
Thank you for your valuable information. I will look into your suggestion.
In the meantime, one of my colleagues has suggested creating a duplicate of the Blue Prism database. The duplicate database will be updated once a day. We can connect the duplicate database to Power BI. According to my understanding of the network latency and performance issue you informed about, I think it would not be very helpful to create a duplicate database.
Regards,
Ekram