topic RE: SQL query to fetch results for process logging extensively in Product Forum

SQL query to fetch results for process logging extensively

Saif — Sat, 04 Jun 2022 03:39:00 GMT

Can someone please help with a SQL query to check which process is logging excessively in database?

RE: SQL query to fetch results for process logging extensively

devneetmohanty07 — Sat, 04 Jun 2022 07:07:00 GMT

Hi Saiful Khan,

You can refer to the below query for your requirement:

SELECT A.processname,COUNT(A.logid) AS log_entries
FROM [Blue Prism].[dbo].[BPASessionLog_NonUnicode] A INNER JOIN [Blue Prism].[dbo].[BPAProcess] B 
ON A.processname = B.name
GROUP BY A.processname
ORDER BY COUNT(A.logid) DESC

This query will give you the count of the log entries available for each process in descending order

------------------------------
----------------------------------
Hope it helps you out and if my solution resolves your query, then please mark it as the 'Best Answer' so that the others members in the community having similar problem statement can track the answer easily in future

Regards,
Devneet Mohanty
Intelligent Process Automation Consultant | Sr. Consultant - Automation Developer,
WonderBotz India Pvt. Ltd.
Blue Prism Community MVP | Blue Prism 7x Certified Professional
Website: https://devneet.github.io/
Email: devneetmohanty07@gmail.com

----------------------------------
------------------------------

RE: SQL query to fetch results for process logging extensively

Saif — Sat, 04 Jun 2022 07:15:00 GMT

Hi Devneet,

Thanks for the query, is there way that we could fetch the size of the logs per process in gb/mb

Original Message:
Sent: 06-04-2022 08:06
From: Devneet Mohanty
Subject: SQL query to fetch results for process logging extensively

Hi ,

You can refer to the below query for your requirement:

SELECT A.processname,COUNT(A.logid) AS log_entriesFROM [Blue Prism].[dbo].[BPASessionLog_NonUnicode] A INNER JOIN [Blue Prism].[dbo].[BPAProcess] B ON A.processname = B.nameGROUP BY A.processnameORDER BY COUNT(A.logid) DESC

RE: SQL query to fetch results for process logging extensively

devneetmohanty07 — Sat, 04 Jun 2022 07:51:00 GMT

Hi Saif,

Please find the below updated query:

SELECT processname,
Sum(
IsNull(DataLength(sessionnumber), 1)
+ IsNull(DataLength(stageid), 1)
+ IsNull(DataLength(stagename), 1)
+ IsNull(DataLength(stagetype), 1)
+ IsNull(DataLength(processname), 1)
+ IsNull(DataLength(pagename), 1)
+ IsNull(DataLength(objectname), 1)
+ IsNull(DataLength(actionname), 1)
+ IsNull(DataLength(result), 1)
+ IsNull(DataLength(resulttype), 1)
+ IsNull(DataLength(startdatetime), 1)
+ IsNull(DataLength(enddatetime), 1)
+ IsNull(DataLength(attributexml), 1)
+ IsNull(DataLength(automateworkingset), 1)
+ IsNull(DataLength(targetappname), 1)
+ IsNull(DataLength(targetappworkingset), 1)
) session_log_size
From
BPASessionLog_NonUnicode
GROUP BY
processname
ORDER BY session_log_size DESC

Hope this helps you out.

------------------------------
----------------------------------
Hope it helps you out and if my solution resolves your query, then please mark it as the 'Best Answer' so that the others members in the community having similar problem statement can track the answer easily in future

Regards,
Devneet Mohanty
Intelligent Process Automation Consultant | Sr. Consultant - Automation Developer,
WonderBotz India Pvt. Ltd.
Blue Prism Community MVP | Blue Prism 7x Certified Professional
Website: https://devneet.github.io/
Email: devneetmohanty07@gmail.com

----------------------------------
------------------------------

RE: SQL query to fetch results for process logging extensively

Saif — Sat, 04 Jun 2022 08:05:00 GMT

Thanks alot Devneet

Original Message:
Sent: 06-04-2022 08:51
From: Devneet Mohanty
Subject: SQL query to fetch results for process logging extensively

Hi,

Please find the below updated query:

SELECT processname,Sum(IsNull(DataLength(sessionnumber), 1)+ IsNull(DataLength(stageid), 1)+ IsNull(DataLength(stagename), 1)+ IsNull(DataLength(stagetype), 1)+ IsNull(DataLength(processname), 1)+ IsNull(DataLength(pagename), 1)+ IsNull(DataLength(objectname), 1)+ IsNull(DataLength(actionname), 1)+ IsNull(DataLength(result), 1)+ IsNull(DataLength(resulttype), 1)+ IsNull(DataLength(startdatetime), 1)+ IsNull(DataLength(enddatetime), 1)+ IsNull(DataLength(attributexml), 1)+ IsNull(DataLength(automateworkingset), 1)+ IsNull(DataLength(targetappname), 1)+ IsNull(DataLength(targetappworkingset), 1)) session_log_sizeFromBPASessionLog_NonUnicodeGROUP BYprocessnameORDER BY session_log_size DESC

RE: SQL query to fetch results for process logging extensively

Saif — Mon, 06 Jun 2022 08:12:00 GMT

Hi,

Can you please enhance the query to be in gb

RE: SQL query to fetch results for process logging extensively

devneetmohanty07 — Mon, 06 Jun 2022 08:35:00 GMT

Hi Saif,

Please find the below query and also just to note you will get 0.00 values for logs having very less bytes in contrast to other higher values:

SELECT processname,CONVERT(DECIMAL(7,2),Sum(
IsNull(DataLength(sessionnumber), 1)
+ IsNull(DataLength(stageid), 1)
+ IsNull(DataLength(stagename), 1)
+ IsNull(DataLength(stagetype), 1)
+ IsNull(DataLength(processname), 1)
+ IsNull(DataLength(pagename), 1)
+ IsNull(DataLength(objectname), 1)
+ IsNull(DataLength(actionname), 1)
+ IsNull(DataLength(result), 1)
+ IsNull(DataLength(resulttype), 1)
+ IsNull(DataLength(startdatetime), 1)
+ IsNull(DataLength(enddatetime), 1)
+ IsNull(DataLength(attributexml), 1)
+ IsNull(DataLength(automateworkingset), 1)
+ IsNull(DataLength(targetappname), 1)
+ IsNull(DataLength(targetappworkingset), 1)
)/1073741824) AS session_log_size
From
BPASessionLog_NonUnicode
GROUP BY
processname
ORDER BY session_log_size DESC

Also if it resolves your query, then please mark it as the 'Best Answer' so that the others members in the community having similar problem statement can track the answer easily in future

------------------------------
----------------------------------

Regards,
Devneet Mohanty
Intelligent Process Automation Consultant | Sr. Consultant - Automation Developer,
WonderBotz India Pvt. Ltd.
Blue Prism Community MVP | Blue Prism 7x Certified Professional
Website: https://devneet.github.io/
Email: devneetmohanty07@gmail.com

----------------------------------
------------------------------

RE: SQL query to fetch results for process logging extensively

Saif — Mon, 06 Jun 2022 08:49:00 GMT

this gives 0.00 in the output for every column

RE: SQL query to fetch results for process logging extensively

devneetmohanty07 — Mon, 06 Jun 2022 09:04:00 GMT

Hi Saif,

Like I said depends on the precision on the values you have with you. If you increase the precision to 38 which is maximum for a decimal you will get the proper value but you need to do it for all the columns:

SELECT processname,CONVERT(DECIMAL(38,2),Sum(
CONVERT(DECIMAL(38,2), IsNull(DataLength(sessionnumber), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stageid), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stagename), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stagetype), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(processname), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(pagename), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(objectname), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(actionname), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(result), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(resulttype), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(startdatetime), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(enddatetime), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(attributexml), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(automateworkingset), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(targetappname), 1))
+ CONVERT(DECIMAL(38,2), IsNull(DataLength(targetappworkingset), 1))
)/1073741824) AS session_log_size
From
BPASessionLog_NonUnicode
GROUP BY
processname
ORDER BY session_log_size DESC

NOTE: If you have very small values even 2 decimal precision will show you 0.00 and won't suffice in that case try with some parameter like (38,12). You need to experiment here and see what fits your use case according to your data

SELECT processname,CONVERT(DECIMAL(38,12),Sum(
CONVERT(DECIMAL(38,12), IsNull(DataLength(sessionnumber), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stageid), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagename), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagetype), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(processname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(pagename), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(objectname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(actionname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(result), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(resulttype), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(startdatetime), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(enddatetime), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(attributexml), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(automateworkingset), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappworkingset), 1))
)/1073741824) AS session_log_size
From
BPASessionLog_NonUnicode
GROUP BY
processname
ORDER BY session_log_size DESC

------------------------------
----------------------------------
Hope it helps you out and if my solution resolves your query, then please mark it as the 'Best Answer' so that the others members in the community having similar problem statement can track the answer easily in future

Regards,
Devneet Mohanty
Intelligent Process Automation Consultant | Sr. Consultant - Automation Developer,
WonderBotz India Pvt. Ltd.
Blue Prism Community MVP | Blue Prism 7x Certified Professional
Website: https://devneet.github.io/
Email: devneetmohanty07@gmail.com

----------------------------------
------------------------------

RE: SQL query to fetch results for process logging extensively

Saif — Mon, 06 Jun 2022 18:29:00 GMT

Devneet,

Process name displaying as Null is occupying the highest space above 300 gb in prod, how to find that name

Original Message:
Sent: 06-06-2022 10:04
From: Devneet Mohanty
Subject: SQL query to fetch results for process logging extensively

Hi

Like I said depends on the precision on the values you have with you. If you increase the precision to 38 which is maximum for a decimal you will get the proper value but you need to do it for all the columns:

SELECT processname,CONVERT(DECIMAL(38,2),Sum(CONVERT(DECIMAL(38,2), IsNull(DataLength(sessionnumber), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stageid), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stagename), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(stagetype), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(processname), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(pagename), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(objectname), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(actionname), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(result), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(resulttype), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(startdatetime), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(enddatetime), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(attributexml), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(automateworkingset), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(targetappname), 1))+ CONVERT(DECIMAL(38,2), IsNull(DataLength(targetappworkingset), 1)))/1073741824) AS session_log_sizeFromBPASessionLog_NonUnicodeGROUP BYprocessnameORDER BY session_log_size DESC

SELECT processname,CONVERT(DECIMAL(38,12),Sum(CONVERT(DECIMAL(38,12), IsNull(DataLength(sessionnumber), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stageid), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagename), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagetype), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(processname), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(pagename), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(objectname), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(actionname), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(result), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(resulttype), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(startdatetime), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(enddatetime), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(attributexml), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(automateworkingset), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappname), 1))+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappworkingset), 1)))/1073741824) AS session_log_sizeFromBPASessionLog_NonUnicodeGROUP BYprocessnameORDER BY session_log_size DESC

RE: SQL query to fetch results for process logging extensively

devneetmohanty07 — Tue, 07 Jun 2022 03:07:00 GMT

Hi Saif,

This is rather strange to happen. But if it is happening you can refer to the master BPAProcess table that has the list of all the processes in your environment but you need to create a join from the current query till that table itself which can happen only via a secondary table called as BPASession table. The query is as follows:

SELECT BPAProcess.name,CONVERT(DECIMAL(38,12),Sum(
CONVERT(DECIMAL(38,12), IsNull(DataLength(BPASessionLog_NonUnicode.sessionnumber), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stageid), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagename), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(stagetype), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(processname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(pagename), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(objectname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(actionname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(result), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(resulttype), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(BPASessionLog_NonUnicode.startdatetime), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(BPASessionLog_NonUnicode.enddatetime), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(attributexml), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(automateworkingset), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappname), 1))
+ CONVERT(DECIMAL(38,12), IsNull(DataLength(targetappworkingset), 1))
)/1073741824) AS session_log_size
From
BPASessionLog_NonUnicode INNER JOIN BPASession 
ON BPASessionLog_NonUnicode.sessionnumber = BPASession.sessionnumber INNER JOIN BPAProcess 
ON BPASession.processid = BPAProcess.processid
GROUP BY
BPAProcess.name
ORDER BY session_log_size DESC