topic Re: Remove Duplicates in Product Forum

Remove Duplicates

FatimaAlcaraz — Fri, 21 Jan 2022 17:22:50 GMT

Good afternoon!
I am having problems to be able to eliminate duplicates in a range of data since the Remove duplicates action does not work for me, I do not know if it is only me that is not applying it in a good way or what would be my mistake. But I need to remove duplicates between this range. A1:F30.

Re: Remove Duplicates

vivek.kumar.goel — Fri, 21 Jan 2022 18:16:33 GMT

Hi Fatima, Can you please tell us what is the error that you are getting while using the "Remove Duplicates" action?
A screenshot of the input parameters for the action would help.

Re: Remove Duplicates

FatimaAlcaraz — Mon, 24 Jan 2022 12:33:11 GMT

Hello! That would be the way to implement it but I don't know what the error would be, if you could help me I would really appreciate it.

Re: Remove Duplicates

michaeloneil — Tue, 25 Jan 2022 15:21:59 GMT

Hi Fatima

I think this is likely because in the column number you have 5:10 and this can only be a number. This column is the column you want to filter on so in your case it can be e,f,g,h,i,j so 5,6,7,8,9 or 10 but not a combination like you would do with a column range. So if you wanted to removed duplicates and filter on column E then you inputs will be

Re: Remove Duplicates

FatimaAlcaraz — Tue, 25 Jan 2022 18:42:00 GMT

Thanks for the clarification, but in my case it doesn't work that way because if I do it that way it deletes all the data in the range I don't know why. Being that when doing it manually from excel, selecting the range and then going to the Data-Remove Duplicates tab; This throws me this message telling me the following and not deleting anything:

Re: Remove Duplicates

michaeloneil — Wed, 26 Jan 2022 12:12:26 GMT

Have you tried taking the worksheet as a collection in blueprism and then use Utility - Collection Manipulation Extended > Remove duplicates
This might work a little better for you and after which you can paste the data back to excel.

Re: Remove Duplicates

FatimaAlcaraz — Fri, 28 Jan 2022 11:22:40 GMT

Hello, I tried to implement what you recommend but I did not find such an action. And when searching I found a similar one but in the lower part, in the second parameter that it requests from the collection part, I do not understand how I should place it. Since I need to remove the duplicates that are within a range as I had already mentioned.

Re: Remove Duplicates

michaeloneil — Sat, 29 Jan 2022 13:36:10 GMT

Using the Collection action remove duplicates you will need to set the duplicate column name you want to search for the duplicates in, similar to excel. This should remove each row where a duplicate is found, if you need to do multiple columns then you can set a loop to go through each column you want to do. For example create a collection with the column names you want to remove duplicates from ColumnName1, ColumnName2, ColumnName3 etc, then use a loop to go through this collection and using the remove duplicates action you can set the column name using this collection. In Field the value would be [ColumnsCollection.Column]

Re: Remove Duplicates

FatimaAlcaraz — Mon, 31 Jan 2022 11:34:42 GMT

Thank you very much for your help, I will be applying what you explained to me.

Re: Remove Duplicates

FatimaAlcaraz — Fri, 04 Feb 2022 11:03:59 GMT

Hi, it won't let me post a new query that I don't know about because it no longer gives me the Add Post option.
That's why I'm going to explain it here; I need to get the values of a collection between semicolons ( ; ) Example: 000123;00234;77700;...

I tried to get the data with the Get collection as CSV action.

Re: Remove Duplicates

PvD_SE — Fri, 04 Feb 2022 12:05:31 GMT

Hi Fatima,

For new questions, please post a new thread.

I'll try and formulate an answer to your latter question, although the question is quite unclear.
The action you chose to get CSV data into a collection is the correct one. It either works or it does not. If it does not, usually all row data is collected in only one collection column. If this is the case, check the below:
Search windows for 'region' and select the 'region settings' and click on 'additional date, time, &regional settings', you get a new window. Now click 'change date, time, or number formats' and then 'additional settings', this will pop a window called 'customize format'. Check the value for 'List separator', this is likely either a , or a ; (comma or semicolon). Change to whatever it is that you have in you CSV and click 'Apply' and 'Ok'. Then try again.

Finally, in some cases, the comma or semicolon in your CSV might be of a different character set that windows is currently handling, in such cases, open the CSV with Notepad++ and search and replace the comma in the CSV for a proper comma, then try again.

...and yes, windows is a bit of a drag...

In future: Please explain what it is you want to know in a format similar to below:
- This is what I have
- This is what I do
- This is what I get
- This is what I want to have instead
- How do I do to get the result I want?

Regards,
Paul
Sweden