How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Please post your suggestions here
eMzw7gJ2NjEdmoNkiR9B
Posts: 82
Joined: 20 Nov 2016, 04:34

How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by eMzw7gJ2NjEdmoNkiR9B » 22 Nov 2020, 23:12

The Subject is the URL for the daily spreadsheet of stations in RadioSure. It is a zip file that once uncompressed turns into an RDS file that you can manually put into the appropriate RadioSure directory to update its station database. (By the way, that link to download the spreadsheet works even when the normally RadioSure web pages are off line - so bookmark it! )

OR, you can open it with a spreadsheet like Microsoft Excel. I launch Excel, find my uncompressed RDS file and then open the file. I take all the defaults and it opens like a normal spreadsheet or workbook. Then I study it for errors.

LOOK FOR DUPLICATES

If you wish to look for duplicates, sort the spreadsheet by the column you are interested in. Sort by Stream 1 is my recommendation. I normally add a few columns on the left for marking the results of various searches I do so that I have a list in one column.

Once you do a do a sort on the column you are interested (easy to do by just clicking on the column heading), it is also easy for find duplicates. For this example, say you have inserted new blank columns A, and B. That would make the Source 1 column the letter "H" column. Then in cell A2, paste this formula:

=IF((OR(H2=H1, H2=H3)), "Dupe", "OK")

That will show in A2 whether the source in H2 matches either the source directly above it, or below it by making it as a Dupe if it is a duplicate, and marking it as OK if it is not a duplicate.

The copy the formula from A2 to the rest of the A column and all the entries in RadioSure will be marked as either OK or Dupe. Then add a column filter (under the DATA, FILTER menu, submenu item on recent version of Excel) and show only the Dupes.

It's not absolutely perfect; some sources will be "almost" the same and not show up as dupes when they really are dupes (for example https and http not showing up as dupes) or some sources, showing up ending with a "/" and others ending with a "/;" It's not perfect, but any day you do this, you will have more than enough stations on the list for cleaning up as best you can.

Thanks for all your help!

User avatar
Fonzy
Posts: 558
Joined: 21 Oct 2013, 22:43
Location: Belgium

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by Fonzy » 22 Nov 2020, 23:37

in your efforts, do not forget that the database is basically without headers as record 1, while the rsd file used by the radio does count the first record as being labels, so the first record of the rsd file is lost as station.
So take good care , that duplicate has to stay, and cannot be changed in anyway, since each , even minor change in the first record , immediately change its ID, and place the changed record to the end of the physical pile in the database
For that reason, not any comment or warning can be placed in the first physical record, and no record can be created in the database with a predefined ID... else a record containing labels could be created, but that is not possible. Until some (non existent ? ) person at the RadioSure board changes the radioplayer, so it knows the first line are not labels, we have to deal with this weirdness.

Abut that link: is very handy, and I use it to auto-update totally my own version (in MS access) of stations, and export even a list for inLightRadio also in its".ird" format with the websites. Only a pitty the websites are not sent in the radiosure- rsd file, so I must keep track of them manually. As long as the stations-title does not change, that goes also automatic

eMzw7gJ2NjEdmoNkiR9B
Posts: 82
Joined: 20 Nov 2016, 04:34

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by eMzw7gJ2NjEdmoNkiR9B » 23 Nov 2020, 08:41

Hi Fonzy, Does Jeramy offer an extract nightly as RS does? I am a registered PRO user there since 2013 but he terminated my access with a new release and has not restored it. I am shocked that his operation still exists!

User avatar
Fonzy
Posts: 558
Joined: 21 Oct 2013, 22:43
Location: Belgium

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by Fonzy » 23 Nov 2020, 12:44

No, Jeramy stopped his project totally, and existing licenses only work on my old XP machine. A fresh ,unused license cannot be validated anymore, and new licenses cannot be bought. But the radioplayer still works fine, although lack the m3u8 decoding
The extract for inlight radio had the website, and the ID of the database, so users could directly switch to the internet database from within the working player on their computers , to the right station for correcting or changing the data, although the changes also took effect on the global database after an approver validated or rejected the change ( I was mod / approver on his site)

eMzw7gJ2NjEdmoNkiR9B
Posts: 82
Joined: 20 Nov 2016, 04:34

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by eMzw7gJ2NjEdmoNkiR9B » 30 Nov 2020, 19:08

A few web pages as a front end to your Access database would be a great way for volunteers to maintain your database if RadioSure ever goes off line.

Reciva.com had been a good site, but is going off line permanently after January 2021.

https://radios.reciva.com/index

koroedd
Posts: 2
Joined: 23 Apr 2021, 12:21

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by koroedd » 23 Apr 2021, 12:46

Hi there! I want to add about of searching of duplicates in database. Additional continue for Fonzy. After creating spreadsheet of database, need to delete column "B" (description),
Image 5.jpg
Image 5.jpg (384.98 KiB) Viewed 2696 times
then copy all text from spreadsheet to new text file. Then open this text file in Notepad++ (or Akelpad) and make some searching filters (Ctrl+F looking and fixing "Http:// - > http://" "http;// - > http://" "http// - > http://" and other errors
Image 13.jpg
Image 13.jpg (462.41 KiB) Viewed 2696 times
, update: already fixed). After fixing errors, tap ctrl+H and replace "http://" to "\r\nhttp://" (for urls with new lines)
Image 12.jpg
Image 12.jpg (413.51 KiB) Viewed 2696 times
also "https://" to "\r\nhttps://" "rtsp://" to "\r\nrtsp://" "mms://" to "\r\nmms://". Then save changes in this text file. Go to browser and open https://www.madeintext.com/remove-duplicate-lines/ or https://wtools.io/remove-dublicate-lines to inspect your created text files for duplicate lines. And you'll see dupes (with number of lines) in text file, and searching became easier.
Last edited by koroedd on 12 Aug 2021, 11:40, edited 3 times in total.

eMzw7gJ2NjEdmoNkiR9B
Posts: 82
Joined: 20 Nov 2016, 04:34

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by eMzw7gJ2NjEdmoNkiR9B » 26 May 2021, 17:15

For years, I have been manually downloading the daily zip file manually so that I have the latest backup copy.

Recently, I found this free opensource program that I recommend:

https://www.freedownloadmanager.org/download.htm

You can easily schedule the daily download so that you no longer need to do it manually. Works on Windows, MacOx, Android and Linux. I've only tried Windows so far and it does work. No ads, no fees. Totally free.

User avatar
Lapsang
Posts: 120
Joined: 21 Sep 2014, 12:59
Location: South East of the Netherlands, in between Belgium and Germany

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by Lapsang » 26 May 2021, 17:34

Hello eMzw7gJ2NjEdmoNkiR9B,

Could you give some explanation about how to use the program?

eMzw7gJ2NjEdmoNkiR9B
Posts: 82
Joined: 20 Nov 2016, 04:34

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by eMzw7gJ2NjEdmoNkiR9B » 26 May 2021, 18:06

I just use the basics. Click on the "+" sign to add a download, add the URL of the source (http://www.radiosure.com/rsdbms/stations2.zip) and then specify the target download directory on my PC of network.

It lets you click to make it daily at any specified time you want. Windows will show you the file's date/time. If you don't delete the previous download, you will see a series of file with names such as stations2.zip, stations2(1).zip, stations2(2).zip, stations2(3).zip ... etc for subsequent days.

User avatar
Lapsang
Posts: 120
Joined: 21 Sep 2014, 12:59
Location: South East of the Netherlands, in between Belgium and Germany

Re: How to look for duplicates in Radio Sure (use http://www.radiosure.com/rsdbms/stations2.zip )

Post by Lapsang » 27 May 2021, 15:27

Hello eMzw7gJ2NjEdmoNkiR9B,

Today around 10:30 I installed the programme. I asked for a download of the Radio?Sure! file between 12:00 and 13:00.

And, yes: at 12:45 I found the file in the Downloads folder.

Question 1: Can you also let the file arrive in the RadioSure>Stations folder?

That is a hidden folder.

Question 2: In this hidden folder I now see the following files. (Please see picture):

Image

For 25 May there is a zipped folder, for 27 May (today) there is none.

How do I handle this? Delete everything from 25 May?

Then there is no longer a zipped folder.

I would like to note that I have no experience at all with manually downloading the database. I always just waited a week.

Post Reply