LiveCode Forums.

hi Dick, just tried out the new code you made for me. Seems now much faster than the previous one, yet still couldn't bid bwmilby's code. Just took 1 sec more than his code ;) Well Done dear rkriesel and bwmilby , the effort you both given for me will never be forgotten http://icons.iconarchive.com/...

hi SparkOut,

will generate a new standalone with your idea for sure. thanks man

hi Richard,

yes I'm using the latest build of LC community version
also glad to know LC team is working to fix the 'Not Responding' thing while it goes through a large process !!

hi rkriesel, well, at the middle of processing, LC shown me (Not Responding) in the title bar. So I forcely closed LC thinking it crashed. But this time I didn't and let it remained still. And finally I got the output. I included millisec count to see how many secs the process takes and here's the r...

hi bwmilby, if you are talking about this: still no success, got my LC crashed while filtering

hi Dick, I didn't expect you would make another faster way out; so your reply given me a big surprise :D by the way, I've tried your function by this way: on mouseUp answer file "Select the File:" with type "Text File|txt" put url ("file:" & it) into Temp set the text of fld "f1" to singletonKeys(Te...

dear bwmilby, you dont know how much you helped me! my work with those text files been pending for many months since I started this thread. at last, you made it. I also give thanks and gratitude to those who helped in getting the proper script either by providing code or idea. You all are so nice gu...

Well, I don't think the lineoffset method is viable for the real file. I let it run for >10 min and it still didn't finish. The below code took between 18 and 23 sec for the actual data (first file - .7z) on mouseUp local tList, tKey, tLines, tCounts, tDupes, tStart set the itemDel to ":" put the m...

jacque wrote: ↑

Sun Jul 22, 2018 8:40 pm

Maybe you can post 50 lines or so here for testing. Plain text please.

I've uploaded the file in different host and in zip format. let me know if you have issue downloading the file:

The goal is to completely remove any key that is repeated (not just the duplicates). you caught me right :D Having real data makes a difference. The offset method is terribly slow (still working). The 2 array method took 18497ms. I'm not sure if you caught the 10000 loops and removed them (I did th...

The issue is needing to retain the entire original line and not just the key portion. I think I misunderstood the goal. I thought any duplicated first item should be entirely removed. If these are really email addresses then that's a bad assumption. I was thinking about the size of the source files...

This is a variation of Dick's method using only arrays. on trimList put fld 1 into tList set the itemDel to "@" repeat for each line l in tList add 1 to tNames[item 1 of l] end repeat repeat for each key k in tNames if tNames[k] > 1 then delete variable tNames[k] end if end repeat put keys(tNames) ...

I was thinking of using arrays too but alone it doesn't identify the duplicates string. So I'd combine the repeat loop and the array method. The loop identifies the repeated string and the array removes all instances. I'd have to check, but I think using an array will also solve the problem where n...

Okay... I didn't realize there would be more than one key duplicated. Here is revised code. You have to do 2 passes. The first looks for the duplicates, the second removes them. ########CODE to copy and paste with your mouse####### on mouseUp 20 local tList, tKey, tKeys, tDupes 20 set the itemDel t...

infinite thanks and gratitude to all who spent time and tried to provide a solution to my problem. Livecode has such a great support family who made my work with livecode proud so far. also making apologize for being so much delayed in providing my result. my sickness due to low blood pressure sent ...