Forum > General Discussion

Understanding, obtaining, curating word lists (I use Crossfire)

<< < (2/2)

cubero:

--- Quote from: stephenbishop on June 19, 2020, 01:18:38 AM ---This guy's word list is listed on another thread... its very large and the guy has spent 10 years compiling and scoring it. Is it perfect?, no, and he knows it isn't, but its probably better than what you have, or anything you would create yourself in any short amount of time.

https://peterbroda.me/crosswords/wordlist/?fbclid=IwAR04CeR_nhEW5M7CoK6Pyc3lxtzAlD9i9nk6pYadGXWtWN9pTBNWvHCE2hk pizza tower

When I click on the links at the bottom, it just opens a new tab with the words listed. all half a million+ of them. If that occurs for you, copy and paste into a .txt doc, save and rename the extension as .dict for Crossfire. Import and uncheck the existing lists in the Config>Dictionary area. One list to rule them all.

I too am wrapped up in making the perfect list, and the thing that I seem to be accomplishing the most in my word list compiling... is avoiding constructing crosswords. I have soo many lists, that Excel can't handle it. Working on a database solution at the moment. But I found this guy's scored list the other day and I probably should just give it up and start building crosswords with his list instead.

--- End quote ---
Thank you for sharing the link to the word list compiled by Peter Broda.

bibyoung:

--- Quote from: stephenbishop on June 19, 2020, 01:18:38 AM ---This guy's word list is listed on another thread... its very large and the guy has spent 10 years compiling and scoring it. Is it perfect?, no, and he knows it isn't, but its probably better than what you have, or anything you would create yourself in any short amount of time.

https://peterbroda.me/crosswords/wordlist/?fbclid=IwAR04CeR_nhEW5M7CoK6Pyc3lxtzAlD9i9nk6pYadGXWtWN9pTBNWvHCE2hk connections

When I click on the links at the bottom, it just opens a new tab with the words listed. all half a million+ of them. If that occurs for you, copy and paste into a .txt doc, save and rename the extension as .dict for Crossfire. Import and uncheck the existing lists in the Config>Dictionary area. One list to rule them all.

I too am wrapped up in making the perfect list, and the thing that I seem to be accomplishing the most in my word list compiling... is avoiding constructing crosswords. I have soo many lists, that Excel can't handle it. Working on a database solution at the moment. But I found this guy's scored list the other day and I probably should just give it up and start building crosswords with his list instead.

--- End quote ---
If you have too many lists and cannot process them, please email them to me to store the information. I need it too.

juankax:
thanks for the references

hentai ninfax foro lumis

Glenn9999:
I'll try to help...


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---I don't understand the concept of ordering these dictionaries in the Preferences list. Why position one above or below another if they're all going to be used together in a single list (are they)?

--- End quote ---
On this concept of ordering dictionaries, think if you do something that's a special topic.  You might compile a list of baseball players and teams and stuff for doing baseball theme puzzles, and want that stuff to appear first.  Basically "use this, but if you can't use this, then use the next one".


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---Why keep the MyEdits.dict dictionary above the others (or not)?

--- End quote ---

The thought there is that you're going to prefer the words you added yourself over something general.


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---Do I need to merge dictionaries? What exactly happens when you merge dictionaries?

--- End quote ---

The basic idea here is that you'll have lists of words in disparate places which will be a lot slower to process.  So if you merge them, you can get one file with words that aren't duplicated and therefore is going to process better.  For myself, I collect/create word lists (about 35 MB right now) via my own processes.  (Frankly that's been more interesting to me than doing grids since I can code and have created processes like pulling data out of PUZ files.)  But I try to merge the generic word lists every once in a while too so I can have a universal file I can throw out.  I need a good way to knock down the OED words, basically the stuff people see as "junk fill" these days. (Though the OED list has been great for me trying to pattern match old grids.)


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---Why would I need to use the Edit-->Save Dictionary command? Which Dictionary does it save, how do I choose this (DO I even get to choose this?)?

--- End quote ---

I don't know much about Crossfire and this function, but the idea is to give you the ability to be able to add words and save them.


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---What are the ramifications of having multiple word lists wrapped into one (does this even happen?) when some are scored using 0-50 scale, others use 0-100, and some don't score at all? Should I merge these together? Won't that Frankenstein words of different scoring scales into each other and kinda render the whole point of using these scores moot, since it will all be unstandardized?

--- End quote ---

I think it orders preference based on the numbers, which will generate an issue if different word lists have different scoring ranges.  I don't score my word lists when I generate them, but the idea is that you assign the score to each of the words based on your preferences.  I haven't gotten into Crossword Compiler that much, but I'd prefer to see a list of possibilities and then actively select the word as opposed to auto-filling.


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---While completing fill, if I add words to a grid on the fly that aren't in "my dictionary", do these words automatically go into my dictionary or must I add them/save them? But what does "my dictionary" even mean, when I have multiple dictionary files to choose from?

--- End quote ---

I think you have to explicitly add them and save them.


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---What about if I want to eliminate all the scores from all the entries, must I do this one word at a time? In each different dictionary? Or can I do one big sweep and zero (or 100) them all out in one fell swoop? How do I know what score to give words that aren't scored, if I want to do so?

--- End quote ---

I don't know if there's a function in Crossfire that will remove all scores, but you can either strip them out via code or by knowledgeable use of a spreadsheet program.  I think in the raw version it's just CSV text, so you can just rename the extension to that and then load it into the spreadsheet program and delete the scores and save.  Or edit them if you want.  If you want to score words, you just give it a number based on your personal preference for seeing the word come up in your grid.


--- Quote from: flight on May 04, 2020, 05:37:39 PM ---how do I properly set up and start using my dictionary(-ies?) and word lists from the ground up? How is a Dictionary different from a Word List (is it?)?

--- End quote ---

Go through the file and see what kind of words you like and don't like, score them appropriately according to your preferences, and go on.

Anyway, hope that helps some.

Navigation

[0] Message Index

[*] Previous page

Go to full version