multiple input terms with/without spelling errors.mistakenly omitted space between two correct words led to one incorrect combined term.mistakenly inserted space within a correct word led to two incorrect terms.SymSpellCompound supports compound splitting / decompounding with three cases: SymSpell assumed every input string as a single term. It is built on top of SymSpell’s 1 million times faster spelling correction algorithm. SymSpellCompound supports compound aware automatic spelling correction of multi-word input strings. My curiosity was aroused and I decided to try if an additional algorithmic layer on top of SymSpell could deal with it. SymSpell always expected a single input term and could not correct spaces inserted into a word or spaces missing between two words. SymSpell, based on the Symmetric Delete spelling correction algorithm, just took 0.000033 seconds (edit distance 2) and 0.000180 seconds (edit distance 3) on an old MacBook Pro.īut then again, their approach was able to deal with more complex expressions like “Whereis th elove”! While so far no correction performance and memory consumption for the deep learning approach were disclosed, I knew that spelling correction can be done much faster than the 0.1 seconds. The reason why they resorted to deep learning was what they perceived as the “abysmal” performance of the conventional spell-checking (which was estimated at ~0.1 seconds for spelling a short word). Meanwhile the initial enthusiasm for Deep Learning in spelling correction has been followed by some disillusion. The question is whether the Deep Learning Multi-tool is going to excel and replace highly specialized algorithms and data structures in every domain, if they both deserve their place or if they shine if their complementary strengths are combined. It is really fascinating how universal Deep learning is from AlphaGo winning Go championships, Watson winning Jeopardy, fighting Fake news and threatening mankind with Singularity. They applied a deep learning approach, the philosopher’s stone of modern times. Recently I was pointed to two interesting posts about spelling correction (and here).
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |