I got a gigantic file of words and phrases, it’s several gigabytes.
I want to use these words and phrases inside the file to make some sort of searchengine where user can search for example “cookie” and receive a list of all the words and phrases that contain the word “cookie”.
Since there so much data I dont think that importing all data into one table would be so smart. But I’m not a expert on MySQL or PHP so you will have to solve this yourself.
Features I need:
1:
I would like to be able to import textfiles with words/phrases very easy. The best would be if I uploaded 20 mb big files with words to the server and then run a cronjob, eachtime the cron started it would import a textfile with keywords it had not already imported.
2: The search-form must be protected by captcha.
3: The results should be listed on the page. But the user should also be able to download a txt-files with the keywords.
4: I must be able to set the minimum length of a word that can be searched. I must also be able to add forbidden-words that cant be searched for!
5: The PHP-code must be written with security in mind.
