* adds language-validation.js
* run prettier
* run prettier on gulpfile.js
* moves language-validation.js functionality into json-validation.js, rollback gulpfile.js
* improves duplicate detection algorithm, removes constraint
* use duplicate detection from @Bruception
* moves findDuplicates function out of loop, adds duplicatePercentageThreshold
* removes russian_10k as 90% of the words are duplicates
* use Math.round to prevent errors when duplicatePercentageThreshold is 0
* remove duplicates from code_bash.json
* remove duplicates from code_brainfck.json
* remove duplicates from code_html.json
* no longer create error when duplicates are found
* run prettier
* lowered threshold, added count log
Co-authored-by: Maximilian Kronenbürger <maximilian.kronenbuerger@1und1.de>
Co-authored-by: Miodec <bartnikjack@gmail.com>