Some Regular Expressions that may be useful for data cleaning.

regex_useful.md

Punctuations, US-ASCII

/[!"#$%&()*+,\-.\/:;<=>?@\[\]^_`{|}~]/

Punctuations, include Unicode ones (\u2000-\u206F: general punctuations, \u2E00-\u2E7F: supplemental punctuations)

/[\u2000-\u206F\u2E00-\u2E7F\\'!"#$%&()*+,\-.\/:;<=>?@\[\]^_`{|}~]/

Chinese characters

/[\u4E00-\u9FFF]/

Non-english letters

/[\u00C0-\u1FFF\u2C00-\uD7FF]/

All letters

[\u00C0-\u1FFF\u2C00-\uD7FF\w]

References

• https://stackoverflow.com/questions/4328500/how-can-i-strip-all-punctuation-from-a-string-in-javascript-using-regex
• https://stackoverflow.com/questions/150033/regular-expression-to-match-non-english-characters