Linux grep正则匹配各国语言

红太狼 2023-06-17 15:00 29阅读 0赞

> The Unicode standard places each assigned code point (character) into one script. A script is a group of code points used by a particular human writing system. Some scripts like Thai correspond with a single human language. Other scripts like Latin span multiple languages.
> 
> Some languages are composed of multiple scripts. There is no Japanese Unicode script. Instead, Unicode offers the Hiragana, Katakana, Han, and Latin scripts that Japanese documents are usually composed of.
> 
> A special script is the Common script. This script contains all sorts of characters that are common to a wide range of scripts. It includes all sorts of punctuation, whitespace and miscellaneous symbols.
> 
> All assigned Unicode code points (those matched by \\P\{Cn\}) are part of exactly one Unicode script. All unassigned Unicode code points (those matched by \\p\{Cn\}) are not part of any Unicode script at all.
> 
> The [JGsoft engine][], [Perl][], [PCRE][], [PHP][], [Ruby 1.9][], [Delphi][], and [XRegExp][] can match Unicode scripts. Here’s a list:

1. 匹配中文

grep -P '[\p{Han}]'  test.log

2. 匹配其他国家语言

>     \p{Common} \p{Arabic} \p{Armenian} \p{Bengali} \p{Bopomofo} 
>     \p{Braille} \p{Buhid} \p{Canadian_Aboriginal} \p{Cherokee} 
>     \p{Cyrillic} \p{Devanagari} \p{Ethiopic} \p{Georgian} \p{Greek} 
>     \p{Gujarati} \p{Gurmukhi} \p{Han} \p{Hangul} \p{Hanunoo} \p{Hebrew} 
>     \p{Hiragana} \p{Inherited} \p{Kannada} \p{Katakana} \p{Khmer} \p{Lao} 
>     \p{Latin} \p{Limbu} \p{Malayalam} \p{Mongolian} \p{Myanmar} \p{Ogham} 
>     \p{Oriya} \p{Runic} \p{Sinhala} \p{Syriac} \p{Tagalog} \p{Tagbanwa} 
>     \p{TaiLe} \p{Tamil} \p{Telugu} \p{Thaana} \p{Thai} \p{Tibetan}

[JGsoft engine]: https://www.regular-expressions.info/jgsoft.html
[Perl]: https://www.regular-expressions.info/perl.html
[PCRE]: https://www.regular-expressions.info/pcre.html
[PHP]: https://www.regular-expressions.info/php.html
[Ruby 1.9]: https://www.regular-expressions.info/ruby.html
[Delphi]: https://www.regular-expressions.info/delphi.html
[XRegExp]: https://www.regular-expressions.info/xregexp.html