This script generates UniNormalData.inc from the Unicode Character Database and supplementary files. More...

Functions
	callbackCanonical ( $matches)

	callbackCompat ( $matches)

Variables
	$canon = 0

	$canonicalComp = array()

	$canonicalDecomp = array()

	$changed = 42

	$checkNFC = array()

	$combiningClass = array()

	$compat = 0

if(! $in)	$compatibilityDecomp = array()

if(! $in)	$exclude = array()

	$in = fopen("DerivedNormalizationProps.txt", "rt" )

	$out = fopen("UtfNormalData.inc", "wt")

	$pass = 1

	$total = 0

if( $out)	else

	if (PHP_SAPI !='cli')

if(! $in) print Initializing normalization quick check tables	n

Detailed Description

This script generates UniNormalData.inc from the Unicode Character Database and supplementary files.

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. http://www.gnu.org/copyleft/gpl.html

Definition in file UtfNormalGenerate.php.

Function Documentation

◆ callbackCanonical()

callbackCanonical ( $matches )

Definition at line 219 of file UtfNormalGenerate.php.

References $canonicalDecomp, $matches, and global.

◆ callbackCompat()

callbackCompat ( $matches )

Definition at line 227 of file UtfNormalGenerate.php.

References $compatibilityDecomp, $matches, and global.

Variable Documentation

◆ $canon

$canon = 0

Definition at line 89 of file UtfNormalGenerate.php.

◆ $canonicalComp

$canonicalComp = array()

Definition at line 85 of file UtfNormalGenerate.php.

◆ $canonicalDecomp

$canonicalDecomp = array()

Definition at line 84 of file UtfNormalGenerate.php.

Referenced by callbackCanonical().

◆ $changed

$changed = 42

Definition at line 130 of file UtfNormalGenerate.php.

Referenced by PopulateParentId\doDBUpdates(), WikiPage\doEditContent(), LinksUpdate\doIncrementalUpdate(), WikiPage\doUpdateRestrictions(), ApiOptions\execute(), SpecialNewpages\filterLinks(), SpecialWhatLinksHere\getFilterPanel(), SpecialWhatLinksHere\getPrevNext(), WikiRevision\importOldRevision(), LinksUpdate\invalidateProperties(), User\setNewtalk(), and DiffEngine\shiftBoundaries().

◆ $checkNFC

$checkNFC = array()

Definition at line 43 of file UtfNormalGenerate.php.

◆ $combiningClass

$combiningClass = array()

Definition at line 86 of file UtfNormalGenerate.php.

◆ $compat

$compat = 0

Definition at line 88 of file UtfNormalGenerate.php.

◆ $compatibilityDecomp

if (! $in) $compatibilityDecomp = array()

Definition at line 83 of file UtfNormalGenerate.php.

Referenced by callbackCompat().

◆ $exclude

if (! $in) $exclude = array()

Definition at line 65 of file UtfNormalGenerate.php.

Referenced by ApiQueryAllUsers\execute(), MWDocGen\execute(), and WebRequest\getValueNames().

◆ $in

$in = fopen("DerivedNormalizationProps.txt", "rt" )

Definition at line 35 of file UtfNormalGenerate.php.

◆ $out

$out = fopen("UtfNormalData.inc", "wt")

Definition at line 167 of file UtfNormalGenerate.php.

Referenced by MWDebug\addModules(), ChangesListSpecialPage\addModules(), SpecialRecentChanges\addModules(), LoginForm\addNewAccount(), LoginForm\addNewAccountMailPassword(), ParserOutput\addOutputPageMetadata(), UploadForm\addUploadJS(), ApiFormatTestBase\apiRequest(), SiteConfiguration\arrayMerge(), benchmarkForm(), SkinTemplate\buildContentNavigationUrls(), AllmessagesTablePager\buildForm(), ProtectionForm\buildForm(), SkinTemplate\buildNavUrls(), ProtectionForm\buildSelector(), lessc\cachedCompile(), lessc\ccompile(), lessc\checkedCompile(), ImportReporter\close(), lessc_parser\color(), lessc\compile(), lessc\compileCSSBlock(), lessc\compileFile(), lessc\compileImportedProps(), lessc\compileMediaQuery(), lessc\compileProp(), lessc\compileProps(), lessc\compileSelectors(), FormOptions\consumeValues(), SpecialContributions\contributionsSub(), Title\convertByteClassToUnicodeClass(), LanguageLa\convertGrammar(), LoginForm\displaySuccessfulAction(), SpecialRecentChanges\doHeader(), SpecialImport\doImport(), MovePageForm\doSubmit(), ConfEditor\dumpTokens(), ConfEditor\edit(), Xml\element(), ChangesList\endRecentChangesList(), lessc\evaluate(), SpecialPreferences\execute(), SpecialUserlogout\execute(), SpecialSpecialpages\execute(), SpecialContributions\execute(), SpecialTags\execute(), SpecialExport\execute(), SpecialUnblock\execute(), MaintenanceFormatInstallDoc\execute(), SpecialJavaScriptTest\execute(), SpecialListGroupRights\execute(), SpecialWhatLinksHere\execute(), SpecialBlockList\execute(), SpecialAllmessages\execute(), SpecialExpandTemplates\execute(), SpecialPrefixindex\execute(), SpecialVersion\execute(), SpecialChangeEmail\execute(), SpecialEditWatchlist\execute(), SpecialSearch\execute(), UserrightsPage\execute(), LinkSearchPage\execute(), SpecialAllpages\execute(), FileDuplicateSearchPage\execute(), SpecialEmailUser\execute(), GetConfiguration\execute(), SpecialNewpages\execute(), SpecialActiveUsers\execute(), DeletedContributionsPage\execute(), QueryPage\execute(), SpecialUndelete\execute(), PPFrame_Hash\expand(), PPFrame_DOM\expand(), Xml\expandAttributes(), SpecialJavaScriptTest\exportQUnit(), lessc_parser\expression(), UtfNormal\fastCombiningSort(), UtfNormal\fastCompose(), UtfNormal\fastDecompose(), ProfilerSimpleText\format(), FormatMetadata\formatNum(), BrokenRedirectsPage\formatResult(), SpecialSearch\formHeader(), lessc_parser\genericList(), Skin\getCategories(), Skin\getCategoryLinks(), Skin\getCopyrightIcon(), SpecialVersion\getCreditsForExtension(), Skin\getDefaultModules(), SpecialVersion\getEntryPointInfo(), SpecialVersion\getExtensionCategory(), SpecialVersion\getExtensionCredits(), Status\getHTML(), ResourceLoaderStartUpModule\getModuleRegistrations(), Skin\getNewtalks(), ActiveUsersPager\getPageHeader(), UsersPager\getPageHeader(), SpecialVersion\getParserFunctionHooks(), SpecialVersion\getParserTags(), ResourceLoaderStartUpModule\getScript(), DeletedContributionsPage\getSubTitle(), Sanitizer\hackDocType(), LanguageEo\iconv(), Language\iconv(), ImagePage\imageDupes(), ImagePage\imageHistory(), ImagePage\imageLinks(), lessc_parser\import(), SkinVector\initPage(), lessc_parser\interpolation(), ProfilerSimpleText\logData(), LoginForm\mainLoginForm(), ResourceLoader\makeCombinedStyles(), ResourceLoader\makeModuleResponse(), SpecialExpandTemplates\makeOutput(), lessc_parser\match(), lessc_parser\mediaExpression(), lessc_parser\mediaQuery(), lessc_parser\mediaQueryList(), Sanitizer\mergeAttributes(), JavaScriptMinifier\minify(), lessc\multiplyMedia(), lessc\multiplySelectors(), SpecialAllpages\namespaceForm(), SpecialPrefixindex\namespacePrefixForm(), SearchMySQL\normalizeText(), SpecialUnlockdb\onSuccess(), SpecialLockdb\onSuccess(), SpecialBlock\onSuccess(), HistoryAction\onView(), lessc\op_color_color(), SpecialVersion\openExtType(), XmlDumpWriter\openPage(), ImagePage\openShowImage(), lessc_parser\openString(), Maintenance\output(), SpecialListGroupRights\outputNamespaceProtectionInfo(), SkinTemplate\outputPage(), SpecialSpecialpages\outputPageList(), ImageQueryPage\outputResults(), QueryPage\outputResults(), lessc_parser\parenValue(), Installer\parse(), lessc\parse(), DiffHistoryBlob\patch(), lessc_parser\peek(), UtfNormal\placebo(), SpecialJavaScriptTest\plainQUnit(), SpecialBlock\postText(), SkinTemplate\prepareQuickTemplate(), SpecialChangeEmail\pretty(), ImagePage\printSharedImageText(), SearchHighlighter\process(), UserMailer\quotedPrintable(), randomString(), lessc\reduce(), lessc_parser\removeComments(), DifferenceEngine\renderNewRevision(), ApiMain\sendCacheHeaders(), Action\setHeaders(), SpecialPage\setHeaders(), SpecialSearch\setupPage(), SkinModern\setupSkinUserCss(), SkinCologneBlue\setupSkinUserCss(), SkinMonoBook\setupSkinUserCss(), SkinVector\setupSkinUserCss(), SkinTemplate\setupSkinUserCss(), SpecialSearch\shortDialog(), SpecialAllpages\showChunk(), DifferenceEngine\showDiffPage(), ImagePage\showError(), SpecialUndelete\showFileConfirmationForm(), MovePageForm\showForm(), SpecialImport\showForm(), SpecialRevisionDelete\showForm(), LogEventsList\showHeader(), SpecialMergeHistory\showHistory(), SpecialUndelete\showHistory(), SpecialExpandTemplates\showHtmlPreview(), SpecialWhatLinksHere\showIndirectLinks(), SpecialSearch\showInterwiki(), SpecialSearch\showInterwikiHit(), SpecialAllpages\showline(), SpecialBlockList\showList(), SpecialUndelete\showList(), LogEventsList\showLogExtract(), ProtectionForm\showLogExtract(), MovePageForm\showLogFragment(), SpecialSearch\showMatches(), DifferenceEngine\showMissingRevision(), SpecialPrefixindex\showPrefixChunk(), EmailConfirmation\showRequestForm(), SpecialSearch\showResults(), SpecialUndelete\showRevision(), SpecialUndelete\showSearchForm(), MovePageForm\showSubpages(), SpecialAllpages\showToplevel(), SpecialVersion\softwareInformation(), lessc_parser\string(), Skin\subPageSubtitle(), ChangeTags\tagUsageStatistics(), ExtraParserTest\testCleanSigInSig(), ParserMethodsTest\testGetSections(), ExifRotationTest\testRotationRendering(), ExifRotationTest\testRotationRenderingNoAutoRotate(), lessc_parser\to(), lessc\toHSL(), lessc\toRGB(), lessc\tryImport(), SpecialUndelete\undelete(), ImagePage\uploadLinksBox(), Sanitizer\validateAttributes(), ImagePage\view(), SpecialJavaScriptTest\viewQUnit(), Article\viewRedirect(), PPFrame_Hash\virtualBracketedImplode(), PPFrame_DOM\virtualBracketedImplode(), PPFrame_Hash\virtualImplode(), PPFrame_DOM\virtualImplode(), wfHtmlValidationHandler(), XmlDumpWriter\writeContributor(), XmlDumpWriter\writeLogItem(), XmlDumpWriter\writeRevision(), and XmlDumpWriter\writeUploads().

◆ $pass

$pass = 1

Definition at line 131 of file UtfNormalGenerate.php.

Referenced by SpecialChangeEmail\attemptChange(), CommandLineInstaller\execute(), and Article\view().

◆ $total

$total = 0

Definition at line 87 of file UtfNormalGenerate.php.

◆ else

if ($out) else

Initial value:

{

print "Can't create file UtfNormalData.inc\n"

Definition at line 189 of file UtfNormalGenerate.php.

◆ if

if(PHP_SAPI !='cli')

Definition at line 28 of file UtfNormalGenerate.php.

◆ n

print Recursively expanding canonical mappings n

Definition at line 36 of file UtfNormalGenerate.php.

Referenced by WikiDiff3\diff(), WikiDiff3\diff_range(), PostgresField\fromText(), RunningStat\getVariance(), RunningStat\merge(), RunningStat\push(), and SideBarTest\testTrickyPipe().

Functions

Variables