Base class for multi-variant language conversion. More...

Inheritance diagram for LanguageConverter:

[legend]

Collaboration diagram for LanguageConverter:

[legend]

Public Member Functions
	__construct ( $langobj)

	autoConvert ( $text, $toVariant=false)
	Dictionary-based conversion.

	autoConvertToAllVariants ( $text)
	Call translate() to convert text to all valid variants.

	convert ( $text)
	Convert text to different variants of a language.

	convertCategoryKey ( $key)
	Convert the sorting key for category links.

	convertHtml ( $text)
	Perform output conversion on a string, and encode for safe HTML output.

	convertNamespace ( $index, $variant=null)
	Get the namespace display name in the preferred variant.

	convertTitle ( $title)
	Auto convert a LinkTarget or PageReference to a readable string in the preferred variant.

	convertTo ( $text, $variant)
	Same as convert() except a extra parameter to custom variant.

	findVariantLink (&$link, &$nt, $ignoreOtherCond=false)
	If a language supports multiple variants, it is possible that non-existing link in one variant actually exists in another variant.

	getConvRuleTitle ()
	Get the title produced by the conversion rule.

	getDefaultVariant ()
	This function would not be affected by user's settings.

	getDescCodeSeparator ()
	Get desc code separator.

	getDescVarSeparator ()
	Get desc var separator.

	getExtraHashOptions ()
	Returns language specific hash options.

	getFlags ()
	Get strings that maps to the flags.

	getMainCode ()
	Get main language code.

	getManualLevel ()
	Get manual level limit for supported variants.

	getPreferredVariant ()
	Get preferred language variant.

	getURLVariant ()
	Get the variant specified in the URL.

	getVariantFallbacks ( $variant)
	In case some variant is not defined in the markup, we need to have some fallback.

	getVariantNames ()
	Get variant names.

	getVariants ()
	Get all valid variants for current Coverter.

	getVariantsFallbacks ()
	Get language variants fallbacks.

	getVarSeparatorPattern ()
	Get the cached separator pattern for ConverterRule::parseRules()

	guessVariant ( $text, $variant)
	Guess if a text is written in a variant.

	hasVariant ( $variant)
	Strict check if the language has the specific variant.

	hasVariants ()
	Check if this is a language with variants.

	markNoConversion ( $text, $noParse=false)
	Enclose a string with the "no conversion" tag.

	translate ( $text, $variant)
	Translate a string to a variant.

	updateConversionTable (LinkTarget $linkTarget)
	Refresh the cache of conversion tables when MediaWiki:Conversiontable* is updated.

	validateVariant ( $variant=null)
	Validate the variant and return an appropriate strict internal variant code if one exists.

Static Public Attributes
static array	$languagesWithVariants
	languages supporting variants

Protected Member Functions
	applyManualConv (ConverterRule $convRule)
	Apply manual conversion rules.

	getAdditionalFlags ()
	Provides additional flags for converter.

	getAdditionalManualLevel ()
	Provides additional flags for converter.

	getHeaderVariant ()
	Determine the language variant from the Accept-Language header.

	getLanguageVariants ()
	Get supported variants of the language.

	getUserVariant (User $user)
	Determine if the user has a variant set.

	loadDefaultTables ()
	Load default conversion tables.

	loadTables ( $fromCache=true)
	Load conversion tables either from the cache or the disk.

	postLoadTables ()
	Hook for post processing after conversion tables are loaded.

	recursiveConvertRule ( $text, $variant, &$startPos, $depth=0)
	Recursively convert text on the inside.

	recursiveConvertTopLevel ( $text, $variant, $depth=0)
	Recursively convert text on the outside.

Protected Attributes
ReplacementArray[] bool[]	$mTables

Private Member Functions
	parseCachedTable ( $code, $subpage='', $recursive=true)
	Parse the conversion table stored in the cache.

	reloadTables ()
	Reload the conversion tables.

Private Attributes
	$mConvRuleTitle = false

	$mHeaderVariant

Language	$mLangObj

	$mMaxDepth = 10

	$mTablesLoaded = false

	$mUcfirst = false

	$mURLVariant

	$mUserVariant

	$mVarSeparatorPattern

const	CACHE_VERSION_KEY = 'VERSION 7'

Detailed Description

Base class for multi-variant language conversion.

Definition at line 36 of file LanguageConverter.php.

Constructor & Destructor Documentation

◆ __construct()

LanguageConverter::__construct ( $langobj )

Parameters

Language $langobj

Reimplemented in CrhConverter.

Definition at line 84 of file LanguageConverter.php.

References deprecatePublicProperty(), deprecatePublicPropertyFallback(), getDescCodeSeparator(), getDescVarSeparator(), getFlags(), getMainCode(), getVariantNames(), getVariants(), and getVariantsFallbacks().

Member Function Documentation

◆ applyManualConv()

LanguageConverter::applyManualConv ( ConverterRule $convRule )

protected

Apply manual conversion rules.

Parameters

ConverterRule $convRule

Definition at line 689 of file LanguageConverter.php.

References ConverterRule\getConvTable(), ConverterRule\getRulesAction(), and ConverterRule\getTitle().

◆ autoConvert()

LanguageConverter::autoConvert	(	$text,
		$toVariant = `false`
	)

Dictionary-based conversion.

This function would not parse the conversion rules. If you want to parse rules, try to use convert() or convertTo().

Parameters

string	$text	The text to be converted
bool \| string	$toVariant	The target language code

Returns: string The converted text

Implements ILanguageConverter.

Definition at line 497 of file LanguageConverter.php.

References StringUtils\explode(), and Parser\MARKER_PREFIX.

◆ autoConvertToAllVariants()

LanguageConverter::autoConvertToAllVariants ( $text )

Call translate() to convert text to all valid variants.

Parameters

string $text The text to be converted

Returns: array Variant => converted text

Implements ILanguageConverter.

Definition at line 673 of file LanguageConverter.php.

◆ convert()

LanguageConverter::convert ( $text )

Convert text to different variants of a language.

The automatic conversion is done in autoConvert(). Here we parse the text marked with -{}-, which specifies special conversions of the text that can not be accomplished in autoConvert().

Syntax of the markup: -{code1:text1;code2:text2;...}- or -{flags|code1:text1;code2:text2;...}- or -{text}- in which case no conversion should take place for text

Warning: Glossary state is maintained between calls. Never feed this method input that hasn't properly been escaped as it may result in an XSS in subsequent calls, even if those subsequent calls properly escape things.

Parameters

string $text Text to be converted, already html escaped.

Returns: string Converted text (html)

Implements ILanguageConverter.

Definition at line 810 of file LanguageConverter.php.

◆ convertCategoryKey()

LanguageConverter::convertCategoryKey ( $key )

Convert the sorting key for category links.

This should make different keys that are variants of each other map to the same key.

Parameters

string $key

Returns: string

Implements ILanguageConverter.

Reimplemented in GanConverter, KkConverter, and ZhConverter.

Definition at line 1293 of file LanguageConverter.php.

◆ convertHtml()

LanguageConverter::convertHtml ( $text )

Perform output conversion on a string, and encode for safe HTML output.

Since: 1.35

Parameters

string $text Text to be converted

Returns: string

Implements ILanguageConverter.

Definition at line 1391 of file LanguageConverter.php.

◆ convertNamespace()

LanguageConverter::convertNamespace	(	$index,
		$variant = `null`
	)

Get the namespace display name in the preferred variant.

Parameters

int	$index	Namespace id
string \| null	$variant	Variant code or null for preferred variant

Returns: string Namespace name for display

Implements ILanguageConverter.

Definition at line 748 of file LanguageConverter.php.

References $cache, Language\getFormattedNsText(), NS_MAIN, and wfMessage().

◆ convertTitle()

LanguageConverter::convertTitle ( $title )

Auto convert a LinkTarget or PageReference to a readable string in the preferred variant.

Parameters

LinkTarget | PageReference $title

Returns: string Converted title text

Implements ILanguageConverter.

Definition at line 727 of file LanguageConverter.php.

References $title, and NS_MAIN.

◆ convertTo()

LanguageConverter::convertTo	(	$text,
		$variant
	)

Same as convert() except a extra parameter to custom variant.

Parameters

string	$text	Text to be converted, already html escaped
-taint	$text	exec_html
string	$variant	The target variant code

Returns: string Converted text; -taint escaped

Implements ILanguageConverter.

Definition at line 824 of file LanguageConverter.php.

◆ findVariantLink()

LanguageConverter::findVariantLink	(	&	$link,
		&	$nt,
			$ignoreOtherCond = `false`
	)

If a language supports multiple variants, it is possible that non-existing link in one variant actually exists in another variant.

This function tries to find it. See e.g. LanguageZh.php The input parameters may be modified upon return

Parameters

string	&$link	The name of the link
Title	&$nt	The title object of the link
bool	$ignoreOtherCond	To disable other conditions when we need to transclude a template or update a category's link

Implements ILanguageConverter.

Reimplemented in LanguageConverterSpecific.

Definition at line 976 of file LanguageConverter.php.

References $wgRequest, and NS_MAIN.

◆ getAdditionalFlags()

LanguageConverter::getAdditionalFlags ( )

protected

Provides additional flags for converter.

By default it return empty array and typically should be overridden by implementation of converter.

Returns: array

Reimplemented in SrConverter.

Definition at line 184 of file LanguageConverter.php.

Referenced by getFlags().

◆ getAdditionalManualLevel()

LanguageConverter::getAdditionalManualLevel ( )

protected

Provides additional flags for converter.

By default it return empty array and typically should be overridden by implementation of converter.

Since: 1.36

Returns: array

Reimplemented in GanConverter, and ZhConverter.

Definition at line 214 of file LanguageConverter.php.

◆ getConvRuleTitle()

LanguageConverter::getConvRuleTitle ( )

Get the title produced by the conversion rule.

Returns: string The converted title text

Implements ILanguageConverter.

Definition at line 280 of file LanguageConverter.php.

◆ getDefaultVariant()

LanguageConverter::getDefaultVariant ( )

This function would not be affected by user's settings.

Returns: string The default variant code

Implements ILanguageConverter.

Definition at line 326 of file LanguageConverter.php.

References $wgDefaultLanguageVariant.

◆ getDescCodeSeparator()

LanguageConverter::getDescCodeSeparator ( )

Get desc code separator.

By default returns ":", can be overridden by implementation of converter.

Since: 1.36

Returns: string

Reimplemented in GanConverter, and ZhConverter.

Definition at line 225 of file LanguageConverter.php.

Referenced by __construct().

◆ getDescVarSeparator()

LanguageConverter::getDescVarSeparator ( )

Get desc var separator.

By default returns ";", can be overridden by implementation of converter.

Since: 1.36

Returns: string

Reimplemented in GanConverter, and ZhConverter.

Definition at line 236 of file LanguageConverter.php.

Referenced by __construct().

◆ getExtraHashOptions()

LanguageConverter::getExtraHashOptions ( )

Returns language specific hash options.

Returns: string

Implements ILanguageConverter.

Definition at line 1045 of file LanguageConverter.php.

◆ getFlags()

LanguageConverter::getFlags ( )

final

Get strings that maps to the flags.

Since: 1.36

Returns: array

Definition at line 157 of file LanguageConverter.php.

References getAdditionalFlags(), and getVariants().

Referenced by __construct().

◆ getHeaderVariant()

LanguageConverter::getHeaderVariant ( )

protected

Determine the language variant from the Accept-Language header.

Returns: mixed Variant if one found, null otherwise

Definition at line 440 of file LanguageConverter.php.

References $wgRequest.

◆ getLanguageVariants()

LanguageConverter::getLanguageVariants ( )

abstractprotected

Get supported variants of the language.

Since: 1.36

Returns: array

Reimplemented in BanConverter, CrhConverter, EnConverter, GanConverter, IuConverter, KkConverter, KuConverter, ShiConverter, SrConverter, TgConverter, TlyConverter, UzConverter, and ZhConverter.

◆ getMainCode()

LanguageConverter::getMainCode ( )

abstract

Get main language code.

Since: 1.36

Returns: string

Reimplemented in BanConverter, CrhConverter, EnConverter, GanConverter, IuConverter, KkConverter, KuConverter, ShiConverter, SrConverter, TgConverter, TlyConverter, UzConverter, and ZhConverter.

Referenced by __construct(), and LanguageConverterSpecific\findVariantLink().

◆ getManualLevel()

LanguageConverter::getManualLevel ( )

final

Get manual level limit for supported variants.

Since: 1.36

Returns: array

Definition at line 194 of file LanguageConverter.php.

◆ getPreferredVariant()

LanguageConverter::getPreferredVariant ( )

Get preferred language variant.

Returns: string The preferred language code

Implements ILanguageConverter.

Definition at line 288 of file LanguageConverter.php.

References $wgDefaultLanguageVariant.

Referenced by LanguageConverterSpecific\findVariantLink().

◆ getURLVariant()

LanguageConverter::getURLVariant ( )

Get the variant specified in the URL.

Returns: mixed Variant if one found, null otherwise

Implements ILanguageConverter.

Definition at line 382 of file LanguageConverter.php.

References $wgRequest.

◆ getUserVariant()

LanguageConverter::getUserVariant ( User $user )

protected

Determine if the user has a variant set.

Parameters

User $user

Returns: mixed Variant if one found, null otherwise

Definition at line 406 of file LanguageConverter.php.

References User\isRegistered(), and User\isSafeToLoad().

◆ getVariantFallbacks()

LanguageConverter::getVariantFallbacks ( $variant )

In case some variant is not defined in the markup, we need to have some fallback.

For example, in zh, normally people will define zh-hans and zh-hant, but less so for zh-sg or zh-hk. when zh-sg is preferred but not defined, we will pick zh-hans in this case. Right now this is only used by zh.

Parameters

string $variant The language code of the variant

Returns: string|array The code of the fallback language or the main code if there is no fallback

Implements ILanguageConverter.

Definition at line 272 of file LanguageConverter.php.

◆ getVariantNames()

LanguageConverter::getVariantNames ( )

Get variant names.

Returns: array

Reimplemented in BanConverter, GanConverter, and ZhConverter.

Definition at line 245 of file LanguageConverter.php.

Referenced by __construct().

◆ getVariants()

LanguageConverter::getVariants ( )

final

Get all valid variants for current Coverter.

It uses abstract

Returns: string[] Contains all valid variants

Implements ILanguageConverter.

Definition at line 256 of file LanguageConverter.php.

References $wgDisabledVariants.

Referenced by __construct(), getFlags(), and LanguageConverterIcu\loadDefaultTables().

◆ getVariantsFallbacks()

LanguageConverter::getVariantsFallbacks ( )

abstract

Get language variants fallbacks.

Since: 1.36

Returns: array

Reimplemented in BanConverter, CrhConverter, EnConverter, GanConverter, IuConverter, KkConverter, KuConverter, ShiConverter, SrConverter, TgConverter, TlyConverter, UzConverter, and ZhConverter.

Referenced by __construct().

◆ getVarSeparatorPattern()

LanguageConverter::getVarSeparatorPattern ( )

Get the cached separator pattern for ConverterRule::parseRules()

Returns: string

Definition at line 1319 of file LanguageConverter.php.

◆ guessVariant()

LanguageConverter::guessVariant	(	$text,
		$variant
	)

Guess if a text is written in a variant.

This should be implemented in subclasses.

Parameters

string	$text	The text to be checked
string	$variant	Language code of the variant to be checked for

Returns: bool True if $text appears to be written in $variant, false if not

Author: Nikola Smolenski smole.nosp@m.nsk@.nosp@m.eunet.nosp@m..rs

Since: 1.19

Implements ILanguageConverter.

Reimplemented in BanConverter, and SrConverter.

Definition at line 1061 of file LanguageConverter.php.

◆ hasVariant()

LanguageConverter::hasVariant ( $variant )

Strict check if the language has the specific variant.

Compare to LanguageConverter::validateVariant() which does a more lenient check and attempts to coerce the given code to a valid one.

Since: 1.35

Parameters

string $variant

Returns: bool

Implements ILanguageConverter.

Definition at line 1379 of file LanguageConverter.php.

◆ hasVariants()

LanguageConverter::hasVariants ( )

Check if this is a language with variants.

Since: 1.35

Returns: bool

Implements ILanguageConverter.

Definition at line 1365 of file LanguageConverter.php.

◆ loadDefaultTables()

LanguageConverter::loadDefaultTables ( )

protected

Load default conversion tables.

This method must be implemented in derived class.

Exceptions

MWException

Reimplemented in EnConverter, GanConverter, IuConverter, KkConverter, KuConverter, ShiConverter, SrConverter, TgConverter, TlyConverter, UzConverter, ZhConverter, and LanguageConverterIcu.

Definition at line 1071 of file LanguageConverter.php.

◆ loadTables()

LanguageConverter::loadTables ( $fromCache = true )

protected

Load conversion tables either from the cache or the disk.

Access: private

Parameters

bool $fromCache Load from memcached? Defaults to true.

Definition at line 1081 of file LanguageConverter.php.

References $cache, and $wgLanguageConverterCacheType.

◆ markNoConversion()

LanguageConverter::markNoConversion	(	$text,
		$noParse = `false`
	)

Enclose a string with the "no conversion" tag.

This is used by various functions in the Parser.

Parameters

string	$text	Text to be tagged for no conversion
bool	$noParse	Unused

Returns: string The tagged text

Implements ILanguageConverter.

Definition at line 1275 of file LanguageConverter.php.

◆ parseCachedTable()

LanguageConverter::parseCachedTable	(	$code,
		$subpage = `''`,
		$recursive = `true`
	)

private

Parse the conversion table stored in the cache.

The tables should be in blocks of the following form: -{ word => word ; word => word ; ... }-

To make the tables more manageable, subpages are allowed and will be parsed recursively if $recursive == true.

Parameters

string	$code	Language code
string	$subpage	Subpage name
bool	$recursive	Parse subpages recursively? Defaults to true.

Returns: array

Definition at line 1157 of file LanguageConverter.php.

References $s, $t, $title, CONTENT_MODEL_WIKITEXT, StringUtils\explode(), and NS_MEDIAWIKI.

◆ postLoadTables()

LanguageConverter::postLoadTables ( )

protected

Hook for post processing after conversion tables are loaded.

Reimplemented in KkConverter, and ZhConverter.

Definition at line 1118 of file LanguageConverter.php.

◆ recursiveConvertRule()

LanguageConverter::recursiveConvertRule	(		$text,
			$variant,
		&	$startPos,
			$depth = `0`
	)

protected

Recursively convert text on the inside.

Parameters

string	$text	Text to be converted
string	$variant	The target variant code
int	&$startPos
int	$depth	Depth of recursion

Exceptions

MWException

Returns: string Converted text

Definition at line 898 of file LanguageConverter.php.

References wfMessage().

◆ recursiveConvertTopLevel()

LanguageConverter::recursiveConvertTopLevel	(	$text,
		$variant,
		$depth = `0`
	)

protected

Recursively convert text on the outside.

Allow to use nested markups to custom rules.

Parameters

string	$text	Text to be converted
string	$variant	The target variant code
int	$depth	Depth of recursion

Returns: string Converted text

Definition at line 843 of file LanguageConverter.php.

◆ reloadTables()

LanguageConverter::reloadTables ( )

private

Reload the conversion tables.

Also used by test suites which need to reset the converter state.

Called by ParserTestRunner with the help of TestingAccessWrapper

Definition at line 1128 of file LanguageConverter.php.

◆ translate()

LanguageConverter::translate	(	$text,
		$variant
	)

Translate a string to a variant.

Doesn't parse rules or do any of that other stuff, for that use convert() or convertTo().

Parameters

string	$text	Text to convert
string	$variant	Variant language code

Returns: string Translated text

Implements ILanguageConverter.

Reimplemented in EnConverter, IuConverter, KkConverter, KuConverter, ShiConverter, SrConverter, UzConverter, and LanguageConverterIcu.

Definition at line 657 of file LanguageConverter.php.

◆ updateConversionTable()

LanguageConverter::updateConversionTable ( LinkTarget $linkTarget )

Refresh the cache of conversion tables when MediaWiki:Conversiontable* is updated.

Parameters

LinkTarget $linkTarget The LinkTarget of the page being updated

Implements ILanguageConverter.

Definition at line 1303 of file LanguageConverter.php.

References $t, MediaWiki\Linker\LinkTarget\getDBkey(), MediaWiki\Linker\LinkTarget\getNamespace(), and NS_MEDIAWIKI.

◆ validateVariant()

LanguageConverter::validateVariant ( $variant = null )

Validate the variant and return an appropriate strict internal variant code if one exists.

Compare to Language::hasVariant() which does a strict test.

Parameters

string | null $variant The variant to validate

Returns: mixed Returns an equivalent valid variant code if possible, null otherwise

Implements ILanguageConverter.

Definition at line 354 of file LanguageConverter.php.

Member Data Documentation

◆ $languagesWithVariants

array LanguageConverter::$languagesWithVariants

static

Initial value:

= [
        'ban',
        'en',
        'crh',
        'gan',
        'iu',
        'kk',
        'ku',
        'shi',
        'sr',
        'tg',
        'uz',
        'zh',
    ]

languages supporting variants

Since: 1.20

Definition at line 44 of file LanguageConverter.php.

◆ $mConvRuleTitle

LanguageConverter::$mConvRuleTitle = false

private

Definition at line 72 of file LanguageConverter.php.

◆ $mHeaderVariant

LanguageConverter::$mHeaderVariant

private

Definition at line 75 of file LanguageConverter.php.

◆ $mLangObj

Language LanguageConverter::$mLangObj

private

Definition at line 69 of file LanguageConverter.php.

◆ $mMaxDepth

LanguageConverter::$mMaxDepth = 10

private

Definition at line 76 of file LanguageConverter.php.

◆ $mTables

ReplacementArray [] bool [] LanguageConverter::$mTables

protected

Definition at line 64 of file LanguageConverter.php.

◆ $mTablesLoaded

LanguageConverter::$mTablesLoaded = false

private

Definition at line 59 of file LanguageConverter.php.

◆ $mUcfirst

LanguageConverter::$mUcfirst = false

private

Definition at line 71 of file LanguageConverter.php.

◆ $mURLVariant

LanguageConverter::$mURLVariant

private

Definition at line 73 of file LanguageConverter.php.

◆ $mUserVariant

LanguageConverter::$mUserVariant

private

Definition at line 74 of file LanguageConverter.php.

◆ $mVarSeparatorPattern

LanguageConverter::$mVarSeparatorPattern

private

Definition at line 77 of file LanguageConverter.php.

◆ CACHE_VERSION_KEY

const LanguageConverter::CACHE_VERSION_KEY = 'VERSION 7'

private

Definition at line 79 of file LanguageConverter.php.

The documentation for this class was generated from the following file:

includes/language/LanguageConverter.php

Public Member Functions

Static Public Attributes

Protected Member Functions

Protected Attributes

Private Member Functions

Private Attributes

Detailed Description

Constructor & Destructor Documentation

◆ __construct()

Member Function Documentation

◆ applyManualConv()

◆ autoConvert()

◆ autoConvertToAllVariants()

◆ convert()

◆ convertCategoryKey()

◆ convertHtml()

◆ convertNamespace()

◆ convertTitle()

◆ convertTo()

◆ findVariantLink()

◆ getAdditionalFlags()

◆ getAdditionalManualLevel()

◆ getConvRuleTitle()

◆ getDefaultVariant()

◆ getDescCodeSeparator()

◆ getDescVarSeparator()

◆ getExtraHashOptions()

◆ getFlags()

◆ getHeaderVariant()

◆ getLanguageVariants()

◆ getMainCode()

◆ getManualLevel()

◆ getPreferredVariant()

◆ getURLVariant()

◆ getUserVariant()

◆ getVariantFallbacks()

◆ getVariantNames()

◆ getVariants()

◆ getVariantsFallbacks()

◆ getVarSeparatorPattern()

◆ guessVariant()

◆ hasVariant()

◆ hasVariants()

◆ loadDefaultTables()

◆ loadTables()

◆ markNoConversion()

◆ parseCachedTable()

◆ postLoadTables()

◆ recursiveConvertRule()

◆ recursiveConvertTopLevel()

◆ reloadTables()

◆ translate()

◆ updateConversionTable()

◆ validateVariant()

Member Data Documentation

◆ $languagesWithVariants

◆ $mConvRuleTitle

◆ $mHeaderVariant

◆ $mLangObj

◆ $mMaxDepth

◆ $mTables

◆ $mTablesLoaded

◆ $mUcfirst

◆ $mURLVariant

◆ $mUserVariant

◆ $mVarSeparatorPattern

◆ CACHE_VERSION_KEY