Public Member Functions
def	__init__ (self, token_re, token_string)

def	DeTokenize (self, line)

def	Tokenize (self, line)

def	TokenizeMatches (self, m)

Public Attributes
	originals

	token_re

	token_string

Detailed Description

Replaces any CSS comments with string tokens and vice versa.

Definition at line 205 of file cssjanus.py.

Constructor & Destructor Documentation

◆ init()

def cssjanus.Tokenizer.__init__	(	self,
		token_re,
		token_string
	)

Constructor for the Tokenizer.

Args:
  token_re: A regex for the string to be replace by a token.
  token_string: The string to put between token delimiters when tokenizing.

Definition at line 208 of file cssjanus.py.

Member Function Documentation

◆ DeTokenize()

def cssjanus.Tokenizer.DeTokenize	(	self,
		line
	)

Replaces tokens with the original string.

Args:
  line: A line with tokens.

Returns:
  line with any tokens replaced by the original string.

Definition at line 237 of file cssjanus.py.

References cssjanus.Tokenizer.originals, and cssjanus.Tokenizer.token_string.

◆ Tokenize()

def cssjanus.Tokenizer.Tokenize	(	self,
		line
	)

Replaces any string matching token_re in line with string tokens.

By passing a function as an argument to the re.sub line below, we bypass
the usual rule where re.sub will only replace the left-most occurrence of
a match by calling the passed in function for each occurrence.

Args:
  line: A line to replace token_re matches in.

Returns:
  line: A line with token_re matches tokenized.

Definition at line 220 of file cssjanus.py.

References cssjanus.Tokenizer.token_re, and cssjanus.Tokenizer.TokenizeMatches().

◆ TokenizeMatches()

def cssjanus.Tokenizer.TokenizeMatches	(	self,
		m
	)

Replaces matches with tokens and stores the originals.

Args:
  m: A match object.

Returns:
  A string token which replaces the CSS comment.

Definition at line 256 of file cssjanus.py.

References cssjanus.Tokenizer.originals, and cssjanus.Tokenizer.token_string.

Referenced by cssjanus.Tokenizer.Tokenize().

Member Data Documentation

◆ originals

cssjanus.Tokenizer.originals

Definition at line 218 of file cssjanus.py.

Referenced by cssjanus.Tokenizer.DeTokenize(), and cssjanus.Tokenizer.TokenizeMatches().

◆ token_re

cssjanus.Tokenizer.token_re

Definition at line 216 of file cssjanus.py.

Referenced by cssjanus.Tokenizer.Tokenize().

◆ token_string

cssjanus.Tokenizer.token_string

Definition at line 217 of file cssjanus.py.