lexical analysis


Also found in: Acronyms, Wikipedia.

lexical analysis

(programming)
(Or "linear analysis", "scanning") The first stage of processing a language. The stream of characters making up the source program or other input is read one at a time and grouped into lexemes (or "tokens") - word-like pieces such as keywords, identifiers, literals and punctutation. The lexemes are then passed to the parser.

["Compilers - Principles, Techniques and Tools", by Alfred V. Aho, Ravi Sethi and Jeffrey D. Ullman, pp. 4-5]
References in periodicals archive ?
* Lexical analysis (part of speech tagging, compound word detection) and syntactical analysis (disambiguation, lemmatization of nouns, verbs, adjectives)
Breaking through the limitations of legacy WAF solutions, Signal Sciences next- gen WAF provides advanced detection via its proprietary SmartParse technology, which uses lexical analysis and telemetry data, and offers easy deployment options.
Effective software screening solutions use lexical analysis to match against not only country name variations, ISO country codes and deductions from city names, but also free text descriptions and financial identifiers.
It doesn't have deep lexical analysis, taxonomy tree or that kind of cognitive ability and that is by design.
Also, Nations (2001) three steps were employed as part of the lexical analysis and practice: close analysis of erroneous and correct lexical usage (noticing), oral and written translation exercises and controlled practice oral discussion activities (retrieval), and mini-presentations and small group discussions of word pairs (generation).
Let the phrase after lexical analysis be [C.sub.i] = {< w[g.sub.i1], w[f.sub.i1] >,< w[g.sub.i2], w[f.sub.i2] >, ...,< w[g.sub.ij], w[f.sub.ij]>}.
Lexical analysis of inflected Arabic words using exhaustive search of an augmented transition network.
Erastus presents a morpho-phonological and lexical analysis of six dialects spoken in central Kenya--Igoji, Tharaka, Chuka, Muthambi, and Mwimbi--with a view toward establishing differences and correspondences they exhibit.
The book ends with an essay on "Frames, Constructions, and Metaphors in Spanish FrameNet." In this final chapter, Subirats, director of Spanish FrameNet, outlines the fundamental issues concerning the application of the frame semantics to the lexical analysis of FrameNet.
Next, a lexical analysis was conducted on each document using a dictionary of performance keywords.