Formulations of linguistic structures, finite-set, phrase-structure, transformational dependency, predictive, with emphasis on their mathematical properties. Mathematical concepts underlying these formulations, such as sets, relations, Markov processes, and automata.