Parser combinators for EBNF
3.4.1 Parser combinators for EBNF
It is very easy to make new parser combinators for EBNF. As a first example we consider repetition. Given a parser for a construction, many constructs a parser for zero or more occurrences of that construction:
many
:: Parser s a -> Parser s [a] many p = list <> p <> many p
<|> succeed []
So the EBNF expression P ∗ is implemented by many P. The auxiliary function list takes an element and a list, and combines them in a simple list:
list x xs = x:xs So list is just (:), and we might have written that in the definition of many, but
then the definition might have looked too cryptic at first sight. The order in which the alternatives are given only influences the order in which
solutions are placed in the list of successes. For example, the many combinator can be used in parsing a natural number:
natural
:: Parser Char Int
natural
= foldl f 0 <> many newdigit
where
f a b = a10 + b
Defined in this way, the natural parser also accepts empty input as a number. If this is not desired, we had better use the many1 parser combinator, which accepts one or more occurrences of a construction, and corresponds to the EBNF expression P + , see Section 2.7. It is defined in listing 5.
Another combinator from EBNF is the option combinator P ?. It takes a parser as argument, and returns a parser that recognises the same construct, but which also succeeds if that construct is not present in the input string. The definition is given
Parser combinators
-- EBNF parser combinators option
:: Parser s a -> a -> Parser s a
option p d = p <|> succeed d many
:: Parser s a -> Parser s [a] many p = list <> p <> many p <|> succeed []
many1
:: Parser s a -> Parser s [a]
many1 p = list <> p <> many p
pack
:: Parser s a -> Parser s b -> Parser s c -> Parser s b
pack p r q = (\x y z -> y) <> p <> r <> q listOf
:: Parser s a -> Parser s b -> Parser s [a]
listOf p s = list <> p <> many ((\x y -> y) <> s <> p) -- Auxiliary functions first :: Parser s b -> Parser s b
first p xs | null r
| otherwise = [head r]
where r = p xs greedy, greedy1 :: Parser s b -> Parser s [b]
greedy
= first . many
greedy1 = first . many1 list x xs = x:xs
Listing 5: EBNF.hs
3.4 More parser combinators
in listing 5. It has an additional argument: the value that should be used as result in case the construct is not present. It is a kind of ‘default’ value.
By the use of the option and many functions, a large amount of backtracking possi- bilities are introduced. This is not always advantageous. For example, if we define
a parser for identifiers by
identifier = many1 (satisfy isAlpha)
a single word may also be parsed as two identifiers. Caused by the order of the alternatives in the definition of many (succeed [] appears as the second alternative), the ‘greedy’ parsing, which accumulates as many letters as possible in the identifier is tried first, but if parsing fails elsewhere in the sentence, also less greedy parsings of the identifier are tried – in vain. You will give a better definition of identifier in Exercise 3.26.
In situations where from the way the grammar is built we can predict that it is hopeless to try non-greedy results of many, we can define a parser transformer first, that transforms a parser into a parser that only returns the first possible parsing. It does so by taking the first element of the list of successes.
first :: Parser a b -> Parser a b first p xs | null r
| otherwise = [head r]
where r = p xs Using this function, we can create a special ‘take all or nothing’ version of many:
greedy
= first . many
greedy1 = first . many1 If we compose the first function with the option parser combinator:
obligatory p d = first (option p d) we get a parser which must accept a construction if it is present, but which does not
fail if it is not present.