Re: [code] lexer for indentation driven blocks

From: Carl Sturtivant <>
Date: Mon, 22 Feb 2016 20:15:18 -0600

Hello Mitchell,

On 2/22/2016 7:52 PM, Mitchell wrote:
> Thanks for the examples. It looks like you'll need a start rule that
> matches some level of beginning whitespace and stores lexer state (that
> probably includes the level of indentation at a minimum), and an end
> rule that checks for the desired level of indentation before matching.
> This is just an idea though, I'm not positive it will work in practice.
> Do you think it would be worth it to add a lexer field like `_LEX_ALL`
> that simply passes the entire buffer's contents to be lexed? At least
> you'll never have to keep persistant track of state (but you'll be
> limited to a small-ish buffer size before you'll see lag, depending on
> the speed of your machine).

I had some ideas during the day, and together with your emailed answers
I think I have a working technique without _LEX_ALL. It'll be
interesting to see how that pans out.

Thanks again,

You are subscribed to
To change subscription settings, send an e-mail to
To unsubscribe, send an e-mail to
Received on Mon 22 Feb 2016 - 21:15:18 EST

This archive was generated by hypermail 2.2.0 : Tue 23 Feb 2016 - 06:50:52 EST