ligo/src/passes/1-parser/cameligo/LexerMain.ml

(* Driver for the CameLIGO lexer *)

module Region = Simple_utils.Region

module IO =
  struct
    let options =
      let open EvalOpt in
      let block = mk_block ~opening:"(*" ~closing:"*)"
      in read ~block ~line:"//" ".mligo"
  end

module M = LexerUnit.Make (IO) (Lexer.Make (LexToken))

let () =
  match M.trace () with
    Stdlib.Ok () -> ()
  | Error Region.{value; _} -> Printf.eprintf "\027[31m%s\027[0m%!" value
Forgot to add those fixes to the previous commit. 2020-01-31 14:11:56 +01:00			`(* Driver for the CameLIGO lexer *)`
Extended lib_utils/pos.ml{i}. First import of Ligodity. (No "simplify" yet.) 2019-05-12 19:31:22 +02:00
I upgraded the parsers to accept `Map.map` etc. I rewrote the doc except "reference" to promote and deprecate built-ins. 2020-02-25 18:07:53 +01:00			`module Region = Simple_utils.Region`

Sharing standalone lexers and parsers, and parser error API. 2020-01-04 19:49:22 +01:00			`module IO =`
			`struct`
The preprocessor library depends now on the kinds of comments instead of a closed set of languages. I also removed the offsets: I simply use the current region to determine whether the preprocessing directie starts at the beginning of a line. I also removed scanning line indicators, to make the lexer simpler. LexToken.mll: Moved the function [check_right_context] that checks stylistic constraints from Lexer.mll to LexToken.mll. While this triplicates code (as CameLIGO, PascaLIGO and ReasonLIGO share the same constraints), the benefit is that Lexer.mll becomes more generic and the signature for the TOKEN module is simpler (no more exporting predicates, except for EOF). In accordance with the change of the preprocessor, the lexers and parsers for LIGO now depend on the kind of comments, not a fixed set of syntaxes. This gives more versatility when adding a new language: only the kinds of its comments are needed, although Lexer.mll and Preproc.mll may have to be modified if they do not already know the comment delimiters, for example line comments starting with #. ************************************************************** BUG: The exceptions coming from LexToken.mll when a stylistic constraint is broken in [LexToken.check_right_context] are not caught yet. ************************************************************** Lexer.mll: I moved out as much as I could from the header into a new module LexerLib. The aim is to make it easy to reuse as much as possible of the lexer machinerie, when it cannot be used as is. 2020-04-24 21:06:18 +02:00			`let options =`
			`let open EvalOpt in`
			`let block = mk_block ~opening:"(" ~closing:")"`
			`in read ~block ~line:"//" ".mligo"`
Sharing standalone lexers and parsers, and parser error API. 2020-01-04 19:49:22 +01:00			`end`
Extended lib_utils/pos.ml{i}. First import of Ligodity. (No "simplify" yet.) 2019-05-12 19:31:22 +02:00
Sharing standalone lexers and parsers, and parser error API. 2020-01-04 19:49:22 +01:00			`module M = LexerUnit.Make (IO) (Lexer.Make (LexToken))`
Fixes to the lexer and the parser API. * The parameter for logging the lexer is now mandatory. * The ParserAPI now thread the logging of the lexer. * LexerMain.ml now call the logging of the lexers (CameLIGO, ReasonLIGO). * Fixed bug in lexer when a line comment ends with EOF. 2020-01-31 12:31:25 +01:00
			`let () =`
			`match M.trace () with`
			`Stdlib.Ok () -> ()`
The preprocessor library depends now on the kinds of comments instead of a closed set of languages. I also removed the offsets: I simply use the current region to determine whether the preprocessing directie starts at the beginning of a line. I also removed scanning line indicators, to make the lexer simpler. LexToken.mll: Moved the function [check_right_context] that checks stylistic constraints from Lexer.mll to LexToken.mll. While this triplicates code (as CameLIGO, PascaLIGO and ReasonLIGO share the same constraints), the benefit is that Lexer.mll becomes more generic and the signature for the TOKEN module is simpler (no more exporting predicates, except for EOF). In accordance with the change of the preprocessor, the lexers and parsers for LIGO now depend on the kind of comments, not a fixed set of syntaxes. This gives more versatility when adding a new language: only the kinds of its comments are needed, although Lexer.mll and Preproc.mll may have to be modified if they do not already know the comment delimiters, for example line comments starting with #. ************************************************************** BUG: The exceptions coming from LexToken.mll when a stylistic constraint is broken in [LexToken.check_right_context] are not caught yet. ************************************************************** Lexer.mll: I moved out as much as I could from the header into a new module LexerLib. The aim is to make it easy to reuse as much as possible of the lexer machinerie, when it cannot be used as is. 2020-04-24 21:06:18 +02:00			`\| Error Region.{value; _} -> Printf.eprintf "\027[31m%s\027[0m%!" value`