Function tokenizeML

tokenize source into array of tokens (excluding EOF)

Prototypes

Token[] tokenizeML(
  const(dstring[]) lines
);

Token[] tokenizeML(
  const(string[]) lines
);

Token[] tokenizeML(
  string code
);

Authors

Vadim Lopatin, coolreader.org@gmail.com

Copyright

Vadim Lopatin, 2015

License

Boost License 1.0