lex: advancement in lexer development #9
Conversation
Signed-off-by: FedericoBruzzone <[email protected]>
Signed-off-by: FedericoBruzzone <[email protected]>
FedericoBruzzone
changed the title
| Bool(bool), | ||
| Char(char), | ||
| } | ||
| const DOUBLE_TICK: &str = "\""; |
There was a problem hiding this comment.
In english is called quotation mark or similar :)
There was a problem hiding this comment.
That's true, I can call it DOUBLE_QUOTE but for consistency we should rename the TICK to SINGLE_QUOTE.
What do you think about it?
| { "kind": "TokenIdentifier", "lexeme": "x", "location": { "file_path": "", "line": 1, "column_start": 0, "column_end": 1 } }, | ||
| { "kind": "TokenWord", "lexeme": "x", "location": { "file_path": "", "line": 1, "column_start": 0, "column_end": 1 } }, |
There was a problem hiding this comment.
This is actually an identifier
There was a problem hiding this comment.
In the lexer we should find a name for all the words.
You know that this is an identifier because of its position.
For instance, a word (or multiple words) between " or ' is not an identifier, but and we have called this word so far Identifier.
There was a problem hiding this comment.
var x = 10 -> x identifier
var y = "x" -> x is a word/string and Y identifier
I mean, word is a bit useless
literaltoken kind multiple partsstrvar init