enum Token {
Identifier(SourceLocation, String),
Keyword(SourceLocation, Keywords),
LiteralNumber(SourceLocation, f32),
Stop(SourceLocation),
String(SourceLocation, String),
Symbol(SourceLocation, char),
}
Expand description
Enum for all tokens recognized by the lexer.
Variants§
Identifier(SourceLocation, String)
Keyword(SourceLocation, Keywords)
LiteralNumber(SourceLocation, f32)
Stop(SourceLocation)
String(SourceLocation, String)
Symbol(SourceLocation, char)
Trait Implementations§
Auto Trait Implementations§
impl RefUnwindSafe for Token
impl Send for Token
impl Sync for Token
impl Unpin for Token
impl UnwindSafe for Token
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more