summaryrefslogtreecommitdiff
path: root/tnslc/src/parse/tokenizer.tnsl
blob: ec34d83db165b78092140710ac3a1eafbd1fe710 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
/#
	Copyright 2021 Kyle Gunger

	This file is licensed under the CDDL 1.0 (the License)
	and may only be used in accordance with the License.
	You should have received a copy of the License with this
	software/source code. If you did not, a copy can be found
	at the following URL:

	https://opensource.org/licenses/CDDL-1.0

	THIS SOFTWARE/SOURCE CODE IS PROVIDED "AS IS" WITH NO
	WARRANTY, GUARANTEE, OR CLAIM OF FITNESS FOR ANY PURPOSE
	EXPRESS OR IMPLIED
#/


/## 
	parse.numeric_literal tokenizes the next numeric literal value in a file.
	Returns a token with the proper data as well as the number of characters read

#; numeric_literal () [Token, uint]

	
;/