Notes...
1. I tried my own demo, a list of 1's, such as
1
1
1
1
When in the following...
while(1)
Log('['+FileReadToken(file)+']');
This returned a list of 1's without any extra spaces or characters between the brackets, so I assume \n is ignored or discarded.
2. In the code above, how come this loop is infinite? Verge never quits with an EOF, it just keeps extending the list of ones. Does the file seeking cursor return to the start of the file?
EDIT: No, this is not the case. The cursor remains at the end of the file and keeps returning the last token. A list of
1 2
1 3
1 5
1 6
8
9
Returned a list of all numbers followed by an infinite list of 9's.