Class CSVTokenizer

Namespace

Core.Loaders

Assembly

Core.dll

High-performance CSV tokenizer for Paradox format (semicolon-delimited). Supports UTF-8 encoding and quoted fields.

[BurstCompile(OptimizeFor = OptimizeFor.Performance)]
public static class CSVTokenizer

Inheritance

object

CSVTokenizer

Methods

Tokenize(NativeSlice<byte>, NativeList<CSVToken>)

Tokenize CSV data with semicolon delimiters

public static CSVTokenizer.CSVTokenizeResult Tokenize(NativeSlice<byte> csvData, NativeList<CSVTokenizer.CSVToken> tokens)

Parameters

csvData NativeSlice<byte>

tokens NativeList<CSVTokenizer.CSVToken>

Returns

CSVTokenizer.CSVTokenizeResult