dataframe-csv/org.jetbrains.kotlinx.dataframe.impl.io

Package-level declarations

Types

DataFrameCustomDoubleParser

internal class DataFrameCustomDoubleParser(parserOptions: ParserOptions? = null) : Tokenizer.CustomDoubleParser

Wrapper around FastDoubleParser so we can use it from Deephaven.

ListSink

internal class ListSink(val columnIndex: Int, val dataType: DataType) : SinkSource<Any>

Implementation of Deephaven's Sink and Source that stores data in an ArrayList.

SinkSource

internal interface SinkSource<T : Any> : Sink<T> , Source<T>

Properties

typesDeephavenAlreadyParses

internal val typesDeephavenAlreadyParses: Set<KType>

Types that Deephaven already parses, so we can skip them when defaulting to DataFrame's String parsers.

Functions

readDelimImpl

internal fun readDelimImpl(inputStream: InputStream, delimiter: Char, header: List<String>, charset: Charset?, hasFixedWidthColumns: Boolean, fixedColumnWidths: List<Int>, colTypes: Map<String, ColType>, skipLines: Long, readLines: Long?, parserOptions: ParserOptions?, ignoreEmptyLines: Boolean, allowMissingColumns: Boolean, ignoreExcessColumns: Boolean, quote: Char, ignoreSurroundingSpaces: Boolean, trimInsideQuoted: Boolean, parseParallel: Boolean, compression: Compression<*>, adjustCsvSpecs: AdjustCsvSpecs): DataFrame<*>

Implementation to read delimiter-separated data from an InputStream based on the Deephaven CSV library.

toApache

internal fun QuoteMode.toApache(): QuoteMode

toColType

internal fun KType.toColType(): ColType

toCsvParser

internal fun ColType.toCsvParser(): Parser<*>

Converts a ColType to a Parser from the Deephaven CSV library. If no direct Parser exists, it defaults to Parsers.STRING so that DataFrame.parse can handle it.

toCsvParserOrNull

internal fun ColType.toCsvParserOrNull(): Parser<*>?

Converts a ColType to a Parser from the Deephaven CSV library. If no direct Parser exists, it returns null.

writeDelimImpl

internal fun writeDelimImpl(df: AnyFrame, writer: Appendable, delimiter: Char, includeHeader: Boolean, quote: Char?, quoteMode: QuoteMode, escapeChar: Char?, commentChar: Char?, headerComments: List<String>, recordSeparator: String, adjustCsvFormat: AdjustCSVFormat)

Writes df to writer in a delimiter-separated format.